2020-11-20T11:24:05.640 INFO:root:teuthology version: 1.0.0-357fd4a 2020-11-20T11:24:05.642 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_pdonnell@teuthology --description fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/suites/dbench} --archive /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640275 --verbose --lock --block --name pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi -- /tmp/teuthology-worker.dnbj2i44.tmp 2020-11-20T11:24:05.683 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-11-20T11:24:05.750 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640275 branch: wip-pdonnell-testing-20201120.053228 description: fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/suites/dbench} email: pdonnell@redhat.com first_in_suite: false job_id: '5640275' kernel: client: sha1: distro kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.3' overrides: admin_socket: branch: wip-pdonnell-testing-20201120.053228 ceph: cephfs: session_timeout: 300 cephfs_ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 15m rados osd op timeout: 15m global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 15m rados osd op timeout: 15m mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20201120.053228 sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb owner: scheduled_pdonnell@teuthology priority: 95 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - osd.2 - osd.5 - osd.8 - osd.11 sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb sleep_before_teardown: 0 suite: fs suite_branch: wip-pdonnell-testing-20201120.053228 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20201120.053228/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - workunit: clients: all: - suites/dbench.sh teuthology_branch: master timestamp: 2020-11-20_08:39:42 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.21168 2020-11-20T11:24:05.750 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20201120.053228/qa; will attempt to use it 2020-11-20T11:24:05.751 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20201120.053228/qa/tasks 2020-11-20T11:24:05.751 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-11-20T11:24:05.753 INFO:teuthology.task.internal:Checking packages... 2020-11-20T11:24:05.772 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'basic' and ceph hash 'b86e691bf191566922a8f08e2a5abf64fde8cfcb' 2020-11-20T11:24:05.773 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-11-20T11:24:05.773 INFO:teuthology.packaging:ref: None 2020-11-20T11:24:05.774 INFO:teuthology.packaging:tag: None 2020-11-20T11:24:05.774 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20201120.053228 2020-11-20T11:24:05.774 INFO:teuthology.packaging:sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:24:05.775 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20201120.053228 2020-11-20T11:24:05.937 INFO:teuthology.task.internal:Found packages for ceph version 16.0.0-7397.gb86e691b 2020-11-20T11:24:05.937 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-11-20T11:24:05.946 INFO:teuthology.task.internal:no buildpackages task found 2020-11-20T11:24:05.947 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-11-20T11:24:05.961 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-11-20T11:24:05.962 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-11-20T11:24:06.012 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:24:16.022 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:24:26.038 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:24:36.053 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:24:46.081 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:24:56.098 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:25:06.158 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:25:16.185 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:25:26.203 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:25:36.218 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:25:46.242 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:25:56.260 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:26:06.280 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:26:16.302 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:26:26.318 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:26:36.335 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:26:46.357 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:26:56.373 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:27:06.387 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:27:16.412 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:27:26.428 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:27:36.444 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:27:46.464 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:27:56.488 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:28:06.506 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:28:16.522 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:28:26.537 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:28:36.552 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:28:46.570 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:28:56.586 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:29:06.604 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:29:16.621 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:29:26.638 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:29:36.667 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:29:46.683 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:29:56.702 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:30:06.722 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:30:16.737 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:30:26.756 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:30:36.774 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:30:46.796 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:30:56.813 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:31:06.832 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:31:16.850 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:31:26.867 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:31:36.885 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:31:46.903 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:31:56.915 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:32:06.932 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:32:16.948 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:32:26.957 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:32:36.974 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:32:46.991 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:32:57.049 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:33:07.068 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:33:17.086 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:33:27.106 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:33:37.132 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:33:47.157 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:33:57.174 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:34:07.194 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:34:17.219 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:34:27.245 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:34:37.267 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:34:47.281 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:34:57.295 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:35:07.319 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:35:17.334 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:35:27.349 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:35:37.380 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:35:47.398 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:35:57.417 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:36:07.431 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:36:17.449 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:36:27.471 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:36:37.485 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_pdonnell@teuthology', 'count': 3, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640275'} 2020-11-20T11:36:37.508 DEBUG:teuthology.lock.ops:locked ubuntu@smithi192.front.sepia.ceph.com, ubuntu@smithi146.front.sepia.ceph.com, ubuntu@smithi087.front.sepia.ceph.com 2020-11-20T11:36:37.585 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f15f028ed90>, signals=[15]) 2020-11-20T11:36:37.796 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of rhel 8.3 2020-11-20T11:36:37.799 INFO:teuthology.provision.fog.smithi087:Scheduling deploy of rhel 8.3 2020-11-20T11:36:37.808 INFO:teuthology.provision.fog.smithi146:Scheduling deploy of rhel 8.3 2020-11-20T11:36:38.187 INFO:teuthology.orchestra.console:Power off smithi146 2020-11-20T11:36:38.188 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-11-20T11:36:38.202 INFO:teuthology.orchestra.console:Power off smithi087 2020-11-20T11:36:38.203 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-11-20T11:36:38.217 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:36:38.226 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:36:38.240 INFO:teuthology.orchestra.console:Power off smithi192 2020-11-20T11:36:38.241 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-11-20T11:36:38.264 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:36:42.250 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:36:42.332 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:36:42.340 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:36:46.437 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:36:46.446 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:36:46.456 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:36:46.648 INFO:teuthology.orchestra.console:Power off for smithi087 completed 2020-11-20T11:36:46.658 INFO:teuthology.orchestra.console:Power off for smithi146 completed 2020-11-20T11:36:46.750 INFO:teuthology.orchestra.console:Power on smithi087 2020-11-20T11:36:46.750 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-11-20T11:36:46.759 INFO:teuthology.orchestra.console:Power on smithi146 2020-11-20T11:36:46.759 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-11-20T11:36:46.780 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:36:46.790 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:36:50.569 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:36:50.779 INFO:teuthology.orchestra.console:Power off for smithi192 completed 2020-11-20T11:36:50.806 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:36:50.817 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:36:50.881 INFO:teuthology.orchestra.console:Power on smithi192 2020-11-20T11:36:50.881 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-11-20T11:36:50.902 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:36:54.918 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:36:54.928 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:36:54.934 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:36:55.131 INFO:teuthology.orchestra.console:Power on for smithi087 completed 2020-11-20T11:36:55.137 INFO:teuthology.orchestra.console:Power on for smithi192 completed 2020-11-20T11:36:55.145 INFO:teuthology.orchestra.console:Power on for smithi146 completed 2020-11-20T11:36:55.232 INFO:teuthology.provision.fog.smithi087:Waiting for deploy to finish 2020-11-20T11:36:55.237 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish 2020-11-20T11:36:55.246 INFO:teuthology.provision.fog.smithi146:Waiting for deploy to finish 2020-11-20T11:39:26.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:39:26.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:39:26.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:39:26.661 ERROR:teuthology.orchestra.connection:Error connecting to smithi146.front.sepia.ceph.com Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/connection.py", line 108, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/client.py", line 446, in connect passphrase, File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/client.py", line 764, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/client.py", line 740, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 1580, in auth_publickey return self.auth_handler.wait_for_response(my_event) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/auth_handler.py", line 250, in wait_for_response raise e paramiko.ssh_exception.AuthenticationException: Authentication failed. 2020-11-20T11:39:26.668 ERROR:teuthology.orchestra.connection:Error connecting to smithi192.front.sepia.ceph.com Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/connection.py", line 108, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/client.py", line 446, in connect passphrase, File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/client.py", line 764, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/client.py", line 740, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 1580, in auth_publickey return self.auth_handler.wait_for_response(my_event) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/auth_handler.py", line 250, in wait_for_response raise e paramiko.ssh_exception.AuthenticationException: Authentication failed. 2020-11-20T11:39:35.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:39:44.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:39:53.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:40:02.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:40:11.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:40:20.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:40:29.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:40:33.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:40:33.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:41:01.886 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-11-20T11:41:01.887 INFO:teuthology.orchestra.run.smithi087:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-11-20T11:41:05.475 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-11-20T11:41:05.475 INFO:teuthology.orchestra.run.smithi192:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-11-20T11:41:17.548 INFO:teuthology.provision.fog.smithi087:Node is ready 2020-11-20T11:41:17.548 INFO:teuthology.orchestra.run.smithi087:> hostname 2020-11-20T11:41:17.565 INFO:teuthology.orchestra.run.smithi087.stdout:smithi087 2020-11-20T11:41:17.566 INFO:teuthology.orchestra.run.smithi087:> grep smithi087 /etc/hosts 2020-11-20T11:41:17.620 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87 smithi087.front.sepia.ceph.com smithi087 2020-11-20T11:41:17.621 INFO:teuthology.orchestra.run.smithi087:> sudo hostname smithi087 2020-11-20T11:41:17.760 INFO:teuthology.orchestra.run.smithi087:> sudo sed -i -e 's/smithi087/smithi087/g' /etc/hosts 2020-11-20T11:41:17.786 INFO:teuthology.orchestra.run.smithi087:> sudo sed -i -e 's/172.21.15.87/172.21.15.87/g' /etc/hosts 2020-11-20T11:41:17.851 INFO:teuthology.orchestra.run.smithi087:> sudo sed -i -e 's/smithi087/smithi087/g' /etc/hostname 2020-11-20T11:41:17.915 INFO:teuthology.orchestra.run.smithi087:> sudo hostname smithi087 2020-11-20T11:41:17.978 INFO:teuthology.provision.fog.smithi087:Deploy complete! 2020-11-20T11:41:17.979 DEBUG:teuthology.parallel:result is None 2020-11-20T11:41:25.324 INFO:teuthology.provision.fog.smithi192:Node is ready 2020-11-20T11:41:25.324 INFO:teuthology.orchestra.run.smithi192:> hostname 2020-11-20T11:41:25.365 INFO:teuthology.orchestra.run.smithi192.stdout:smithi192.front.sepia.ceph.com 2020-11-20T11:41:25.366 INFO:teuthology.orchestra.run.smithi192:> grep smithi192.front.sepia.ceph.com /etc/hosts 2020-11-20T11:41:25.446 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.15.192 smithi192.front.sepia.ceph.com smithi192 2020-11-20T11:41:25.446 INFO:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2020-11-20T11:41:25.611 INFO:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hosts 2020-11-20T11:41:25.646 INFO:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/172.21.15.192/172.21.15.192/g' /etc/hosts 2020-11-20T11:41:25.719 INFO:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hostname 2020-11-20T11:41:25.790 INFO:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2020-11-20T11:41:25.861 INFO:teuthology.provision.fog.smithi192:Deploy complete! 2020-11-20T11:41:25.862 DEBUG:teuthology.parallel:result is None 2020-11-20T11:41:39.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:41:39.892 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-11-20T11:41:39.893 INFO:teuthology.orchestra.run.smithi146:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-11-20T11:41:40.222 INFO:teuthology.provision.fog.smithi146:Node is ready 2020-11-20T11:41:40.223 INFO:teuthology.orchestra.run.smithi146:> hostname 2020-11-20T11:41:40.237 INFO:teuthology.orchestra.run.smithi146.stdout:smithi146.front.sepia.ceph.com 2020-11-20T11:41:40.237 INFO:teuthology.orchestra.run.smithi146:> grep smithi146.front.sepia.ceph.com /etc/hosts 2020-11-20T11:41:40.291 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146 smithi146.front.sepia.ceph.com smithi146 2020-11-20T11:41:40.292 INFO:teuthology.orchestra.run.smithi146:> sudo hostname smithi146 2020-11-20T11:41:40.397 INFO:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/smithi146.front.sepia.ceph.com/smithi146/g' /etc/hosts 2020-11-20T11:41:40.422 INFO:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/172.21.15.146/172.21.15.146/g' /etc/hosts 2020-11-20T11:41:40.487 INFO:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/smithi146.front.sepia.ceph.com/smithi146/g' /etc/hostname 2020-11-20T11:41:40.551 INFO:teuthology.orchestra.run.smithi146:> sudo hostname smithi146 2020-11-20T11:41:40.614 INFO:teuthology.provision.fog.smithi146:Deploy complete! 2020-11-20T11:41:40.614 DEBUG:teuthology.parallel:result is None 2020-11-20T11:41:40.766 INFO:teuthology.lock.ops:Checking smithi192.front.sepia.ceph.com 2020-11-20T11:41:40.767 INFO:teuthology.lock.ops:New key found. Updating... 2020-11-20T11:41:40.785 INFO:teuthology.lock.ops:Checking smithi146.front.sepia.ceph.com 2020-11-20T11:41:40.786 INFO:teuthology.lock.ops:New key found. Updating... 2020-11-20T11:41:40.799 INFO:teuthology.lock.ops:Checking smithi087.front.sepia.ceph.com 2020-11-20T11:41:40.800 INFO:teuthology.lock.ops:New key found. Updating... 2020-11-20T11:41:40.814 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: set os type and version on server 2020-11-20T11:41:40.814 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T11:41:40.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:41:40.881 INFO:teuthology.orchestra.run.smithi192:> true 2020-11-20T11:41:41.047 INFO:teuthology.orchestra.run.smithi192:> uname -m 2020-11-20T11:41:41.101 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2020-11-20T11:41:41.102 INFO:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2020-11-20T11:41:41.155 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="Red Hat Enterprise Linux" 2020-11-20T11:41:41.155 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="8.3 (Ootpa)" 2020-11-20T11:41:41.156 INFO:teuthology.orchestra.run.smithi192.stdout:ID="rhel" 2020-11-20T11:41:41.156 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="fedora" 2020-11-20T11:41:41.156 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="8.3" 2020-11-20T11:41:41.156 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el8" 2020-11-20T11:41:41.156 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2020-11-20T11:41:41.157 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2020-11-20T11:41:41.157 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2020-11-20T11:41:41.157 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://www.redhat.com/" 2020-11-20T11:41:41.158 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-11-20T11:41:41.158 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:41:41.158 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-11-20T11:41:41.159 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2020-11-20T11:41:41.159 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-11-20T11:41:41.159 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2020-11-20T11:41:41.160 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2020-11-20T11:41:41.175 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: set os type and version on server 2020-11-20T11:41:41.176 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T11:41:41.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:41:41.246 INFO:teuthology.orchestra.run.smithi146:> true 2020-11-20T11:41:41.411 INFO:teuthology.orchestra.run.smithi146:> uname -m 2020-11-20T11:41:41.465 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2020-11-20T11:41:41.465 INFO:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2020-11-20T11:41:41.519 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="Red Hat Enterprise Linux" 2020-11-20T11:41:41.519 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="8.3 (Ootpa)" 2020-11-20T11:41:41.519 INFO:teuthology.orchestra.run.smithi146.stdout:ID="rhel" 2020-11-20T11:41:41.520 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="fedora" 2020-11-20T11:41:41.520 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="8.3" 2020-11-20T11:41:41.520 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el8" 2020-11-20T11:41:41.520 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2020-11-20T11:41:41.521 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2020-11-20T11:41:41.521 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2020-11-20T11:41:41.522 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://www.redhat.com/" 2020-11-20T11:41:41.522 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-11-20T11:41:41.522 INFO:teuthology.orchestra.run.smithi146.stdout: 2020-11-20T11:41:41.523 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-11-20T11:41:41.523 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2020-11-20T11:41:41.523 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-11-20T11:41:41.523 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2020-11-20T11:41:41.524 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2020-11-20T11:41:41.539 INFO:teuthology.lock.ops:Updating [smithi087.front.sepia.ceph.com]: set os type and version on server 2020-11-20T11:41:41.540 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T11:41:41.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:41:41.606 INFO:teuthology.orchestra.run.smithi087:> true 2020-11-20T11:41:41.776 INFO:teuthology.orchestra.run.smithi087:> uname -m 2020-11-20T11:41:41.830 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64 2020-11-20T11:41:41.831 INFO:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2020-11-20T11:41:41.885 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="Red Hat Enterprise Linux" 2020-11-20T11:41:41.885 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="8.3 (Ootpa)" 2020-11-20T11:41:41.885 INFO:teuthology.orchestra.run.smithi087.stdout:ID="rhel" 2020-11-20T11:41:41.886 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE="fedora" 2020-11-20T11:41:41.886 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="8.3" 2020-11-20T11:41:41.886 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM_ID="platform:el8" 2020-11-20T11:41:41.886 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2020-11-20T11:41:41.887 INFO:teuthology.orchestra.run.smithi087.stdout:ANSI_COLOR="0;31" 2020-11-20T11:41:41.887 INFO:teuthology.orchestra.run.smithi087.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2020-11-20T11:41:41.887 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://www.redhat.com/" 2020-11-20T11:41:41.887 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-11-20T11:41:41.888 INFO:teuthology.orchestra.run.smithi087.stdout: 2020-11-20T11:41:41.888 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-11-20T11:41:41.888 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2020-11-20T11:41:41.888 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-11-20T11:41:41.888 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2020-11-20T11:41:41.889 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2020-11-20T11:41:41.905 INFO:teuthology.task.internal.lock_machines:3 smithi machines locked this try, 3/3 locked so far 2020-11-20T11:41:41.965 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi087.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyQREByNYC5DaKSPsf+8C7u7a8020f9XZfB4vaZeJK7+GWd00IJeDNnQ0idLggJFBikBrnBrJ9cmsYpRoODWI7L+H0FKpf97sVzfgS3XWtWbSB6+U4xcBg1krpfhce3Zo9Qc+iFfcx6kNeyRZCFRVcq80xBGgqPkl1fqznzmAZ26P/Phcz0EtmWIe9MJpm0teufQHljIckV3B5DyfWfQ29w0MyGJD/9rLZmzcQqmbIJ5NWMrd7Xy/vj3RcUZSMii0e3ui7eySL9AfTxz1Z1j4OD0wUoSJZImDxT92pclwhefX2UnypUqAXwkpPVjYR5utZJkFQmhgDJhhlNrd3q79AvK90f8I8kEiX4uqeiHvKK3V56WmpTmCYZiaFU5sbZ0uc1V/01/6Tkf6eRjMlpaKiqooiAiL98lIAU2sTDB8K+Gz7iUbUrgqf+EAsi/32eG5WlCRIYL0iiNFbcqO/pAw56Ja6vCUmB/HTdhf16ZsJM1HA8bdqfxohWMk7Be1g29s= smithi146.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfODP2sZvosIZwhSmzF6qg9vkVOb/1rtNlxDuvjlWfIhBv06CGy3ZidHuk72xvjTm4sRk7ibeQ+XvYHpE8sUTOHdXFLzvtuTjzYaA8FShGTHIcwb6q8GOPkane7bDN4t4qNGrHVHmuw/lYScNF3AksYMdbX4QDnF8bM8Nwsit6hORivbRBOWN6a3ASw1D3BdBJIWDdG/N1NK6eW80rIVpCM9nYuGg1T4nix4jii7/6WgD39DIWzrCZG1WupZ7cmrpGTDaRwjFk6y/CAk+zQ+0Nkmyo1nOF+H5XeqQ7ryYHp2jK/TauacqnGgcBwGJ0JRXK8rqfuEKzeU8Xesz6myGVAjz63HdGnQPvWo1+00brk22SX+XeklXTTtQVxWWykZhSlugjiiXhi83mW+pkRs6Y42OFJtweoPEcS2/ZWISm3jzqp+pxiQ0nbXfQjvt0h5fnWnDMhY21mOpmvbAeV2uEtIYAw2hiij8f8afooFxTIRP8vRsGdkcHqa+OUoDC//s= smithi192.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDW+8g4wlw1XKlVbFJrpQ0e5OSZe77fmRFLUwPN6/VdSJ2HDyjj9mUhz7zYUu11a+D/OL4vasXUysu+isMK2zqkwPbi7cAFKuwDZmNHMijzv0Qfwy9zgqVQlkNiQ0hYcWb7ItL95X0erwxxgyUmV3y0SQzjGkajhYYniABHY5IFlAvT7ZzAoGRNyX4cwf7olhqYQWwCX18BrsRO5BP8nVi8UiphS5t3l2XptJq4USjDKmkMAKQ5K7shJliOjFjqW2iO9/FNOWXLgcPPPElw8BdnTG8uvAfXoSeAebJItJIG0a1XbSZGY1F91XY3IksgPGbdav3Ei0P3yB7h5hB3Z4WzPpec9RbVYt2CYSxU2Wfz8cbBFfvEY+0H/a8HU+uO31O4okr2W8K3mcE+IPwUKMbs9ScjXhLeflyQwMnplV2sGcs7mjfirYyPmSF7bCeClyZhFh1lJTBZPkFZ8kD6jYQhJae64K9+pJB5ZrEs5H3WYsF5enwsttqotx1tjkOSgh8= 2020-11-20T11:41:41.965 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-11-20T11:41:42.020 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-11-20T11:41:42.027 INFO:teuthology.task.internal:Saving configuration 2020-11-20T11:41:42.045 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-11-20T11:41:42.115 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-11-20T11:41:42.134 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-11-20 11:36:37.491385', 'description': '/home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640275', 'locked_by': 'scheduled_pdonnell@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG6fbJEMDALNN00xDx6+klEh8VZArYsDAoAAWcKBZXWiV1MZg1JGMtb1f8pDu4XON2wB6Zhruq4wWAs2D/ZJDgI=', 'os_version': '8.3', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'rhel', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi192.front.sepia.ceph.com'} 2020-11-20T11:41:42.151 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-11-20 11:36:37.491406', 'description': '/home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640275', 'locked_by': 'scheduled_pdonnell@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOOHg+2TvSQsty5LGjQKU1s46OW8+2QpBXDXrF+VISakEcGocivasAjn+HpV2q+ZQomobNngEqi2cMJ8I8fnoBE=', 'os_version': '8.3', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'rhel', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi146.front.sepia.ceph.com'} 2020-11-20T11:41:42.167 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-11-20 11:36:37.491422', 'description': '/home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640275', 'locked_by': 'scheduled_pdonnell@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFZT6LDXWZuQ5kIrxoF4c4SJdar8GJjsD0MXgHdewOx0rtyC6EnOExKA7GBqmpemeef88aRn0OJ9YUHNVoAfUdk=', 'os_version': '8.3', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'rhel', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi087.front.sepia.ceph.com'} 2020-11-20T11:41:42.168 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-11-20T11:41:42.177 INFO:teuthology.task.internal:roles: ubuntu@smithi192.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2020-11-20T11:41:42.177 INFO:teuthology.task.internal:roles: ubuntu@smithi146.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2020-11-20T11:41:42.177 INFO:teuthology.task.internal:roles: ubuntu@smithi087.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2020-11-20T11:41:42.177 INFO:teuthology.run_tasks:Running task console_log... 2020-11-20T11:41:42.273 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f15efb29510>, signals=[15]) 2020-11-20T11:41:42.274 INFO:teuthology.run_tasks:Running task internal.connect... 2020-11-20T11:41:42.285 INFO:teuthology.task.internal:Opening connections... 2020-11-20T11:41:42.286 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi192.front.sepia.ceph.com 2020-11-20T11:41:42.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:41:42.360 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi146.front.sepia.ceph.com 2020-11-20T11:41:42.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:41:42.433 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi087.front.sepia.ceph.com 2020-11-20T11:41:42.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:41:42.503 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-11-20T11:41:42.515 INFO:teuthology.orchestra.run.smithi192:> uname -m 2020-11-20T11:41:42.530 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2020-11-20T11:41:42.531 INFO:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2020-11-20T11:41:42.585 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="Red Hat Enterprise Linux" 2020-11-20T11:41:42.585 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="8.3 (Ootpa)" 2020-11-20T11:41:42.586 INFO:teuthology.orchestra.run.smithi192.stdout:ID="rhel" 2020-11-20T11:41:42.586 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="fedora" 2020-11-20T11:41:42.586 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="8.3" 2020-11-20T11:41:42.586 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el8" 2020-11-20T11:41:42.586 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2020-11-20T11:41:42.587 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2020-11-20T11:41:42.587 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2020-11-20T11:41:42.587 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://www.redhat.com/" 2020-11-20T11:41:42.587 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-11-20T11:41:42.588 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:41:42.588 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-11-20T11:41:42.588 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2020-11-20T11:41:42.588 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-11-20T11:41:42.588 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2020-11-20T11:41:42.589 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2020-11-20T11:41:42.605 INFO:teuthology.orchestra.run.smithi146:> uname -m 2020-11-20T11:41:42.620 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2020-11-20T11:41:42.621 INFO:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2020-11-20T11:41:42.675 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="Red Hat Enterprise Linux" 2020-11-20T11:41:42.675 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="8.3 (Ootpa)" 2020-11-20T11:41:42.675 INFO:teuthology.orchestra.run.smithi146.stdout:ID="rhel" 2020-11-20T11:41:42.676 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="fedora" 2020-11-20T11:41:42.676 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="8.3" 2020-11-20T11:41:42.676 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el8" 2020-11-20T11:41:42.676 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2020-11-20T11:41:42.677 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2020-11-20T11:41:42.677 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2020-11-20T11:41:42.677 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://www.redhat.com/" 2020-11-20T11:41:42.678 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-11-20T11:41:42.678 INFO:teuthology.orchestra.run.smithi146.stdout: 2020-11-20T11:41:42.679 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-11-20T11:41:42.680 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2020-11-20T11:41:42.680 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-11-20T11:41:42.680 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2020-11-20T11:41:42.681 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2020-11-20T11:41:42.696 INFO:teuthology.orchestra.run.smithi087:> uname -m 2020-11-20T11:41:42.712 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64 2020-11-20T11:41:42.712 INFO:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2020-11-20T11:41:42.766 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="Red Hat Enterprise Linux" 2020-11-20T11:41:42.766 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="8.3 (Ootpa)" 2020-11-20T11:41:42.766 INFO:teuthology.orchestra.run.smithi087.stdout:ID="rhel" 2020-11-20T11:41:42.766 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE="fedora" 2020-11-20T11:41:42.767 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="8.3" 2020-11-20T11:41:42.767 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM_ID="platform:el8" 2020-11-20T11:41:42.767 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2020-11-20T11:41:42.767 INFO:teuthology.orchestra.run.smithi087.stdout:ANSI_COLOR="0;31" 2020-11-20T11:41:42.768 INFO:teuthology.orchestra.run.smithi087.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2020-11-20T11:41:42.768 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://www.redhat.com/" 2020-11-20T11:41:42.768 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-11-20T11:41:42.768 INFO:teuthology.orchestra.run.smithi087.stdout: 2020-11-20T11:41:42.768 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-11-20T11:41:42.769 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2020-11-20T11:41:42.769 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-11-20T11:41:42.769 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2020-11-20T11:41:42.769 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2020-11-20T11:41:42.784 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-11-20T11:41:42.830 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-11-20T11:41:42.842 INFO:teuthology.task.internal:Checking for old test directory... 2020-11-20T11:41:42.843 INFO:teuthology.orchestra.run.smithi087:> test '!' -e /home/ubuntu/cephtest 2020-11-20T11:41:42.845 INFO:teuthology.orchestra.run.smithi146:> test '!' -e /home/ubuntu/cephtest 2020-11-20T11:41:42.848 INFO:teuthology.orchestra.run.smithi192:> test '!' -e /home/ubuntu/cephtest 2020-11-20T11:41:42.863 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-11-20T11:41:42.874 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-11-20T11:41:42.875 INFO:teuthology.orchestra.run.smithi087:> test -z $(ls -A /var/lib/ceph) 2020-11-20T11:41:42.899 INFO:teuthology.orchestra.run.smithi146:> test -z $(ls -A /var/lib/ceph) 2020-11-20T11:41:42.902 INFO:teuthology.orchestra.run.smithi192:> test -z $(ls -A /var/lib/ceph) 2020-11-20T11:41:42.926 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-11-20T11:41:42.988 INFO:teuthology.run_tasks:Running task kernel... 2020-11-20T11:41:43.006 DEBUG:teuthology.task.kernel:normalized config {'client.0': {'sha1': 'distro'}} 2020-11-20T11:41:43.007 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2020-11-20T11:41:43.007 INFO:teuthology.orchestra.run.smithi192:> uname -r 2020-11-20T11:41:43.021 INFO:teuthology.orchestra.run.smithi192.stdout:4.18.0-240.1.1.el8_3.x86_64 2020-11-20T11:41:43.022 INFO:teuthology.task.kernel:Running kernel on smithi192: 4.18.0-240.1.1.el8_3.x86_64 2020-11-20T11:41:43.022 INFO:teuthology.orchestra.run.smithi192:> sudo yum install -y kernel 2020-11-20T11:41:44.483 INFO:teuthology.orchestra.run.smithi192.stdout:Updating Subscription Management repositories. 2020-11-20T11:41:44.487 INFO:teuthology.orchestra.run.smithi192.stdout:Unable to read consumer identity 2020-11-20T11:41:44.578 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:41:44.578 INFO:teuthology.orchestra.run.smithi192.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-11-20T11:41:44.578 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:41:46.314 INFO:teuthology.orchestra.run.smithi192.stdout:Extra Packages for Enterprise Linux 21 MB/s | 8.3 MB 00:00 2020-11-20T11:41:47.989 INFO:teuthology.orchestra.run.smithi192.stdout:lab-extras 4.4 MB/s | 23 kB 00:00 2020-11-20T11:41:48.036 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:00:01 ago on Fri 20 Nov 2020 11:41:47 AM UTC. 2020-11-20T11:41:48.499 INFO:teuthology.orchestra.run.smithi192.stdout:Package kernel-4.18.0-240.1.1.el8_3.x86_64 is already installed. 2020-11-20T11:41:48.500 INFO:teuthology.orchestra.run.smithi192.stdout:Package kernel-4.18.0-240.el8.x86_64 is already installed. 2020-11-20T11:41:48.606 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2020-11-20T11:41:48.611 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2020-11-20T11:41:48.611 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2020-11-20T11:41:48.710 INFO:teuthology.orchestra.run.smithi192:> echo no | sudo yum reinstall kernel || true 2020-11-20T11:41:48.980 INFO:teuthology.orchestra.run.smithi192.stdout:Updating Subscription Management repositories. 2020-11-20T11:41:48.981 INFO:teuthology.orchestra.run.smithi192.stdout:Unable to read consumer identity 2020-11-20T11:41:49.028 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:41:49.030 INFO:teuthology.orchestra.run.smithi192.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-11-20T11:41:49.031 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:41:49.194 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Nov 2020 11:41:47 AM UTC. 2020-11-20T11:41:49.320 INFO:teuthology.orchestra.run.smithi192.stdout:Installed package kernel-4.18.0-240.1.1.el8_3.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2020-11-20T11:41:49.321 INFO:teuthology.orchestra.run.smithi192.stdout:Installed package kernel-4.18.0-240.el8.x86_64 (from anaconda) not available. 2020-11-20T11:41:49.359 INFO:teuthology.orchestra.run.smithi192.stderr:Error: No packages marked for reinstall. 2020-11-20T11:41:49.394 INFO:teuthology.orchestra.run.smithi192:> sudo yum reinstall -y kernel || true 2020-11-20T11:41:49.665 INFO:teuthology.orchestra.run.smithi192.stdout:Updating Subscription Management repositories. 2020-11-20T11:41:49.666 INFO:teuthology.orchestra.run.smithi192.stdout:Unable to read consumer identity 2020-11-20T11:41:49.709 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:41:49.710 INFO:teuthology.orchestra.run.smithi192.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-11-20T11:41:49.710 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:41:49.878 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Nov 2020 11:41:47 AM UTC. 2020-11-20T11:41:50.020 INFO:teuthology.orchestra.run.smithi192.stdout:Installed package kernel-4.18.0-240.1.1.el8_3.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2020-11-20T11:41:50.021 INFO:teuthology.orchestra.run.smithi192.stdout:Installed package kernel-4.18.0-240.el8.x86_64 (from anaconda) not available. 2020-11-20T11:41:50.048 INFO:teuthology.orchestra.run.smithi192.stderr:Error: No packages marked for reinstall. 2020-11-20T11:41:50.087 INFO:teuthology.orchestra.run.smithi192:> rpm -q kernel --last | head -n 1 2020-11-20T11:41:50.171 INFO:teuthology.orchestra.run.smithi192.stdout:kernel-4.18.0-240.1.1.el8_3.x86_64 Tue 10 Nov 2020 09:16:49 PM UTC 2020-11-20T11:41:50.173 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-240.1.1.el8_3.x86_64 2020-11-20T11:41:50.173 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-11-20T11:41:50.173 INFO:teuthology.run_tasks:Running task internal.base... 2020-11-20T11:41:50.181 INFO:teuthology.task.internal:Creating test directory... 2020-11-20T11:41:50.181 INFO:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-11-20T11:41:50.183 INFO:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-11-20T11:41:50.186 INFO:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-11-20T11:41:50.200 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-11-20T11:41:50.214 INFO:teuthology.run_tasks:Running task internal.archive... 2020-11-20T11:41:50.243 INFO:teuthology.task.internal:Creating archive directory... 2020-11-20T11:41:50.243 INFO:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-11-20T11:41:50.246 INFO:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-11-20T11:41:50.248 INFO:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-11-20T11:41:50.276 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-11-20T11:41:50.283 INFO:teuthology.task.internal:Enabling coredump saving... 2020-11-20T11:41:50.284 INFO:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-11-20T11:41:50.318 INFO:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-11-20T11:41:50.321 INFO:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-11-20T11:41:50.355 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T11:41:50.357 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T11:41:50.359 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T11:41:50.374 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T11:41:50.375 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T11:41:50.377 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T11:41:50.378 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-11-20T11:41:50.386 INFO:teuthology.task.internal:Configuring sudo... 2020-11-20T11:41:50.387 INFO:teuthology.orchestra.run.smithi087:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-11-20T11:41:50.418 INFO:teuthology.orchestra.run.smithi146:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-11-20T11:41:50.421 INFO:teuthology.orchestra.run.smithi192:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-11-20T11:41:50.446 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-11-20T11:41:50.460 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-11-20T11:41:50.461 INFO:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-11-20T11:41:50.486 INFO:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-11-20T11:41:50.489 INFO:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-11-20T11:41:50.503 INFO:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T11:41:50.578 INFO:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T11:41:50.634 INFO:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T11:41:50.709 INFO:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T11:41:50.753 INFO:teuthology.orchestra.run.smithi192:> set -ex 2020-11-20T11:41:50.754 INFO:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T11:41:50.807 INFO:teuthology.orchestra.run.smithi192.stderr:+ sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T11:41:50.816 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records in 2020-11-20T11:41:50.816 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records out 2020-11-20T11:41:50.816 INFO:teuthology.orchestra.run.smithi192.stderr:152 bytes copied, 2.9219e-05 s, 5.2 MB/s 2020-11-20T11:41:50.818 INFO:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T11:41:50.853 INFO:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T11:41:50.935 INFO:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T11:41:50.969 INFO:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T11:41:51.020 INFO:teuthology.orchestra.run.smithi146:> set -ex 2020-11-20T11:41:51.020 INFO:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T11:41:51.074 INFO:teuthology.orchestra.run.smithi146.stderr:+ sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T11:41:51.084 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records in 2020-11-20T11:41:51.085 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records out 2020-11-20T11:41:51.085 INFO:teuthology.orchestra.run.smithi146.stderr:152 bytes copied, 3.0634e-05 s, 5.0 MB/s 2020-11-20T11:41:51.086 INFO:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T11:41:51.122 INFO:teuthology.orchestra.run.smithi087:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T11:41:51.251 INFO:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T11:41:51.286 INFO:teuthology.orchestra.run.smithi087:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T11:41:51.336 INFO:teuthology.orchestra.run.smithi087:> set -ex 2020-11-20T11:41:51.337 INFO:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T11:41:51.391 INFO:teuthology.orchestra.run.smithi087.stderr:+ sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T11:41:51.401 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records in 2020-11-20T11:41:51.401 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records out 2020-11-20T11:41:51.402 INFO:teuthology.orchestra.run.smithi087.stderr:152 bytes copied, 3.2885e-05 s, 4.6 MB/s 2020-11-20T11:41:51.403 INFO:teuthology.orchestra.run.smithi087:> sudo service rsyslog restart 2020-11-20T11:41:51.445 INFO:teuthology.orchestra.run.smithi146:> sudo service rsyslog restart 2020-11-20T11:41:51.448 INFO:teuthology.orchestra.run.smithi192:> sudo service rsyslog restart 2020-11-20T11:41:51.513 INFO:teuthology.orchestra.run.smithi087.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-11-20T11:41:51.516 INFO:teuthology.orchestra.run.smithi146.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-11-20T11:41:51.525 INFO:teuthology.orchestra.run.smithi192.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-11-20T11:41:51.859 INFO:teuthology.run_tasks:Running task internal.timer... 2020-11-20T11:41:51.870 INFO:teuthology.task.internal:Starting timer... 2020-11-20T11:41:51.870 INFO:teuthology.run_tasks:Running task pcp... 2020-11-20T11:41:51.886 INFO:teuthology.run_tasks:Running task selinux... 2020-11-20T11:41:51.916 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2020-11-20T11:41:51.917 INFO:teuthology.orchestra.run.smithi087:> sudo service auditd rotate 2020-11-20T11:41:52.091 INFO:teuthology.orchestra.run.smithi087.stdout:Rotating logs: [ OK ] 2020-11-20T11:41:52.092 INFO:teuthology.orchestra.run.smithi146:> sudo service auditd rotate 2020-11-20T11:41:52.214 INFO:teuthology.orchestra.run.smithi146.stdout:Rotating logs: [ OK ] 2020-11-20T11:41:52.216 INFO:teuthology.orchestra.run.smithi192:> sudo service auditd rotate 2020-11-20T11:41:52.273 INFO:teuthology.orchestra.run.smithi192.stdout:Rotating logs: [ OK ] 2020-11-20T11:41:52.275 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-11-20T11:41:52.275 INFO:teuthology.orchestra.run.smithi192:> /usr/sbin/getenforce 2020-11-20T11:41:52.303 INFO:teuthology.orchestra.run.smithi192.stdout:Permissive 2020-11-20T11:41:52.304 INFO:teuthology.orchestra.run.smithi146:> /usr/sbin/getenforce 2020-11-20T11:41:52.323 INFO:teuthology.orchestra.run.smithi146.stdout:Permissive 2020-11-20T11:41:52.323 INFO:teuthology.orchestra.run.smithi087:> /usr/sbin/getenforce 2020-11-20T11:41:52.344 INFO:teuthology.orchestra.run.smithi087.stdout:Permissive 2020-11-20T11:41:52.345 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi192.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi146.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi087.front.sepia.ceph.com': 'permissive'} 2020-11-20T11:41:52.345 INFO:teuthology.orchestra.run.smithi192:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-11-20T11:41:52.369 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T11:41:52.369 INFO:teuthology.orchestra.run.smithi146:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-11-20T11:41:52.395 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T11:41:52.396 INFO:teuthology.orchestra.run.smithi087:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-11-20T11:41:52.421 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T11:41:52.421 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-11-20T11:41:52.422 INFO:teuthology.orchestra.run.smithi192:> sudo /usr/sbin/setenforce permissive 2020-11-20T11:41:52.448 INFO:teuthology.orchestra.run.smithi146:> sudo /usr/sbin/setenforce permissive 2020-11-20T11:41:52.472 INFO:teuthology.orchestra.run.smithi087:> sudo /usr/sbin/setenforce permissive 2020-11-20T11:41:52.497 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-11-20T11:41:52.509 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated; assuming it is current 2020-11-20T11:41:52.509 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-11-20T11:41:52.521 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-11-20T11:41:52.523 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi192.front.sepia.ceph.com,smithi146.front.sepia.ceph.com,smithi087.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-11-20T11:41:52.849 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-11-20T11:41:53.722 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-11-20T11:41:56.295 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-11-20T11:41:56.315 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:41:56 +0000 (0:00:00.071) 0:00:00.071 ******* 2020-11-20T11:41:56.327 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:41:56 +0000 (0:00:00.012) 0:00:00.083 ******* 2020-11-20T11:41:56.341 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:41:56 +0000 (0:00:00.013) 0:00:00.096 ******* 2020-11-20T11:41:57.845 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi192.front.sepia.ceph.com] 2020-11-20T11:41:57.886 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] 2020-11-20T11:41:57.944 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:41:57 +0000 (0:00:01.603) 0:00:01.700 ******* 2020-11-20T11:41:57.954 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] 2020-11-20T11:41:57.994 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:41:57 +0000 (0:00:00.049) 0:00:01.749 ******* 2020-11-20T11:41:58.060 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:41:58 +0000 (0:00:00.066) 0:00:01.816 ******* 2020-11-20T11:41:58.245 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-20T11:41:58.247 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-20T11:41:58.281 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:41:58 +0000 (0:00:00.220) 0:00:02.036 ******* 2020-11-20T11:41:58.312 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:41:58 +0000 (0:00:00.031) 0:00:02.068 ******* 2020-11-20T11:41:58.318 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-20T11:41:58.354 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:41:58 +0000 (0:00:00.042) 0:00:02.110 ******* 2020-11-20T11:41:58.678 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** ok: [smithi087.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-11-20T11:41:58.679 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-11-20T11:41:58.715 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:41:58 +0000 (0:00:00.359) 0:00:02.470 ******* 2020-11-20T11:41:58.746 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:41:58 +0000 (0:00:00.031) 0:00:02.502 ******* 2020-11-20T11:41:58.752 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-11-20T11:41:58.753 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:41:58.787 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:41:58 +0000 (0:00:00.040) 0:00:02.543 ******* 2020-11-20T11:41:58.819 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:41:58 +0000 (0:00:00.031) 0:00:02.574 ******* 2020-11-20T11:41:58.824 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:41:58.859 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:41:58 +0000 (0:00:00.040) 0:00:02.614 ******* 2020-11-20T11:41:58.865 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:41:58.900 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:41:58 +0000 (0:00:00.041) 0:00:02.656 ******* 2020-11-20T11:41:59.083 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** ok: [smithi146.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:41:59.084 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:41:59.086 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:41:59.119 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:41:59 +0000 (0:00:00.219) 0:00:02.875 ******* 2020-11-20T11:41:59.150 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:41:59 +0000 (0:00:00.030) 0:00:02.905 ******* 2020-11-20T11:41:59.181 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:41:59 +0000 (0:00:00.030) 0:00:02.936 ******* 2020-11-20T11:41:59.971 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2020-11-20T11:41:59.973 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605872519.1315634-51988632235737/source", "state": "file", "uid": 0} 2020-11-20T11:42:00.026 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:00 +0000 (0:00:00.845) 0:00:03.782 ******* 2020-11-20T11:42:00.039 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605872519.162533-126981820017342/source", "state": "file", "uid": 0} 2020-11-20T11:42:00.042 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605872519.1932778-237471831692222/source", "state": "file", "uid": 0} 2020-11-20T11:42:00.078 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:00 +0000 (0:00:00.051) 0:00:03.833 ******* 2020-11-20T11:42:00.115 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:00 +0000 (0:00:00.034) 0:00:03.867 ******* 2020-11-20T11:42:00.594 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtC 2020-11-20T11:42:00.596 INFO:teuthology.task.ansible.out:toHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1 2020-11-20T11:42:00.598 INFO:teuthology.task.ansible.out:cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P 2020-11-20T11:42:00.599 INFO:teuthology.task.ansible.out:2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3Nz 2020-11-20T11:42:00.601 INFO:teuthology.task.ansible.out:aC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-11-20T11:42:00.811 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2020-11-20T11:42:00.817 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-11-20T11:42:00.977 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:00 +0000 (0:00:00.864) 0:00:04.732 ******* 2020-11-20T11:42:01.020 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:01 +0000 (0:00:00.043) 0:00:04.776 ******* 2020-11-20T11:42:01.062 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:01 +0000 (0:00:00.042) 0:00:04.818 ******* 2020-11-20T11:42:01.606 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi087.front.sepia.ceph.com] 2020-11-20T11:42:01.703 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2020-11-20T11:42:01.705 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:01 +0000 (0:00:00.641) 0:00:05.460 ******* 2020-11-20T11:42:01.715 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] 2020-11-20T11:42:01.729 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] 2020-11-20T11:42:01.828 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:01 +0000 (0:00:00.123) 0:00:05.583 ******* 2020-11-20T11:42:01.864 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:01 +0000 (0:00:00.036) 0:00:05.620 ******* 2020-11-20T11:42:02.203 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-11-20T11:42:02.205 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.180207", "end": "2020-11-20 11:42:02.173969", "rc": 0, "start": "2020-11-20 11:42:01.993762", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T11:42:02.238 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:02 +0000 (0:00:00.373) 0:00:05.994 ******* 2020-11-20T11:42:02.244 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.219923", "end": "2020-11-20 11:42:02.210079", "rc": 0, "start": "2020-11-20 11:42:01.990156", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T11:42:02.297 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:02 +0000 (0:00:00.058) 0:00:06.052 ******* 2020-11-20T11:42:02.306 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.170674", "end": "2020-11-20 11:42:02.227868", "rc": 0, "start": "2020-11-20 11:42:02.057194", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T11:42:02.348 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:02 +0000 (0:00:00.051) 0:00:06.104 ******* 2020-11-20T11:42:02.430 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-11-20T11:42:02.432 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.010741", "end": "2020-11-20 11:42:02.402225", "failed_when_result": false, "rc": 0, "start": "2020-11-20 11:42:02.391484", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T11:42:02.481 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:02 +0000 (0:00:00.132) 0:00:06.237 ******* 2020-11-20T11:42:02.499 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.017273", "end": "2020-11-20 11:42:02.475200", "failed_when_result": false, "rc": 0, "start": "2020-11-20 11:42:02.457927", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T11:42:02.533 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:02 +0000 (0:00:00.051) 0:00:06.289 ******* 2020-11-20T11:42:02.538 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-11-20T11:42:02.540 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-11-20T11:42:02.574 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:02 +0000 (0:00:00.041) 0:00:06.330 ******* 2020-11-20T11:42:02.580 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-11-20T11:42:02.581 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.006894", "end": "2020-11-20 11:42:02.515852", "failed_when_result": false, "rc": 0, "start": "2020-11-20 11:42:02.508958", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} TASK [users : Determine if we can skip users and pubkeys updates] ************** ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-11-20T11:42:02.616 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:02 +0000 (0:00:00.042) 0:00:06.372 ******* 2020-11-20T11:42:02.647 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:02 +0000 (0:00:00.030) 0:00:06.403 ******* 2020-11-20T11:42:02.652 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-11-20T11:42:02.654 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:02.691 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:02 +0000 (0:00:00.044) 0:00:06.447 ******* 2020-11-20T11:42:02.722 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:02 +0000 (0:00:00.030) 0:00:06.477 ******* 2020-11-20T11:42:02.728 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-11-20T11:42:02.730 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} TASK [users : Remove managed_admin_users from managed_users] ******************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:02.763 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:02 +0000 (0:00:00.041) 0:00:06.519 ******* 2020-11-20T11:42:02.794 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:02 +0000 (0:00:00.030) 0:00:06.550 ******* 2020-11-20T11:42:02.800 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:02.802 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:02.835 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:02 +0000 (0:00:00.041) 0:00:06.591 ******* 2020-11-20T11:42:02.875 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:02 +0000 (0:00:00.039) 0:00:06.631 ******* 2020-11-20T11:42:02.881 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-11-20T11:42:02.882 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:02.916 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:02 +0000 (0:00:00.041) 0:00:06.672 ******* 2020-11-20T11:42:02.948 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:02 +0000 (0:00:00.031) 0:00:06.704 ******* 2020-11-20T11:42:02.953 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-11-20T11:42:02.955 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Set UID_MIN to 1001] ********************************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:02.989 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:02 +0000 (0:00:00.040) 0:00:06.745 ******* 2020-11-20T11:42:03.021 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:03 +0000 (0:00:00.031) 0:00:06.776 ******* 2020-11-20T11:42:03.027 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-11-20T11:42:03.030 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.064 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:03 +0000 (0:00:00.044) 0:00:06.820 ******* 2020-11-20T11:42:03.071 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-20T11:42:03.072 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.073 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.075 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.075 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669c 2020-11-20T11:42:03.079 INFO:teuthology.task.ansible.out:f7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.112 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:03 +0000 (0:00:00.047) 0:00:06.867 ******* 2020-11-20T11:42:03.118 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.120 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} TASK [users : Filter the managed_users list] *********************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.121 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b4 2020-11-20T11:42:03.122 INFO:teuthology.task.ansible.out:90a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW 2020-11-20T11:42:03.124 INFO:teuthology.task.ansible.out:2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis 2020-11-20T11:42:03.125 INFO:teuthology.task.ansible.out:", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317a 2020-11-20T11:42:03.127 INFO:teuthology.task.ansible.out:e89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.158 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:03 +0000 (0:00:00.047) 0:00:06.914 ******* 2020-11-20T11:42:03.166 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.167 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.169 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.169 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyu 2020-11-20T11:42:03.171 INFO:teuthology.task.ansible.out:riw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9 2020-11-20T11:42:03.173 INFO:teuthology.task.ansible.out:+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.208 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:03 +0000 (0:00:00.049) 0:00:06.964 ******* 2020-11-20T11:42:03.215 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-11-20T11:42:03.217 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.217 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.218 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.219 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.220 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.220 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJi 2020-11-20T11:42:03.222 INFO:teuthology.task.ansible.out:hFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.257 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:03 +0000 (0:00:00.049) 0:00:07.013 ******* 2020-11-20T11:42:03.264 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.266 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.268 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.269 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.270 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.281 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.283 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.283 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmi 2020-11-20T11:42:03.285 INFO:teuthology.task.ansible.out:ck@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} TASK [users : Set UID_MIN to 1001] ********************************************* skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440 2020-11-20T11:42:03.286 INFO:teuthology.task.ansible.out:e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.321 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:03 +0000 (0:00:00.063) 0:00:07.077 ******* 2020-11-20T11:42:03.328 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.329 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.330 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.331 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.332 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.333 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2 2020-11-20T11:42:03.338 INFO:teuthology.task.ansible.out:Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d63774 2020-11-20T11:42:03.341 INFO:teuthology.task.ansible.out:6a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.346 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.349 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "c 2020-11-20T11:42:03.350 INFO:teuthology.task.ansible.out:hanged": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smit 2020-11-20T11:42:03.352 INFO:teuthology.task.ansible.out:hi087.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.364 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.365 INFO:teuthology.task.ansible.out: skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.366 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.366 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@h 2020-11-20T11:42:03.368 INFO:teuthology.task.ansible.out:ome hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa 2020-11-20T11:42:03.369 INFO:teuthology.task.ansible.out:\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.379 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.381 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.381 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com 2020-11-20T11:42:03.383 INFO:teuthology.task.ansible.out:] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e 2020-11-20T11:42:03.385 INFO:teuthology.task.ansible.out:7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.394 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.396 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0 2020-11-20T11:42:03.397 INFO:teuthology.task.ansible.out:LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.408 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.410 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.410 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, 2020-11-20T11:42:03.412 INFO:teuthology.task.ansible.out:"item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.423 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.427 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae30 2020-11-20T11:42:03.428 INFO:teuthology.task.ansible.out:4abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": 2020-11-20T11:42:03.430 INFO:teuthology.task.ansible.out: "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2020-11-20T11:42:03.432 INFO:teuthology.task.ansible.out: 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was 2020-11-20T11:42:03.434 INFO:teuthology.task.ansible.out:False"} 2020-11-20T11:42:03.443 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.444 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.446 INFO:teuthology.task.ansible.out: 2020-11-20T11:42:03.446 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.447 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.447 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455 2020-11-20T11:42:03.448 INFO:teuthology.task.ansible.out:b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible 2020-11-20T11:42:03.450 INFO:teuthology.task.ansible.out:_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.459 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.461 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.462 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.464 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.464 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfo 2020-11-20T11:42:03.466 INFO:teuthology.task.ansible.out:nsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.476 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.478 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.479 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'wusu 2020-11-20T11:42:03.480 INFO:teuthology.task.ansible.out:i', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.489 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.491 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'k 2020-11-20T11:42:03.493 INFO:teuthology.task.ansible.out:keithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.502 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.505 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.c 2020-11-20T11:42:03.507 INFO:teuthology.task.ansible.out:eph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.516 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.517 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.519 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.520 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.520 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.521 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_va 2020-11-20T11:42:03.525 INFO:teuthology.task.ansible.out:r": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1c 2020-11-20T11:42:03.526 INFO:teuthology.task.ansible.out:arbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.536 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.538 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.538 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.540 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.540 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.541 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qs 2020-11-20T11:42:03.543 INFO:teuthology.task.ansible.out:DknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.552 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.553 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.553 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.555 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.566 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.568 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.568 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] 2020-11-20T11:42:03.570 INFO:teuthology.task.ansible.out: => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.570 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d 2020-11-20T11:42:03.572 INFO:teuthology.task.ansible.out:0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.582 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.583 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.594 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.596 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.597 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.600 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.601 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 2020-11-20T11:42:03.603 INFO:teuthology.task.ansible.out: 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.615 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1 2020-11-20T11:42:03.620 INFO:teuthology.task.ansible.out:108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.626 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.629 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan 2020-11-20T11:42:03.631 INFO:teuthology.task.ansible.out:@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.640 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.644 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.645 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.645 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.647 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.647 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.647 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.659 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.661 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.663 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedor 2020-11-20T11:42:03.664 INFO:teuthology.task.ansible.out:a OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'pdonn 2020-11-20T11:42:03.666 INFO:teuthology.task.ansible.out:ell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.676 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.677 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.678 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.679 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "c 2020-11-20T11:42:03.682 INFO:teuthology.task.ansible.out:hanged": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.690 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.691 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.692 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.693 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (ite 2020-11-20T11:42:03.695 INFO:teuthology.task.ansible.out:m={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.705 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.707 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.707 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.709 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.720 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.722 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q b 2020-11-20T11:42:03.724 INFO:teuthology.task.ansible.out:dd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.735 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.737 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.737 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.738 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result 2020-11-20T11:42:03.739 INFO:teuthology.task.ansible.out: was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.753 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.755 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"na 2020-11-20T11:42:03.757 INFO:teuthology.task.ansible.out:me": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.766 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.769 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.770 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.771 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.cep 2020-11-20T11:42:03.773 INFO:teuthology.task.ansible.out:h.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.784 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.786 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.797 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.798 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.816 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.818 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.818 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/ 2020-11-20T11:42:03.820 INFO:teuthology.task.ansible.out:R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.860 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:03 +0000 (0:00:00.539) 0:00:07.616 ******* 2020-11-20T11:42:03.869 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.871 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.872 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.874 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.874 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.875 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.875 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.875 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"na 2020-11-20T11:42:03.877 INFO:teuthology.task.ansible.out:me": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.878 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkei 2020-11-20T11:42:03.880 INFO:teuthology.task.ansible.out:thle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.880 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => ( 2020-11-20T11:42:03.882 INFO:teuthology.task.ansible.out:item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458 2020-11-20T11:42:03.884 INFO:teuthology.task.ansible.out:c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.894 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.896 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.897 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.933 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:03 +0000 (0:00:00.071) 0:00:07.688 ******* 2020-11-20T11:42:03.939 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.941 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.942 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.942 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyrat 2020-11-20T11:42:03.944 INFO:teuthology.task.ansible.out:sas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb2 2020-11-20T11:42:03.946 INFO:teuthology.task.ansible.out:3a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.956 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:03.958 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.f 2020-11-20T11:42:03.960 INFO:teuthology.task.ansible.out:ront.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2 2020-11-20T11:42:03.963 INFO:teuthology.task.ansible.out:c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} TASK [users : Merge managed_users and managed_admin users] ********************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.005 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:04 +0000 (0:00:00.069) 0:00:07.758 ******* 2020-11-20T11:42:04.011 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.016 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vere 2020-11-20T11:42:04.022 INFO:teuthology.task.ansible.out:ddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'nam 2020-11-20T11:42:04.024 INFO:teuthology.task.ansible.out:e': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.029 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.030 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.030 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.032 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.048 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.050 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} TASK [users : Clone the keys repo] ********************************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.051 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.051 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result wa 2020-11-20T11:42:04.053 INFO:teuthology.task.ansible.out:s False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.054 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.093 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:04 +0000 (0:00:00.091) 0:00:07.849 ******* 2020-11-20T11:42:04.138 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:04 +0000 (0:00:00.045) 0:00:07.894 ******* 2020-11-20T11:42:04.145 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.147 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.148 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.148 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"na 2020-11-20T11:42:04.150 INFO:teuthology.task.ansible.out:me": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.151 INFO:teuthology.task.ansible.out:skipping: [sm 2020-11-20T11:42:04.153 INFO:teuthology.task.ansible.out:ithi192.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.154 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional re 2020-11-20T11:42:04.156 INFO:teuthology.task.ansible.out:sult was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.170 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-11-20T11:42:04.205 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:04 +0000 (0:00:00.066) 0:00:07.961 ******* 2020-11-20T11:42:04.237 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:04 +0000 (0:00:00.032) 0:00:07.993 ******* 2020-11-20T11:42:04.286 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:04 +0000 (0:00:00.048) 0:00:08.042 ******* 2020-11-20T11:42:04.292 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-11-20T11:42:04.294 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Merge managed_users and managed_admin users] ********************* skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.337 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:04 +0000 (0:00:00.050) 0:00:08.092 ******* 2020-11-20T11:42:04.389 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:04 +0000 (0:00:00.052) 0:00:08.144 ******* 2020-11-20T11:42:04.395 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** TASK [users : Filter the revoked_users list] *********************************** 2020-11-20T11:42:04.397 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.433 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:04 +0000 (0:00:00.043) 0:00:08.188 ******* 2020-11-20T11:42:04.464 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:04 +0000 (0:00:00.031) 0:00:08.219 ******* 2020-11-20T11:42:04.470 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-11-20T11:42:04.472 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.508 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:04 +0000 (0:00:00.044) 0:00:08.264 ******* 2020-11-20T11:42:04.515 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-20T11:42:04.517 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.518 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.518 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.518 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi087.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.522 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.565 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:04 +0000 (0:00:00.056) 0:00:08.320 ******* 2020-11-20T11:42:04.574 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.576 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.577 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.579 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi087.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.581 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.582 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.583 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.583 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.584 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.585 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.585 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.586 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.588 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.639 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:04 +0000 (0:00:00.073) 0:00:08.394 ******* 2020-11-20T11:42:04.656 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.658 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-11-20T11:42:04.658 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.660 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi087.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.662 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.662 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.663 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.663 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.664 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.698 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:04 +0000 (0:00:00.059) 0:00:08.454 ******* 2020-11-20T11:42:04.704 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.706 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.706 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.711 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi087.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", " 2020-11-20T11:42:04.713 INFO:teuthology.task.ansible.out:skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.745 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:04 +0000 (0:00:00.046) 0:00:08.501 ******* 2020-11-20T11:42:04.752 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.753 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.757 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.800 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:04 +0000 (0:00:00.054) 0:00:08.555 ******* 2020-11-20T11:42:04.858 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:04 +0000 (0:00:00.057) 0:00:08.613 ******* 2020-11-20T11:42:04.866 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-11-20T11:42:04.867 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.908 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:04 +0000 (0:00:00.050) 0:00:08.664 ******* 2020-11-20T11:42:04.914 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-11-20T11:42:04.916 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.950 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:04 +0000 (0:00:00.042) 0:00:08.706 ******* 2020-11-20T11:42:04.956 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-20T11:42:04.958 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.969 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.972 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:04.982 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi146.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.019 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:05 +0000 (0:00:00.069) 0:00:08.775 ******* 2020-11-20T11:42:05.026 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.028 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.028 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.029 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.041 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.043 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.052 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.054 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.064 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.065 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.066 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.067 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.078 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.094 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.095 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.105 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.107 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.117 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.118 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.129 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.131 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.142 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.145 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.154 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.156 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.167 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.169 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.172 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.182 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.185 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.194 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.196 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.206 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.211 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.213 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.214 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.263 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:05 +0000 (0:00:00.243) 0:00:09.019 ******* 2020-11-20T11:42:05.275 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.278 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.279 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.295 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.303 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.305 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.305 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.307 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.317 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.319 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.333 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.372 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:05 +0000 (0:00:00.108) 0:00:09.127 ******* 2020-11-20T11:42:05.574 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "eefb312a9cf82af5b9a46fb88fa640babe5fe20f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-11-20T11:42:05.615 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:05 +0000 (0:00:00.243) 0:00:09.371 ******* 2020-11-20T11:42:05.642 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-11-20T11:42:05.644 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => { "msg": "Host smithi087.front.sepia.ceph.com is running RedHat 8.3 (Ootpa)" } 2020-11-20T11:42:05.684 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:05 +0000 (0:00:00.066) 0:00:09.437 ******* 2020-11-20T11:42:05.720 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-11-20T11:42:05.722 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml) => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/{{ container_mirror }}", "nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"], "rhsm_repos": ["rhel-8-for-x86_64-baseos-rpms", "rhel-8-for-x86_64-appstream-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"} TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-11-20T11:42:05.723 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "eefb312a9cf82af5b9a46fb88fa640babe5fe20f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-11-20T11:42:05.767 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:05 +0000 (0:00:00.085) 0:00:09.523 ******* 2020-11-20T11:42:05.810 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:05 +0000 (0:00:00.043) 0:00:09.566 ******* 2020-11-20T11:42:05.817 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-11-20T11:42:05.819 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:05.855 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:05 +0000 (0:00:00.044) 0:00:09.611 ******* 2020-11-20T11:42:05.862 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-11-20T11:42:05.864 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "checksum": "eefb312a9cf82af5b9a46fb88fa640babe5fe20f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} TASK [common : Log the OS name, version and release] *************************** ok: [smithi146.front.sepia.ceph.com] => { "msg": "Host smithi146.front.sepia.ceph.com is running RedHat 8.3 (Ootpa)" } 2020-11-20T11:42:05.914 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:05 +0000 (0:00:00.059) 0:00:09.670 ******* 2020-11-20T11:42:05.960 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:05 +0000 (0:00:00.044) 0:00:09.714 ******* 2020-11-20T11:42:05.964 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-11-20T11:42:05.966 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml) => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/{{ container_mirror }}", "nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"], "rhsm_repos": ["rhel-8-for-x86_64-baseos-rpms", "rhel-8-for-x86_64-appstream-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"} 2020-11-20T11:42:06.009 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:06 +0000 (0:00:00.050) 0:00:09.765 ******* 2020-11-20T11:42:06.016 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-11-20T11:42:06.018 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => { "msg": "Host smithi192.front.sepia.ceph.com is running RedHat 8.3 (Ootpa)" } 2020-11-20T11:42:06.054 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:06 +0000 (0:00:00.044) 0:00:09.809 ******* 2020-11-20T11:42:06.060 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-11-20T11:42:06.062 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:06.099 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:06 +0000 (0:00:00.045) 0:00:09.855 ******* 2020-11-20T11:42:06.105 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-11-20T11:42:06.107 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml) => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/{{ container_mirror }}", "nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"], "rhsm_repos": ["rhel-8-for-x86_64-baseos-rpms", "rhel-8-for-x86_64-appstream-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"} 2020-11-20T11:42:06.141 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:06 +0000 (0:00:00.041) 0:00:09.897 ******* 2020-11-20T11:42:06.169 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-11-20T11:42:06.170 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:06.202 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:06 +0000 (0:00:00.060) 0:00:09.958 ******* 2020-11-20T11:42:06.357 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.313087", "end": "2020-11-20 11:42:06.329605", "rc": 0, "start": "2020-11-20 11:42:06.016518", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-11-20T11:42:06.391 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:06 +0000 (0:00:00.189) 0:00:10.147 ******* 2020-11-20T11:42:06.419 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-11-20T11:42:06.421 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:06.464 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:06 +0000 (0:00:00.072) 0:00:10.220 ******* 2020-11-20T11:42:06.496 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:06.528 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:06 +0000 (0:00:00.064) 0:00:10.284 ******* 2020-11-20T11:42:06.555 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-11-20T11:42:06.557 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:06.590 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:06 +0000 (0:00:00.061) 0:00:10.346 ******* 2020-11-20T11:42:06.618 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:06.621 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.336260", "end": "2020-11-20 11:42:06.595483", "rc": 0, "start": "2020-11-20 11:42:06.259223", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-11-20T11:42:06.655 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:06 +0000 (0:00:00.062) 0:00:10.408 ******* 2020-11-20T11:42:06.687 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:06 +0000 (0:00:00.034) 0:00:10.443 ******* 2020-11-20T11:42:06.693 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-11-20T11:42:06.694 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:06.734 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:06 +0000 (0:00:00.046) 0:00:10.490 ******* 2020-11-20T11:42:06.741 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-11-20T11:42:06.743 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.312194", "end": "2020-11-20 11:42:06.671913", "rc": 0, "start": "2020-11-20 11:42:06.359719", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-11-20T11:42:06.744 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:06.779 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:06 +0000 (0:00:00.043) 0:00:10.533 ******* 2020-11-20T11:42:06.808 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:06 +0000 (0:00:00.031) 0:00:10.564 ******* 2020-11-20T11:42:06.814 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-11-20T11:42:06.815 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:06.851 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:06 +0000 (0:00:00.042) 0:00:10.607 ******* 2020-11-20T11:42:06.882 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:06 +0000 (0:00:00.031) 0:00:10.638 ******* 2020-11-20T11:42:06.889 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-11-20T11:42:06.891 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:06.924 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:06 +0000 (0:00:00.042) 0:00:10.680 ******* 2020-11-20T11:42:06.930 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-11-20T11:42:06.931 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi087.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:06.966 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:06 +0000 (0:00:00.041) 0:00:10.722 ******* 2020-11-20T11:42:06.996 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:06 +0000 (0:00:00.030) 0:00:10.752 ******* 2020-11-20T11:42:07.003 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-11-20T11:42:07.005 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set have_entitlements] ****************************************** ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} 2020-11-20T11:42:07.039 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:07 +0000 (0:00:00.042) 0:00:10.795 ******* 2020-11-20T11:42:07.071 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:07 +0000 (0:00:00.031) 0:00:10.827 ******* 2020-11-20T11:42:07.077 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-11-20T11:42:07.079 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:07.113 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:07 +0000 (0:00:00.041) 0:00:10.869 ******* 2020-11-20T11:42:07.119 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-11-20T11:42:07.121 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:07.154 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:07 +0000 (0:00:00.041) 0:00:10.910 ******* 2020-11-20T11:42:07.160 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-11-20T11:42:07.163 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:07.196 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:07 +0000 (0:00:00.041) 0:00:10.952 ******* 2020-11-20T11:42:07.202 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-11-20T11:42:07.203 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:07.238 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:07 +0000 (0:00:00.042) 0:00:10.994 ******* 2020-11-20T11:42:07.244 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-11-20T11:42:07.245 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} 2020-11-20T11:42:07.279 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:07 +0000 (0:00:00.040) 0:00:11.035 ******* 2020-11-20T11:42:07.285 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-11-20T11:42:07.287 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:07.321 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:07 +0000 (0:00:00.041) 0:00:11.076 ******* 2020-11-20T11:42:07.336 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-11-20T11:42:07.338 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi146.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:42:07.370 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:07 +0000 (0:00:00.049) 0:00:11.126 ******* 2020-11-20T11:42:07.376 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-11-20T11:42:07.378 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} 2020-11-20T11:42:07.424 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:07 +0000 (0:00:00.054) 0:00:11.180 ******* 2020-11-20T11:42:07.432 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-11-20T11:42:07.434 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} 2020-11-20T11:42:07.494 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:07 +0000 (0:00:00.069) 0:00:11.250 ******* 2020-11-20T11:42:07.500 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-11-20T11:42:07.502 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi192.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:42:07.544 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:07 +0000 (0:00:00.050) 0:00:11.300 ******* 2020-11-20T11:42:07.582 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** ok: [smithi192.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} 2020-11-20T11:42:07.616 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:07 +0000 (0:00:00.071) 0:00:11.372 ******* 2020-11-20T11:42:08.515 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-11-20T11:42:08.516 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed /root/.ansible/tmp/ansible-moduletmp-1605872528.3810754-cft_80as/katello-ca-consumer-latest.noarch5pjd85wc.rpm"]} 2020-11-20T11:42:08.549 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:08 +0000 (0:00:00.932) 0:00:12.305 ******* 2020-11-20T11:42:09.096 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-11-20T11:42:09.097 INFO:teuthology.task.ansible.out:fatal: [smithi192.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring 2020-11-20T11:42:09.131 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:09 +0000 (0:00:00.582) 0:00:12.887 ******* 2020-11-20T11:42:09.169 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-11-20T11:42:09.171 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} 2020-11-20T11:42:09.204 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:09 +0000 (0:00:00.072) 0:00:12.959 ******* 2020-11-20T11:42:12.306 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-11-20T11:42:12.309 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed /root/.ansible/tmp/ansible-moduletmp-1605872532.1169376-4fg6ju4i/katello-ca-consumer-latest.noarchb1viswwm.rpm"]} 2020-11-20T11:42:12.340 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:12 +0000 (0:00:03.136) 0:00:16.096 ******* 2020-11-20T11:42:12.899 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-11-20T11:42:12.901 INFO:teuthology.task.ansible.out:fatal: [smithi087.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring 2020-11-20T11:42:12.940 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:12 +0000 (0:00:00.599) 0:00:16.696 ******* 2020-11-20T11:42:12.978 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-11-20T11:42:12.979 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} 2020-11-20T11:42:13.013 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:13 +0000 (0:00:00.071) 0:00:16.768 ******* 2020-11-20T11:42:13.218 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-11-20T11:42:13.220 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed /root/.ansible/tmp/ansible-moduletmp-1605872533.0447013-7glv8kn5/katello-ca-consumer-latest.noarchcfjdczqa.rpm"]} 2020-11-20T11:42:13.254 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:13 +0000 (0:00:00.242) 0:00:17.010 ******* 2020-11-20T11:42:13.805 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-11-20T11:42:13.807 INFO:teuthology.task.ansible.out:fatal: [smithi146.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring 2020-11-20T11:42:13.839 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:13 +0000 (0:00:00.584) 0:00:17.595 ******* 2020-11-20T11:42:13.876 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-11-20T11:42:13.878 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} 2020-11-20T11:42:13.913 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:13 +0000 (0:00:00.073) 0:00:17.669 ******* 2020-11-20T11:42:24.481 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-11-20T11:42:24.483 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T11:42:24.521 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:24 +0000 (0:00:10.608) 0:00:28.277 ******* 2020-11-20T11:42:24.559 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-11-20T11:42:24.561 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} 2020-11-20T11:42:24.594 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:24 +0000 (0:00:00.072) 0:00:28.350 ******* 2020-11-20T11:42:25.214 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-11-20T11:42:25.216 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.427882", "end": "2020-11-20 11:42:25.187530", "failed_when_result": false, "rc": 0, "start": "2020-11-20 11:42:24.759648", "stderr": "", "stderr_lines": [], "stdout": "7.4\n7.5\n7.6\n7.7\n7.8\n7.9\n7Server\n8\n8.0\n8.1\n8.2\n8.3", "stdout_lines": ["7.4", "7.5", "7.6", "7.7", "7.8", "7.9", "7Server", "8", "8.0", "8.1", "8.2", "8.3"]} 2020-11-20T11:42:25.248 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:25 +0000 (0:00:00.653) 0:00:29.004 ******* 2020-11-20T11:42:25.275 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-11-20T11:42:25.277 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:25.309 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:25 +0000 (0:00:00.060) 0:00:29.064 ******* 2020-11-20T11:42:25.335 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:25.369 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:25 +0000 (0:00:00.060) 0:00:29.125 ******* 2020-11-20T11:42:25.396 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi192.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:42:25.431 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:25 +0000 (0:00:00.061) 0:00:29.187 ******* 2020-11-20T11:42:25.469 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-20T11:42:25.471 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:25.507 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:25 +0000 (0:00:00.076) 0:00:29.263 ******* 2020-11-20T11:42:26.993 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** changed: [smithi087.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T11:42:27.027 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:27 +0000 (0:00:01.519) 0:00:30.782 ******* 2020-11-20T11:42:27.064 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-11-20T11:42:27.066 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} 2020-11-20T11:42:27.098 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:27 +0000 (0:00:00.071) 0:00:30.854 ******* 2020-11-20T11:42:27.657 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-11-20T11:42:27.659 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.364560", "end": "2020-11-20 11:42:27.627659", "failed_when_result": false, "rc": 0, "start": "2020-11-20 11:42:27.263099", "stderr": "", "stderr_lines": [], "stdout": "7.4\n7.5\n7.6\n7.7\n7.8\n7.9\n7Server\n8\n8.0\n8.1\n8.2\n8.3", "stdout_lines": ["7.4", "7.5", "7.6", "7.7", "7.8", "7.9", "7Server", "8", "8.0", "8.1", "8.2", "8.3"]} 2020-11-20T11:42:27.691 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:27 +0000 (0:00:00.593) 0:00:31.447 ******* 2020-11-20T11:42:27.718 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-11-20T11:42:27.720 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:27.752 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:27 +0000 (0:00:00.060) 0:00:31.508 ******* 2020-11-20T11:42:27.789 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-11-20T11:42:27.791 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:27.824 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:27 +0000 (0:00:00.072) 0:00:31.580 ******* 2020-11-20T11:42:27.852 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-11-20T11:42:27.854 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:42:27.903 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:27 +0000 (0:00:00.078) 0:00:31.658 ******* 2020-11-20T11:42:27.943 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-20T11:42:27.945 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:27.980 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:27 +0000 (0:00:00.077) 0:00:31.736 ******* 2020-11-20T11:42:28.010 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-11-20T11:42:28.012 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:02.317753", "end": "2020-11-20 11:42:27.989440", "rc": 0, "start": "2020-11-20 11:42:25.671687", "stderr": "", "stderr_lines": [], "stdout": "rhel-8-for-x86_64-appstream-rpms\nrhel-8-for-x86_64-baseos-rpms", "stdout_lines": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]} 2020-11-20T11:42:28.056 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:28 +0000 (0:00:00.075) 0:00:31.812 ******* 2020-11-20T11:42:28.094 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-11-20T11:42:28.096 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]}, "changed": false} 2020-11-20T11:42:28.132 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:28 +0000 (0:00:00.075) 0:00:31.888 ******* 2020-11-20T11:42:28.162 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-11-20T11:42:28.164 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:28.196 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:28 +0000 (0:00:00.064) 0:00:31.952 ******* 2020-11-20T11:42:28.234 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-11-20T11:42:28.236 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": false}, "changed": false} 2020-11-20T11:42:28.282 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:28 +0000 (0:00:00.085) 0:00:32.037 ******* 2020-11-20T11:42:28.318 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-11-20T11:42:28.320 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2020-11-20T11:42:28.353 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:28 +0000 (0:00:00.071) 0:00:32.109 ******* 2020-11-20T11:42:28.832 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** changed: [smithi146.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T11:42:28.867 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:28 +0000 (0:00:00.513) 0:00:32.622 ******* 2020-11-20T11:42:28.908 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-11-20T11:42:28.910 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} 2020-11-20T11:42:28.944 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:28 +0000 (0:00:00.077) 0:00:32.700 ******* 2020-11-20T11:42:29.514 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.371778", "end": "2020-11-20 11:42:29.480741", "failed_when_result": false, "rc": 0, "start": "2020-11-20 11:42:29.108963", "stderr": "", "stderr_lines": [], "stdout": "7.4\n7.5\n7.6\n7.7\n7.8\n7.9\n7Server\n8\n8.0\n8.1\n8.2\n8.3", "stdout_lines": ["7.4", "7.5", "7.6", "7.7", "7.8", "7.9", "7Server", "8", "8.0", "8.1", "8.2", "8.3"]} 2020-11-20T11:42:29.547 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:29 +0000 (0:00:00.603) 0:00:33.303 ******* 2020-11-20T11:42:29.586 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-11-20T11:42:29.588 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:29.625 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:29 +0000 (0:00:00.077) 0:00:33.381 ******* 2020-11-20T11:42:29.653 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:29.691 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:29 +0000 (0:00:00.066) 0:00:33.447 ******* 2020-11-20T11:42:29.718 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-11-20T11:42:29.720 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:42:29.758 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:29 +0000 (0:00:00.067) 0:00:33.514 ******* 2020-11-20T11:42:29.795 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-20T11:42:29.797 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:29.829 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:29 +0000 (0:00:00.070) 0:00:33.585 ******* 2020-11-20T11:42:30.481 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-11-20T11:42:30.483 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:02.318640", "end": "2020-11-20 11:42:30.462011", "rc": 0, "start": "2020-11-20 11:42:28.143371", "stderr": "", "stderr_lines": [], "stdout": "rhel-8-for-x86_64-appstream-rpms\nrhel-8-for-x86_64-baseos-rpms", "stdout_lines": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]} 2020-11-20T11:42:30.517 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:30 +0000 (0:00:00.688) 0:00:34.273 ******* 2020-11-20T11:42:30.557 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]}, "changed": false} 2020-11-20T11:42:30.592 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:30 +0000 (0:00:00.073) 0:00:34.347 ******* 2020-11-20T11:42:30.621 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:30.655 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:30 +0000 (0:00:00.063) 0:00:34.411 ******* 2020-11-20T11:42:30.692 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-11-20T11:42:30.694 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": false}, "changed": false} 2020-11-20T11:42:30.728 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:30 +0000 (0:00:00.071) 0:00:34.483 ******* 2020-11-20T11:42:30.765 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2020-11-20T11:42:30.799 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:30 +0000 (0:00:00.072) 0:00:34.555 ******* 2020-11-20T11:42:30.838 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** changed: [smithi192.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T11:42:30.874 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:30 +0000 (0:00:00.074) 0:00:34.630 ******* 2020-11-20T11:42:32.309 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-11-20T11:42:32.311 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:02.290483", "end": "2020-11-20 11:42:32.283195", "rc": 0, "start": "2020-11-20 11:42:29.992712", "stderr": "", "stderr_lines": [], "stdout": "rhel-8-for-x86_64-appstream-rpms\nrhel-8-for-x86_64-baseos-rpms", "stdout_lines": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]} 2020-11-20T11:42:32.344 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:32 +0000 (0:00:01.469) 0:00:36.100 ******* 2020-11-20T11:42:32.382 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]}, "changed": false} 2020-11-20T11:42:32.420 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:32 +0000 (0:00:00.076) 0:00:36.176 ******* 2020-11-20T11:42:32.457 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-11-20T11:42:32.460 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:32.492 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:32 +0000 (0:00:00.072) 0:00:36.248 ******* 2020-11-20T11:42:32.532 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": false}, "changed": false} 2020-11-20T11:42:32.565 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:32 +0000 (0:00:00.073) 0:00:36.321 ******* 2020-11-20T11:42:32.604 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2020-11-20T11:42:32.640 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:32 +0000 (0:00:00.073) 0:00:36.395 ******* 2020-11-20T11:42:33.793 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** changed: [smithi087.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T11:42:33.826 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:33 +0000 (0:00:01.187) 0:00:37.582 ******* 2020-11-20T11:42:34.422 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-11-20T11:42:34.424 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"changed": true, "cmd": ["subscription-manager", "repos", "--enable=rhel-8-for-x86_64-baseos-rpms", "--enable=rhel-8-for-x86_64-appstream-rpms"], "delta": "0:00:03.350738", "end": "2020-11-20 11:42:34.389417", "rc": 0, "start": "2020-11-20 11:42:31.038679", "stderr": "", "stderr_lines": [], "stdout": "Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.\nRepository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system.", "stdout_lines": ["Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.", "Repository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system."]} 2020-11-20T11:42:34.466 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:34 +0000 (0:00:00.639) 0:00:38.222 ******* 2020-11-20T11:42:34.661 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2020-11-20T11:42:34.712 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:34 +0000 (0:00:00.245) 0:00:38.468 ******* 2020-11-20T11:42:34.903 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** ok: [smithi192.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:42:34.942 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:34 +0000 (0:00:00.229) 0:00:38.698 ******* 2020-11-20T11:42:35.137 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-11-20T11:42:35.139 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T11:42:35.172 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:35 +0000 (0:00:00.230) 0:00:38.928 ******* 2020-11-20T11:42:35.409 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-11-20T11:42:35.410 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-11-20T11:42:35.824 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-11-20T11:42:35.863 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:35 +0000 (0:00:00.690) 0:00:39.619 ******* 2020-11-20T11:42:36.307 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-11-20T11:42:36.309 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-11-20T11:42:36.733 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-11-20T11:42:36.780 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:36 +0000 (0:00:00.916) 0:00:40.535 ******* 2020-11-20T11:42:36.817 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-20T11:42:36.819 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:36.854 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:36 +0000 (0:00:00.074) 0:00:40.610 ******* 2020-11-20T11:42:36.883 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-20T11:42:36.885 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:36.917 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:36 +0000 (0:00:00.062) 0:00:40.673 ******* 2020-11-20T11:42:36.944 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-11-20T11:42:36.946 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:36.985 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:36 +0000 (0:00:00.067) 0:00:40.741 ******* 2020-11-20T11:42:37.012 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:37.046 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:37 +0000 (0:00:00.060) 0:00:40.802 ******* 2020-11-20T11:42:37.073 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:37.107 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:37 +0000 (0:00:00.061) 0:00:40.863 ******* 2020-11-20T11:42:37.135 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-11-20T11:42:37.136 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:37.171 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:37 +0000 (0:00:00.062) 0:00:40.925 ******* 2020-11-20T11:42:37.202 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-11-20T11:42:37.204 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:37.237 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:37 +0000 (0:00:00.067) 0:00:40.993 ******* 2020-11-20T11:42:37.264 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:37.298 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:37 +0000 (0:00:00.060) 0:00:41.054 ******* 2020-11-20T11:42:37.304 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-11-20T11:42:37.306 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "cmd": ["subscription-manager", "repos", "--enable=rhel-8-for-x86_64-baseos-rpms", "--enable=rhel-8-for-x86_64-appstream-rpms"], "delta": "0:00:03.265199", "end": "2020-11-20 11:42:37.272317", "rc": 0, "start": "2020-11-20 11:42:34.007118", "stderr": "", "stderr_lines": [], "stdout": "Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.\nRepository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system.", "stdout_lines": ["Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.", "Repository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system."]} 2020-11-20T11:42:37.341 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:37 +0000 (0:00:00.043) 0:00:41.097 ******* 2020-11-20T11:42:37.348 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:37.383 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:37 +0000 (0:00:00.042) 0:00:41.139 ******* 2020-11-20T11:42:37.529 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2020-11-20T11:42:37.564 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:37 +0000 (0:00:00.180) 0:00:41.320 ******* 2020-11-20T11:42:37.752 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-11-20T11:42:37.754 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:42:37.787 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:37 +0000 (0:00:00.222) 0:00:41.542 ******* 2020-11-20T11:42:38.240 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-11-20T11:42:38.242 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-11-20T11:42:38.522 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-11-20T11:42:38.523 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.964600", "end": "2020-11-20 11:42:38.500353", "rc": 0, "start": "2020-11-20 11:42:37.535753", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:42:38.559 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:38 +0000 (0:00:00.772) 0:00:42.315 ******* 2020-11-20T11:42:38.598 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-11-20T11:42:38.600 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "cmd": ["subscription-manager", "repos", "--enable=rhel-8-for-x86_64-baseos-rpms", "--enable=rhel-8-for-x86_64-appstream-rpms"], "delta": "0:00:03.234813", "end": "2020-11-20 11:42:38.571795", "rc": 0, "start": "2020-11-20 11:42:35.336982", "stderr": "", "stderr_lines": [], "stdout": "Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.\nRepository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system.", "stdout_lines": ["Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.", "Repository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system."]} 2020-11-20T11:42:38.635 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:38 +0000 (0:00:00.075) 0:00:42.391 ******* 2020-11-20T11:42:38.654 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** ok: [smithi087.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-11-20T11:42:38.695 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:38 +0000 (0:00:00.059) 0:00:42.451 ******* 2020-11-20T11:42:38.841 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-11-20T11:42:38.843 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2020-11-20T11:42:38.892 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:38 +0000 (0:00:00.196) 0:00:42.647 ******* 2020-11-20T11:42:39.080 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-11-20T11:42:39.082 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:42:39.117 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:39 +0000 (0:00:00.225) 0:00:42.873 ******* 2020-11-20T11:42:39.145 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-11-20T11:42:39.146 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-11-20T11:42:39.572 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-11-20T11:42:39.574 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} TASK [common : Configure local epel mirrorlists] ******************************* ok: [smithi087.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-11-20T11:42:39.610 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:39 +0000 (0:00:00.492) 0:00:43.365 ******* 2020-11-20T11:42:39.637 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-20T11:42:39.638 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:39.673 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:39 +0000 (0:00:00.063) 0:00:43.429 ******* 2020-11-20T11:42:39.732 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:39.748 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:39 +0000 (0:00:00.072) 0:00:43.502 ******* 2020-11-20T11:42:39.778 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:39.830 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:39 +0000 (0:00:00.083) 0:00:43.586 ******* 2020-11-20T11:42:39.861 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:39.901 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:39 +0000 (0:00:00.069) 0:00:43.655 ******* 2020-11-20T11:42:39.927 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:39.970 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:39 +0000 (0:00:00.069) 0:00:43.725 ******* 2020-11-20T11:42:39.996 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-11-20T11:42:39.998 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:40.033 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:40 +0000 (0:00:00.063) 0:00:43.788 ******* 2020-11-20T11:42:40.040 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-11-20T11:42:40.041 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-11-20T11:42:40.087 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:40 +0000 (0:00:00.053) 0:00:43.842 ******* 2020-11-20T11:42:40.093 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-11-20T11:42:40.095 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:40.132 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:40 +0000 (0:00:00.045) 0:00:43.887 ******* 2020-11-20T11:42:40.159 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-11-20T11:42:40.161 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:40.195 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:40 +0000 (0:00:00.063) 0:00:43.951 ******* 2020-11-20T11:42:40.222 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:40.256 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:40 +0000 (0:00:00.061) 0:00:44.012 ******* 2020-11-20T11:42:40.527 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-11-20T11:42:40.529 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.095166", "end": "2020-11-20 11:42:40.500344", "rc": 0, "start": "2020-11-20 11:42:40.405178", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:42:40.565 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:40 +0000 (0:00:00.308) 0:00:44.320 ******* 2020-11-20T11:42:40.572 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-11-20T11:42:40.574 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-11-20T11:42:40.970 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-11-20T11:42:41.005 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:41 +0000 (0:00:00.440) 0:00:44.761 ******* 2020-11-20T11:42:41.043 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-20T11:42:41.045 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:41.080 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:41 +0000 (0:00:00.075) 0:00:44.836 ******* 2020-11-20T11:42:41.108 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-20T11:42:41.110 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:41.142 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:41 +0000 (0:00:00.061) 0:00:44.897 ******* 2020-11-20T11:42:41.168 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:41.202 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:41 +0000 (0:00:00.060) 0:00:44.958 ******* 2020-11-20T11:42:41.229 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-11-20T11:42:41.231 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:41.264 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:41 +0000 (0:00:00.062) 0:00:45.020 ******* 2020-11-20T11:42:41.291 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-20T11:42:41.292 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:41.325 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:41 +0000 (0:00:00.061) 0:00:45.081 ******* 2020-11-20T11:42:41.332 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-11-20T11:42:41.334 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-11-20T11:42:41.370 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:41 +0000 (0:00:00.043) 0:00:45.125 ******* 2020-11-20T11:42:41.376 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-11-20T11:42:41.378 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:41.411 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:41 +0000 (0:00:00.041) 0:00:45.167 ******* 2020-11-20T11:42:41.417 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-11-20T11:42:41.419 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:41.452 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:41 +0000 (0:00:00.041) 0:00:45.208 ******* 2020-11-20T11:42:41.458 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-11-20T11:42:41.460 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:41.494 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:41 +0000 (0:00:00.041) 0:00:45.250 ******* 2020-11-20T11:42:41.500 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-11-20T11:42:41.502 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:41.536 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:41 +0000 (0:00:00.042) 0:00:45.292 ******* 2020-11-20T11:42:41.542 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-11-20T11:42:41.544 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:41.588 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:41 +0000 (0:00:00.052) 0:00:45.344 ******* 2020-11-20T11:42:41.595 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-11-20T11:42:41.597 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:41.635 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:41 +0000 (0:00:00.047) 0:00:45.391 ******* 2020-11-20T11:42:41.644 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:41.691 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:41 +0000 (0:00:00.055) 0:00:45.446 ******* 2020-11-20T11:42:41.697 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-11-20T11:42:41.699 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:41.734 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:41 +0000 (0:00:00.043) 0:00:45.490 ******* 2020-11-20T11:42:42.163 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-11-20T11:42:42.164 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-11-20T11:42:42.199 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:42 +0000 (0:00:00.464) 0:00:45.955 ******* 2020-11-20T11:42:42.527 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.651355", "end": "2020-11-20 11:42:42.500341", "rc": 0, "start": "2020-11-20 11:42:41.848986", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:42:42.561 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:42 +0000 (0:00:00.362) 0:00:46.317 ******* 2020-11-20T11:42:43.708 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-11-20T11:42:43.710 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-11-20T11:42:43.751 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:43 +0000 (0:00:01.190) 0:00:47.507 ******* 2020-11-20T11:42:43.778 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-11-20T11:42:43.780 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:43.813 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:43 +0000 (0:00:00.060) 0:00:47.567 ******* 2020-11-20T11:42:43.839 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:43.889 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:43 +0000 (0:00:00.077) 0:00:47.645 ******* 2020-11-20T11:42:43.918 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-11-20T11:42:43.920 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:43.958 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:43 +0000 (0:00:00.069) 0:00:47.714 ******* 2020-11-20T11:42:43.985 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:44.019 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:44 +0000 (0:00:00.061) 0:00:47.775 ******* 2020-11-20T11:42:44.476 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-11-20T11:42:44.478 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-11-20T11:42:44.510 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:44 +0000 (0:00:00.490) 0:00:48.266 ******* 2020-11-20T11:42:44.610 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-11-20T11:42:44.612 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-11-20T11:42:44.647 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:44 +0000 (0:00:00.136) 0:00:48.403 ******* 2020-11-20T11:42:45.155 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-20T11:42:45.157 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-11-20T11:42:45.286 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-11-20T11:42:45.288 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-11-20T11:42:45.326 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:45 +0000 (0:00:00.679) 0:00:49.082 ******* 2020-11-20T11:42:45.356 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-11-20T11:42:45.358 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:45.392 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:45 +0000 (0:00:00.066) 0:00:49.148 ******* 2020-11-20T11:42:45.420 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-11-20T11:42:45.421 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:45.462 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:45 +0000 (0:00:00.069) 0:00:49.218 ******* 2020-11-20T11:42:45.489 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-11-20T11:42:45.491 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:45.524 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:45 +0000 (0:00:00.061) 0:00:49.279 ******* 2020-11-20T11:42:45.551 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-11-20T11:42:45.553 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:45.586 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:45 +0000 (0:00:00.062) 0:00:49.342 ******* 2020-11-20T11:42:45.603 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi192.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-11-20T11:42:46.037 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-11-20T11:42:46.072 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:46 +0000 (0:00:00.486) 0:00:49.828 ******* 2020-11-20T11:42:46.078 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-11-20T11:42:46.080 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-11-20T11:42:46.131 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:46 +0000 (0:00:00.058) 0:00:49.886 ******* 2020-11-20T11:42:46.256 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-11-20T11:42:46.258 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:42:46.305 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:46 +0000 (0:00:00.174) 0:00:50.061 ******* 2020-11-20T11:42:46.767 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-20T11:42:46.771 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-11-20T11:42:46.887 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-11-20T11:42:46.888 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-11-20T11:42:46.922 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:46 +0000 (0:00:00.617) 0:00:50.678 ******* 2020-11-20T11:42:47.191 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-20T11:42:47.193 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-11-20T11:42:47.384 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi087.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-11-20T11:42:47.589 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi192.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-11-20T11:42:47.625 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:47 +0000 (0:00:00.701) 0:00:51.379 ******* 2020-11-20T11:42:47.650 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-11-20T11:42:47.651 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:47.686 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:47 +0000 (0:00:00.062) 0:00:51.442 ******* 2020-11-20T11:42:47.724 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-11-20T11:42:47.726 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-11-20T11:42:47.759 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:47 +0000 (0:00:00.072) 0:00:51.514 ******* 2020-11-20T11:42:47.818 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-20T11:42:47.820 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-11-20T11:42:47.938 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* changed: [smithi192.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T11:42:47.971 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:47 +0000 (0:00:00.212) 0:00:51.727 ******* 2020-11-20T11:42:48.031 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi192.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:48.043 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:48.054 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:48.065 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:48.067 INFO:teuthology.task.ansible.out: 2020-11-20T11:42:48.107 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:48 +0000 (0:00:00.135) 0:00:51.862 ******* 2020-11-20T11:42:48.230 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-20T11:42:48.232 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-11-20T11:42:48.266 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:48 +0000 (0:00:00.159) 0:00:52.022 ******* 2020-11-20T11:42:48.458 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-11-20T11:42:48.460 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:42:48.493 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:48 +0000 (0:00:00.226) 0:00:52.249 ******* 2020-11-20T11:42:48.747 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-11-20T11:42:48.785 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:48 +0000 (0:00:00.291) 0:00:52.541 ******* 2020-11-20T11:42:48.941 INFO:teuthology.task.ansible.out: 2020-11-20T11:42:48.943 INFO:teuthology.task.ansible.out:TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi087.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-11-20T11:42:49.253 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-20T11:42:49.255 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-11-20T11:42:49.339 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-20T11:42:49.341 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-11-20T11:42:49.680 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-20T11:42:49.681 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-11-20T11:42:49.747 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-20T11:42:49.749 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-11-20T11:42:49.792 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:49 +0000 (0:00:01.007) 0:00:53.548 ******* 2020-11-20T11:42:49.937 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-11-20T11:42:49.939 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:50.104 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:50 +0000 (0:00:00.311) 0:00:53.860 ******* 2020-11-20T11:42:50.111 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-20T11:42:50.114 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-11-20T11:42:50.148 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:50 +0000 (0:00:00.044) 0:00:53.904 ******* 2020-11-20T11:42:50.156 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-11-20T11:42:50.158 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-11-20T11:42:50.193 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:50 +0000 (0:00:00.043) 0:00:53.948 ******* 2020-11-20T11:42:50.326 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-11-20T11:42:50.328 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:42:50.362 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:50 +0000 (0:00:00.168) 0:00:54.117 ******* 2020-11-20T11:42:50.380 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-11-20T11:42:50.382 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T11:42:50.429 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:50 +0000 (0:00:00.067) 0:00:54.185 ******* 2020-11-20T11:42:50.468 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-11-20T11:42:50.470 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:50.480 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:50.491 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:50.493 INFO:teuthology.task.ansible.out: 2020-11-20T11:42:50.504 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:50.550 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:50 +0000 (0:00:00.121) 0:00:54.306 ******* 2020-11-20T11:42:50.578 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-11-20T11:42:50.580 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-11-20T11:42:50.616 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:50 +0000 (0:00:00.065) 0:00:54.372 ******* 2020-11-20T11:42:50.644 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-11-20T11:42:50.646 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:50.687 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:50 +0000 (0:00:00.069) 0:00:54.441 ******* 2020-11-20T11:42:50.798 INFO:teuthology.task.ansible.out: 2020-11-20T11:42:50.799 INFO:teuthology.task.ansible.out:TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi146.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-11-20T11:42:51.128 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-11-20T11:42:51.163 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:51 +0000 (0:00:00.477) 0:00:54.919 ******* 2020-11-20T11:42:51.201 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-20T11:42:51.203 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-11-20T11:42:51.597 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-11-20T11:42:51.599 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-11-20T11:42:51.599 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-20T11:42:51.634 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:51 +0000 (0:00:00.471) 0:00:55.390 ******* 2020-11-20T11:42:51.669 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:51 +0000 (0:00:00.034) 0:00:55.425 ******* 2020-11-20T11:42:51.675 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-11-20T11:42:51.677 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:51.711 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:51 +0000 (0:00:00.042) 0:00:55.467 ******* 2020-11-20T11:42:51.717 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-11-20T11:42:51.719 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:51.754 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:51 +0000 (0:00:00.043) 0:00:55.510 ******* 2020-11-20T11:42:51.761 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-11-20T11:42:51.797 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:51 +0000 (0:00:00.042) 0:00:55.553 ******* 2020-11-20T11:42:51.941 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-11-20T11:42:51.942 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:42:51.977 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:51 +0000 (0:00:00.179) 0:00:55.732 ******* 2020-11-20T11:42:51.983 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* changed: [smithi146.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T11:42:52.021 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:52 +0000 (0:00:00.043) 0:00:55.776 ******* 2020-11-20T11:42:52.058 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-11-20T11:42:52.060 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:52.070 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:52.081 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:52.092 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:52.129 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:52 +0000 (0:00:00.108) 0:00:55.885 ******* 2020-11-20T11:42:52.241 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** fatal: [smithi192.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-11-20T11:42:52.276 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:52 +0000 (0:00:00.147) 0:00:56.032 ******* 2020-11-20T11:42:52.304 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-11-20T11:42:52.307 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:52.338 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:52 +0000 (0:00:00.062) 0:00:56.094 ******* 2020-11-20T11:42:52.781 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-11-20T11:42:52.786 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2020-11-20T11:42:52.827 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:52 +0000 (0:00:00.487) 0:00:56.582 ******* 2020-11-20T11:42:52.993 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-11-20T11:42:52.995 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-11-20T11:42:53.029 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:53 +0000 (0:00:00.202) 0:00:56.784 ******* 2020-11-20T11:42:53.056 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-11-20T11:42:53.058 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:53.092 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:53 +0000 (0:00:00.063) 0:00:56.848 ******* 2020-11-20T11:42:53.525 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-11-20T11:42:53.564 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:53 +0000 (0:00:00.471) 0:00:57.319 ******* 2020-11-20T11:42:53.571 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-11-20T11:42:53.573 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 11:40:59 UTC", "ActiveEnterTimestampMonotonic": "15445258", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "var-run.mount systemd-tmpfiles-setup.service network.target systemd-journald.socket time-sync.target tmp.mount sysinit.target nss-lookup.target local-fs.target system.slice -.mount basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 11:40:59 UTC", "AssertTimestampMonotonic": "15443955", "Before": "plymouth-quit.service getty@tty1.service xdm.service multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 11:40:59 UTC", "ConditionTimestampMonotonic": "15443955", "ConfigurationDirectoryMode": " 2020-11-20T11:42:53.575 INFO:teuthology.task.ansible.out:0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "969", "ExecMainStartTimestamp": "Fri 2020-11-20 11:40:59 UTC", "ExecMainStartTimestampMonotonic": "15445213", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Fri 2020-11-20 11:40:59 UTC] ; stop_time=[n/a] ; pid=969 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "FreezerState": "running", "GID": "984", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 11:40:59 UTC", "InactiveExitTimestampMonotonic": "15445258", "InvocationID": "957e7c480dd0455294f8814d89a5758c", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infin 2020-11-20T11:42:53.579 INFO:teuthology.task.ansible.out:ity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127237", "LimitNPROCSoft": "127237", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127237", "LimitSIGPENDINGSoft": "127237", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "969", "MemoryAccounting": "yes", "MemoryCurrent": "1552384", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualSta 2020-11-20T11:42:53.582 INFO:teuthology.task.ansible.out:rt": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/run/nrpe /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 11:40:59 UTC", "StateChangeTimestampMonotonic": "15445258", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203580", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "988", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 11:40:59 UTC", "WatchdogTimestampMonotonic": "15445257", "WatchdogUSec": "0"}} 2020-11-20T11:42:53.616 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:53 +0000 (0:00:00.052) 0:00:57.371 ******* 2020-11-20T11:42:53.833 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* changed: [smithi192.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001730", "end": "2020-11-20 11:42:53.806429", "rc": 0, "start": "2020-11-20 11:42:53.804699", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-11-20T11:42:53.867 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:53 +0000 (0:00:00.251) 0:00:57.623 ******* 2020-11-20T11:42:54.044 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-11-20T11:42:54.046 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-11-20T11:42:54.081 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:54 +0000 (0:00:00.213) 0:00:57.837 ******* 2020-11-20T11:42:54.118 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-11-20T11:42:54.121 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:54.155 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:54 +0000 (0:00:00.074) 0:00:57.911 ******* 2020-11-20T11:42:54.350 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-11-20T11:42:54.352 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:42:54.388 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:54 +0000 (0:00:00.232) 0:00:58.143 ******* 2020-11-20T11:42:54.616 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-11-20T11:42:54.618 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-11-20T11:42:54.652 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:54 +0000 (0:00:00.264) 0:00:58.408 ******* 2020-11-20T11:42:54.659 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-11-20T11:42:54.661 INFO:teuthology.task.ansible.out:fatal: [smithi087.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-11-20T11:42:54.695 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:54 +0000 (0:00:00.042) 0:00:58.451 ******* 2020-11-20T11:42:54.702 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-11-20T11:42:54.704 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:54.738 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:54 +0000 (0:00:00.042) 0:00:58.493 ******* 2020-11-20T11:42:54.744 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-11-20T11:42:54.746 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:54.780 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:54 +0000 (0:00:00.042) 0:00:58.536 ******* 2020-11-20T11:42:55.177 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-11-20T11:42:55.179 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-11-20T11:42:55.215 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:55 +0000 (0:00:00.434) 0:00:58.970 ******* 2020-11-20T11:42:55.231 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-11-20T11:42:55.233 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2020-11-20T11:42:55.266 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:55 +0000 (0:00:00.052) 0:00:59.022 ******* 2020-11-20T11:42:55.583 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-11-20T11:42:55.588 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 11:40:56 UTC", "ActiveEnterTimestampMonotonic": "15053342", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "var-run.mount time-sync.target systemd-tmpfiles-setup.service basic.target system.slice sysinit.target -.mount nss-lookup.target systemd-journald.socket local-fs.target network.target tmp.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 11:40:56 UTC", "AssertTimestampMonotonic": "15052370", "Before": "getty@tty1.service xdm.service plymouth-quit.service shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 11:40:56 UTC", "ConditionTimestampMonotonic": "15052369", "ConfigurationDirectoryMode": " 2020-11-20T11:42:55.592 INFO:teuthology.task.ansible.out:0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "970", "ExecMainStartTimestamp": "Fri 2020-11-20 11:40:56 UTC", "ExecMainStartTimestampMonotonic": "15053314", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Fri 2020-11-20 11:40:56 UTC] ; stop_time=[n/a] ; pid=970 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "FreezerState": "running", "GID": "984", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 11:40:56 UTC", "InactiveExitTimestampMonotonic": "15053342", "InvocationID": "dde74a7aeb1448e5b22dd6944f98805a", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infin 2020-11-20T11:42:55.594 INFO:teuthology.task.ansible.out:ity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127237", "LimitNPROCSoft": "127237", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127237", "LimitSIGPENDINGSoft": "127237", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "970", "MemoryAccounting": "yes", "MemoryCurrent": "1388544", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualSta 2020-11-20T11:42:55.596 INFO:teuthology.task.ansible.out:rt": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 11:40:56 UTC", "StateChangeTimestampMonotonic": "15053342", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203579", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "988", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 11:40:56 UTC", "WatchdogTimestampMonotonic": "15053341", "WatchdogUSec": "0"}} 2020-11-20T11:42:55.621 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:55 +0000 (0:00:00.353) 0:00:59.376 ******* 2020-11-20T11:42:55.706 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-11-20T11:42:55.708 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-11-20T11:42:55.747 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:55 +0000 (0:00:00.126) 0:00:59.502 ******* 2020-11-20T11:42:55.791 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ skipping: [smithi146.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-11-20T11:42:55.823 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:55 +0000 (0:00:00.076) 0:00:59.579 ******* 2020-11-20T11:42:55.831 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001688", "end": "2020-11-20 11:42:55.785946", "rc": 0, "start": "2020-11-20 11:42:55.784258", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-11-20T11:42:55.868 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:55 +0000 (0:00:00.044) 0:00:59.623 ******* 2020-11-20T11:42:56.019 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* ok: [smithi146.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:42:56.055 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:56 +0000 (0:00:00.187) 0:00:59.811 ******* 2020-11-20T11:42:56.291 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-11-20T11:42:56.325 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:56 +0000 (0:00:00.269) 0:01:00.080 ******* 2020-11-20T11:42:56.331 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-11-20T11:42:56.334 INFO:teuthology.task.ansible.out:fatal: [smithi146.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-11-20T11:42:56.378 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:56 +0000 (0:00:00.053) 0:01:00.134 ******* 2020-11-20T11:42:56.418 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:42:56.453 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:56 +0000 (0:00:00.075) 0:01:00.209 ******* 2020-11-20T11:42:56.455 INFO:teuthology.task.ansible.out: 2020-11-20T11:42:56.936 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2020-11-20T11:42:56.982 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:56 +0000 (0:00:00.529) 0:01:00.738 ******* 2020-11-20T11:42:57.283 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-11-20T11:42:57.284 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 11:41:07 UTC", "ActiveEnterTimestampMonotonic": "15607793", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target time-sync.target system.slice systemd-tmpfiles-setup.service systemd-journald.socket network.target -.mount var-run.mount local-fs.target tmp.mount sysinit.target nss-lookup.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 11:41:07 UTC", "AssertTimestampMonotonic": "15599779", "Before": "plymouth-quit.service xdm.service multi-user.target getty@tty1.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 11:41:07 UTC", "ConditionTimestampMonotonic": "15599778", "ConfigurationDirectoryMode": " 2020-11-20T11:42:57.286 INFO:teuthology.task.ansible.out:0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "997", "ExecMainStartTimestamp": "Fri 2020-11-20 11:41:07 UTC", "ExecMainStartTimestampMonotonic": "15607728", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Fri 2020-11-20 11:41:07 UTC] ; stop_time=[n/a] ; pid=997 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "FreezerState": "running", "GID": "984", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 11:41:07 UTC", "InactiveExitTimestampMonotonic": "15607793", "InvocationID": "af9aece442734950927ef70848213aab", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infin 2020-11-20T11:42:57.287 INFO:teuthology.task.ansible.out:ity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127237", "LimitNPROCSoft": "127237", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127237", "LimitSIGPENDINGSoft": "127237", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "997", "MemoryAccounting": "yes", "MemoryCurrent": "1396736", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualSta 2020-11-20T11:42:57.289 INFO:teuthology.task.ansible.out:rt": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/run/nrpe /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 11:41:07 UTC", "StateChangeTimestampMonotonic": "15607793", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203580", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "988", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 11:41:07 UTC", "WatchdogTimestampMonotonic": "15607791", "WatchdogUSec": "0"}} 2020-11-20T11:42:57.319 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:57 +0000 (0:00:00.336) 0:01:01.075 ******* 2020-11-20T11:42:57.505 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-11-20T11:42:57.507 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001699", "end": "2020-11-20 11:42:57.477497", "rc": 0, "start": "2020-11-20 11:42:57.475798", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-11-20T11:42:57.540 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:57 +0000 (0:00:00.220) 0:01:01.295 ******* 2020-11-20T11:42:58.329 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-11-20T11:42:58.330 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-11-20T11:42:58.367 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:58 +0000 (0:00:00.828) 0:01:02.123 ******* 2020-11-20T11:42:58.917 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-11-20T11:42:58.919 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-11-20T11:42:58.953 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:58 +0000 (0:00:00.585) 0:01:02.709 ******* 2020-11-20T11:42:59.718 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-11-20T11:42:59.720 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-11-20T11:42:59.754 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:59 +0000 (0:00:00.800) 0:01:03.509 ******* 2020-11-20T11:42:59.949 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-11-20T11:42:59.951 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-11-20T11:42:59.985 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:42:59 +0000 (0:00:00.231) 0:01:03.741 ******* 2020-11-20T11:43:00.809 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-11-20T11:43:00.843 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:00 +0000 (0:00:00.857) 0:01:04.599 ******* 2020-11-20T11:43:01.480 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-11-20T11:43:01.481 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-11-20T11:43:01.520 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:01 +0000 (0:00:00.676) 0:01:05.275 ******* 2020-11-20T11:43:02.417 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-11-20T11:43:02.419 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-11-20T11:43:02.456 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:02 +0000 (0:00:00.936) 0:01:06.212 ******* 2020-11-20T11:43:03.089 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-11-20T11:43:03.127 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:03 +0000 (0:00:00.668) 0:01:06.881 ******* 2020-11-20T11:43:16.114 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-11-20T11:43:16.116 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.175764", "end": "2020-11-20 11:43:16.089161", "failed_when_result": false, "rc": 0, "start": "2020-11-20 11:42:59.913397", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-11-20T11:43:16.150 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:16 +0000 (0:00:13.025) 0:01:19.906 ******* 2020-11-20T11:43:16.648 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-11-20T11:43:16.650 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-11-20T11:43:16.693 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:16 +0000 (0:00:00.543) 0:01:20.449 ******* 2020-11-20T11:43:16.907 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-11-20T11:43:16.909 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.011438", "end": "2020-11-20 11:43:16.886921", "rc": 0, "start": "2020-11-20 11:43:16.875483", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:43:16.949 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:16 +0000 (0:00:00.255) 0:01:20.705 ******* 2020-11-20T11:43:17.135 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-11-20T11:43:17.137 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.002405", "end": "2020-11-20 11:43:17.112813", "rc": 0, "start": "2020-11-20 11:43:17.110408", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:43:17.169 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:17 +0000 (0:00:00.219) 0:01:20.924 ******* 2020-11-20T11:43:18.039 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-11-20T11:43:18.041 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.339774", "end": "2020-11-20 11:43:18.016286", "failed_when_result": false, "rc": 0, "start": "2020-11-20 11:43:01.676512", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-11-20T11:43:18.074 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:18 +0000 (0:00:00.905) 0:01:21.830 ******* 2020-11-20T11:43:18.535 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-11-20T11:43:18.536 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-11-20T11:43:18.570 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:18 +0000 (0:00:00.496) 0:01:22.326 ******* 2020-11-20T11:43:18.776 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.025798", "end": "2020-11-20 11:43:18.755725", "rc": 0, "start": "2020-11-20 11:43:18.729927", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:43:18.810 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:18 +0000 (0:00:00.239) 0:01:22.566 ******* 2020-11-20T11:43:18.993 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-11-20T11:43:18.995 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.002063", "end": "2020-11-20 11:43:18.971636", "rc": 0, "start": "2020-11-20 11:43:18.969573", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:43:19.027 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:19 +0000 (0:00:00.216) 0:01:22.783 ******* 2020-11-20T11:43:19.372 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.057896", "end": "2020-11-20 11:43:19.339902", "failed_when_result": false, "rc": 0, "start": "2020-11-20 11:43:03.282006", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-11-20T11:43:19.405 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:19 +0000 (0:00:00.378) 0:01:23.161 ******* 2020-11-20T11:43:19.854 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-11-20T11:43:19.856 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-11-20T11:43:19.908 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:19 +0000 (0:00:00.501) 0:01:23.663 ******* 2020-11-20T11:43:20.117 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-11-20T11:43:20.118 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.020952", "end": "2020-11-20 11:43:20.089442", "rc": 0, "start": "2020-11-20 11:43:20.068490", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:43:20.162 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:20 +0000 (0:00:00.254) 0:01:23.917 ******* 2020-11-20T11:43:20.349 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-11-20T11:43:20.350 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.002196", "end": "2020-11-20 11:43:20.321396", "rc": 0, "start": "2020-11-20 11:43:20.319200", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:43:20.382 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:20 +0000 (0:00:00.220) 0:01:24.138 ******* 2020-11-20T11:43:33.459 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** changed: [smithi192.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.104385", "end": "2020-11-20 11:43:33.432701", "rc": 0, "start": "2020-11-20 11:43:17.328316", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:43:33.494 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:33 +0000 (0:00:13.111) 0:01:37.250 ******* 2020-11-20T11:43:33.679 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-11-20T11:43:33.680 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-11-20T11:43:33.713 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:33 +0000 (0:00:00.219) 0:01:37.469 ******* 2020-11-20T11:43:33.741 INFO:teuthology.task.ansible.out: TASK [common : Check for podman] *********************************************** 2020-11-20T11:43:33.743 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:43:33.791 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:33 +0000 (0:00:00.077) 0:01:37.546 ******* 2020-11-20T11:43:33.828 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* ok: [smithi192.front.sepia.ceph.com] => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000"}, "changed": false} 2020-11-20T11:43:33.861 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:33 +0000 (0:00:00.070) 0:01:37.617 ******* 2020-11-20T11:43:33.889 INFO:teuthology.task.ansible.out: TASK [common : Check for docker] *********************************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:43:33.922 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:33 +0000 (0:00:00.060) 0:01:37.678 ******* 2020-11-20T11:43:33.950 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:43:33.983 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:33 +0000 (0:00:00.060) 0:01:37.739 ******* 2020-11-20T11:43:34.033 INFO:teuthology.task.ansible.out: TASK [common : Include encrypted variables] ************************************ ok: [smithi192.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi192.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:43:34.068 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:34 +0000 (0:00:00.085) 0:01:37.824 ******* 2020-11-20T11:43:34.274 INFO:teuthology.task.ansible.out: TASK [common : Create /etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000] *** 2020-11-20T11:43:34.276 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"changed": true, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:43:34.310 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:34 +0000 (0:00:00.241) 0:01:38.066 ******* 2020-11-20T11:43:34.791 INFO:teuthology.task.ansible.out: TASK [common : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2020-11-20T11:43:34.793 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"changed": true, "checksum": "d386a5d594d8bb6c408cf08541a4eb609577a03d", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "md5sum": "e2cf8b6a8ad65ba91ea9fc53d49f1bf4", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 2236, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605872614.3456466-203420440902984/source", "state": "file", "uid": 0} 2020-11-20T11:43:34.825 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:34 +0000 (0:00:00.514) 0:01:38.580 ******* 2020-11-20T11:43:34.851 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-11-20T11:43:34.853 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-11-20T11:43:34.887 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:34 +0000 (0:00:00.061) 0:01:38.642 ******* 2020-11-20T11:43:34.924 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-11-20T11:43:34.925 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T11:43:34.958 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:34 +0000 (0:00:00.071) 0:01:38.714 ******* 2020-11-20T11:43:34.995 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-11-20T11:43:34.997 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": ["dbench"], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "git-all", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "podman", "podman-docker", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "autoconf", "gdb", "iozone", "lvm2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"} 2020-11-20T11:43:35.031 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:35 +0000 (0:00:00.072) 0:01:38.786 ******* 2020-11-20T11:43:35.068 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-11-20T11:43:35.070 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T11:43:35.102 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:35 +0000 (0:00:00.071) 0:01:38.858 ******* 2020-11-20T11:43:35.277 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-11-20T11:43:35.279 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-20T11:43:35.312 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:35 +0000 (0:00:00.208) 0:01:39.067 ******* 2020-11-20T11:43:35.317 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-11-20T11:43:35.319 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.086327", "end": "2020-11-20 11:43:35.273006", "rc": 0, "start": "2020-11-20 11:43:19.186679", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:43:35.354 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:35 +0000 (0:00:00.042) 0:01:39.110 ******* 2020-11-20T11:43:35.488 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-11-20T11:43:35.490 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "name": "ubuntu", "state": "present", "system": false} 2020-11-20T11:43:35.523 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:35 +0000 (0:00:00.168) 0:01:39.279 ******* 2020-11-20T11:43:35.551 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Remove temporary files] ********************************** ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-11-20T11:43:35.584 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:35 +0000 (0:00:00.061) 0:01:39.340 ******* 2020-11-20T11:43:35.615 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:35 +0000 (0:00:00.030) 0:01:39.371 ******* 2020-11-20T11:43:35.621 INFO:teuthology.task.ansible.out: TASK [common : Check for podman] *********************************************** 2020-11-20T11:43:35.623 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:43:35.655 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:35 +0000 (0:00:00.039) 0:01:39.411 ******* 2020-11-20T11:43:35.662 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:43:35.697 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:35 +0000 (0:00:00.041) 0:01:39.452 ******* 2020-11-20T11:43:35.702 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* 2020-11-20T11:43:35.704 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000"}, "changed": false} 2020-11-20T11:43:35.738 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:35 +0000 (0:00:00.040) 0:01:39.493 ******* 2020-11-20T11:43:35.783 INFO:teuthology.task.ansible.out: TASK [common : Check for docker] *********************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:43:35.815 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:35 +0000 (0:00:00.077) 0:01:39.571 ******* 2020-11-20T11:43:35.842 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* 2020-11-20T11:43:35.844 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:43:35.876 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:35 +0000 (0:00:00.060) 0:01:39.632 ******* 2020-11-20T11:43:35.893 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-11-20T11:43:35.895 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-11-20T11:43:35.928 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:35 +0000 (0:00:00.052) 0:01:39.684 ******* 2020-11-20T11:43:35.933 INFO:teuthology.task.ansible.out: TASK [common : Include encrypted variables] ************************************ 2020-11-20T11:43:35.935 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi087.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:43:35.972 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:35 +0000 (0:00:00.043) 0:01:39.728 ******* 2020-11-20T11:43:36.179 INFO:teuthology.task.ansible.out: TASK [common : Create /etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000] *** 2020-11-20T11:43:36.181 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:43:36.219 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:36 +0000 (0:00:00.246) 0:01:39.974 ******* 2020-11-20T11:43:36.442 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-11-20T11:43:36.444 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-11-20T11:43:36.479 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:36 +0000 (0:00:00.260) 0:01:40.235 ******* 2020-11-20T11:43:36.509 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [smithi192.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi192"}, "changed": false} 2020-11-20T11:43:36.542 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:36 +0000 (0:00:00.063) 0:01:40.298 ******* 2020-11-20T11:43:36.614 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-11-20T11:43:36.616 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.037443", "end": "2020-11-20 11:43:36.586036", "rc": 0, "start": "2020-11-20 11:43:20.548593", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:43:36.651 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:36 +0000 (0:00:00.108) 0:01:40.406 ******* 2020-11-20T11:43:36.700 INFO:teuthology.task.ansible.out: TASK [common : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2020-11-20T11:43:36.701 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "checksum": "d386a5d594d8bb6c408cf08541a4eb609577a03d", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "md5sum": "e2cf8b6a8ad65ba91ea9fc53d49f1bf4", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 2236, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605872616.2485967-131440380716847/source", "state": "file", "uid": 0} 2020-11-20T11:43:36.734 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:36 +0000 (0:00:00.083) 0:01:40.490 ******* 2020-11-20T11:43:36.761 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-11-20T11:43:36.763 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-11-20T11:43:36.797 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:36 +0000 (0:00:00.062) 0:01:40.552 ******* 2020-11-20T11:43:36.848 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-11-20T11:43:36.850 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} TASK [common : nrpe - Remove temporary files] ********************************** ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-11-20T11:43:36.888 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:36 +0000 (0:00:00.091) 0:01:40.644 ******* 2020-11-20T11:43:36.920 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:36 +0000 (0:00:00.031) 0:01:40.676 ******* 2020-11-20T11:43:36.927 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-11-20T11:43:36.929 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": ["dbench"], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "git-all", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "podman", "podman-docker", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "autoconf", "gdb", "iozone", "lvm2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"} 2020-11-20T11:43:36.964 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:36 +0000 (0:00:00.043) 0:01:40.720 ******* 2020-11-20T11:43:36.970 INFO:teuthology.task.ansible.out: TASK [common : Check for podman] *********************************************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:43:37.015 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:37 +0000 (0:00:00.051) 0:01:40.771 ******* 2020-11-20T11:43:37.023 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-11-20T11:43:37.025 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T11:43:37.062 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:37 +0000 (0:00:00.046) 0:01:40.817 ******* 2020-11-20T11:43:37.069 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* 2020-11-20T11:43:37.070 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000"}, "changed": false} 2020-11-20T11:43:37.118 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:37 +0000 (0:00:00.056) 0:01:40.874 ******* 2020-11-20T11:43:37.145 INFO:teuthology.task.ansible.out: TASK [common : Check for docker] *********************************************** 2020-11-20T11:43:37.147 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:43:37.179 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:37 +0000 (0:00:00.060) 0:01:40.935 ******* 2020-11-20T11:43:37.206 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* 2020-11-20T11:43:37.208 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:43:37.240 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:37 +0000 (0:00:00.060) 0:01:40.995 ******* 2020-11-20T11:43:37.246 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-11-20T11:43:37.247 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-20T11:43:37.281 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:37 +0000 (0:00:00.041) 0:01:41.037 ******* 2020-11-20T11:43:37.299 INFO:teuthology.task.ansible.out: TASK [common : Include encrypted variables] ************************************ 2020-11-20T11:43:37.301 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi146.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:43:37.358 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:37 +0000 (0:00:00.077) 0:01:41.114 ******* 2020-11-20T11:43:37.460 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "name": "ubuntu", "state": "present", "system": false} 2020-11-20T11:43:37.496 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:37 +0000 (0:00:00.137) 0:01:41.252 ******* 2020-11-20T11:43:37.524 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-11-20T11:43:37.526 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:43:37.560 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:37 +0000 (0:00:00.062) 0:01:41.314 ******* 2020-11-20T11:43:37.577 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ ok: [smithi192.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi192", "ansible_hostname": "smithi192", "ansible_nodename": "smithi192"}, "changed": false, "name": "smithi192"} 2020-11-20T11:43:37.613 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:37 +0000 (0:00:00.054) 0:01:41.369 ******* 2020-11-20T11:43:37.621 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-11-20T11:43:37.624 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Create /etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000] *** changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:43:37.661 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:37 +0000 (0:00:00.047) 0:01:41.417 ******* 2020-11-20T11:43:37.695 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:37 +0000 (0:00:00.033) 0:01:41.451 ******* 2020-11-20T11:43:37.889 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [smithi087.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-11-20T11:43:37.934 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:37 +0000 (0:00:00.239) 0:01:41.690 ******* 2020-11-20T11:43:38.094 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-11-20T11:43:38.095 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-11-20T11:43:38.129 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:38 +0000 (0:00:00.194) 0:01:41.885 ******* 2020-11-20T11:43:38.211 INFO:teuthology.task.ansible.out: TASK [common : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "checksum": "d386a5d594d8bb6c408cf08541a4eb609577a03d", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "md5sum": "e2cf8b6a8ad65ba91ea9fc53d49f1bf4", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 2236, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605872617.733566-223394467885553/source", "state": "file", "uid": 0} 2020-11-20T11:43:38.250 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:38 +0000 (0:00:00.121) 0:01:42.006 ******* 2020-11-20T11:43:38.280 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-11-20T11:43:38.321 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:38 +0000 (0:00:00.070) 0:01:42.077 ******* 2020-11-20T11:43:38.364 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-11-20T11:43:38.366 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T11:43:38.401 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:38 +0000 (0:00:00.079) 0:01:42.156 ******* 2020-11-20T11:43:38.441 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-11-20T11:43:38.443 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": ["dbench"], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "git-all", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "podman", "podman-docker", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "autoconf", "gdb", "iozone", "lvm2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"} 2020-11-20T11:43:38.443 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-11-20T11:43:38.500 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:38 +0000 (0:00:00.097) 0:01:42.254 ******* 2020-11-20T11:43:38.530 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:38 +0000 (0:00:00.031) 0:01:42.286 ******* 2020-11-20T11:43:38.536 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi087"}, "changed": false} 2020-11-20T11:43:38.573 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:38 +0000 (0:00:00.043) 0:01:42.329 ******* 2020-11-20T11:43:38.582 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} TASK [testnode : Including version specific variables.] ************************ ok: [smithi146.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T11:43:38.631 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:38 +0000 (0:00:00.058) 0:01:42.387 ******* 2020-11-20T11:43:38.665 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:38 +0000 (0:00:00.034) 0:01:42.421 ******* 2020-11-20T11:43:38.821 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-11-20T11:43:38.823 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-20T11:43:38.856 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:38 +0000 (0:00:00.191) 0:01:42.612 ******* 2020-11-20T11:43:39.043 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-11-20T11:43:39.045 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "name": "ubuntu", "state": "present", "system": false} 2020-11-20T11:43:39.096 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:39 +0000 (0:00:00.239) 0:01:42.852 ******* 2020-11-20T11:43:39.124 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-11-20T11:43:39.126 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:43:39.159 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:39 +0000 (0:00:00.062) 0:01:42.915 ******* 2020-11-20T11:43:39.166 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-11-20T11:43:39.168 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi087.front.sepia.ceph.com", "ansible_hostname": "smithi087", "ansible_nodename": "smithi087"}, "changed": true, "name": "smithi087"} 2020-11-20T11:43:39.202 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:39 +0000 (0:00:00.043) 0:01:42.958 ******* 2020-11-20T11:43:39.209 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-11-20T11:43:39.318 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 11:43:39 +0000 (0:00:00.044) 0:01:43.003 ******* TASK [testnode : Add ssh pubkeys] ********************************************** ok: [smithi192.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} Friday 20 November 2020 11:43:39 +0000 (0:00:00.058) 0:01:43.061 ******* 2020-11-20T11:43:39.463 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-11-20T11:43:39.465 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-11-20T11:43:39.501 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:39 +0000 (0:00:00.193) 0:01:43.255 ******* 2020-11-20T11:43:39.739 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-11-20T11:43:39.773 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:39 +0000 (0:00:00.273) 0:01:43.529 ******* 2020-11-20T11:43:39.801 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-11-20T11:43:39.803 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-11-20T11:43:39.842 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:39 +0000 (0:00:00.069) 0:01:43.598 ******* 2020-11-20T11:43:40.017 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-11-20T11:43:40.019 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-11-20T11:43:40.053 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:40 +0000 (0:00:00.210) 0:01:43.809 ******* 2020-11-20T11:43:40.060 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-11-20T11:43:40.063 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-20T11:43:40.098 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:40 +0000 (0:00:00.045) 0:01:43.854 ******* 2020-11-20T11:43:40.104 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-11-20T11:43:40.106 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi146"}, "changed": false} 2020-11-20T11:43:40.151 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:40 +0000 (0:00:00.052) 0:01:43.907 ******* 2020-11-20T11:43:40.291 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-11-20T11:43:40.326 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:40 +0000 (0:00:00.174) 0:01:44.082 ******* 2020-11-20T11:43:40.332 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-11-20T11:43:40.334 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-11-20T11:43:40.369 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:40 +0000 (0:00:00.042) 0:01:44.125 ******* 2020-11-20T11:43:40.530 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-11-20T11:43:40.531 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1236, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-11-20T11:43:40.565 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:40 +0000 (0:00:00.196) 0:01:44.321 ******* 2020-11-20T11:43:40.737 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-11-20T11:43:40.740 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi146", "ansible_hostname": "smithi146", "ansible_nodename": "smithi146"}, "changed": false, "name": "smithi146"} 2020-11-20T11:43:40.774 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:40 +0000 (0:00:00.209) 0:01:44.530 ******* 2020-11-20T11:43:40.975 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-11-20T11:43:40.977 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-11-20T11:43:41.018 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:41 +0000 (0:00:00.243) 0:01:44.774 ******* 2020-11-20T11:43:41.035 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-20T11:43:41.037 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-11-20T11:43:41.076 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:41 +0000 (0:00:00.058) 0:01:44.832 ******* 2020-11-20T11:43:41.230 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-11-20T11:43:41.232 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-11-20T11:43:41.266 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:41 +0000 (0:00:00.189) 0:01:45.022 ******* 2020-11-20T11:43:41.464 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-11-20T11:43:41.466 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-11-20T11:43:41.505 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:41 +0000 (0:00:00.238) 0:01:45.260 ******* 2020-11-20T11:43:41.522 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-20T11:43:41.524 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-11-20T11:43:41.558 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:41 +0000 (0:00:00.053) 0:01:45.314 ******* 2020-11-20T11:43:41.691 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-11-20T11:43:41.693 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-20T11:43:41.726 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:41 +0000 (0:00:00.167) 0:01:45.482 ******* 2020-11-20T11:43:41.733 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-11-20T11:43:41.734 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-11-20T11:43:41.770 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:41 +0000 (0:00:00.043) 0:01:45.525 ******* 2020-11-20T11:43:41.914 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-11-20T11:43:41.916 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-11-20T11:43:41.950 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:41 +0000 (0:00:00.180) 0:01:45.706 ******* 2020-11-20T11:43:42.158 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-11-20T11:43:42.159 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1236, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-11-20T11:43:42.192 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:42 +0000 (0:00:00.241) 0:01:45.948 ******* 2020-11-20T11:43:42.358 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-11-20T11:43:42.360 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-11-20T11:43:42.394 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:42 +0000 (0:00:00.201) 0:01:46.150 ******* 2020-11-20T11:43:42.625 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-20T11:43:42.626 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-11-20T11:43:42.660 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:42 +0000 (0:00:00.265) 0:01:46.415 ******* 2020-11-20T11:43:42.834 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-11-20T11:43:42.836 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-11-20T11:43:42.870 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:42 +0000 (0:00:00.209) 0:01:46.625 ******* 2020-11-20T11:43:43.055 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-11-20T11:43:43.057 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-20T11:43:43.090 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:43 +0000 (0:00:00.220) 0:01:46.846 ******* 2020-11-20T11:43:43.107 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-20T11:43:43.109 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-11-20T11:43:43.147 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:43 +0000 (0:00:00.056) 0:01:46.903 ******* 2020-11-20T11:43:43.271 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-11-20T11:43:43.273 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-11-20T11:43:43.313 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:43 +0000 (0:00:00.163) 0:01:47.066 ******* 2020-11-20T11:43:43.517 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-11-20T11:43:43.519 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1236, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-11-20T11:43:43.558 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:43 +0000 (0:00:00.246) 0:01:47.313 ******* 2020-11-20T11:43:43.746 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-20T11:43:43.748 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi192.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.997363", "end": "2020-11-20 11:43:43.722516", "rc": 0, "start": "2020-11-20 11:43:41.725153", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:43:43.784 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:43 +0000 (0:00:00.226) 0:01:47.540 ******* 2020-11-20T11:43:43.811 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:43:43.845 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:43 +0000 (0:00:00.060) 0:01:47.601 ******* 2020-11-20T11:43:43.999 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-20T11:43:44.001 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-11-20T11:43:44.034 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:44 +0000 (0:00:00.189) 0:01:47.790 ******* 2020-11-20T11:43:44.304 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-11-20T11:43:44.306 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-11-20T11:43:44.341 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:44 +0000 (0:00:00.307) 0:01:48.097 ******* 2020-11-20T11:43:44.368 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-11-20T11:43:44.402 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:44 +0000 (0:00:00.060) 0:01:48.158 ******* 2020-11-20T11:43:44.429 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-11-20T11:43:44.463 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:44 +0000 (0:00:00.060) 0:01:48.219 ******* 2020-11-20T11:43:44.479 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-20T11:43:44.481 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-11-20T11:43:44.514 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:44 +0000 (0:00:00.051) 0:01:48.270 ******* 2020-11-20T11:43:44.521 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-11-20T11:43:44.523 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:43:44.558 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:44 +0000 (0:00:00.042) 0:01:48.313 ******* 2020-11-20T11:43:44.597 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi192.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-20T11:43:44.632 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:44 +0000 (0:00:00.075) 0:01:48.388 ******* 2020-11-20T11:43:44.659 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-11-20T11:43:44.661 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:43:44.693 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:44 +0000 (0:00:00.060) 0:01:48.449 ******* 2020-11-20T11:43:44.723 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:43:44.757 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:44 +0000 (0:00:00.063) 0:01:48.513 ******* 2020-11-20T11:43:44.794 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:43:44.828 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:44 +0000 (0:00:00.070) 0:01:48.584 ******* 2020-11-20T11:43:44.870 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:43:44.909 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:44 +0000 (0:00:00.081) 0:01:48.665 ******* 2020-11-20T11:43:45.107 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-11-20T11:43:45.109 INFO:teuthology.task.ansible.out:fatal: [smithi192.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.007053", "end": "2020-11-20 11:43:45.082830", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 11:43:45.075777", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-11-20T11:43:45.143 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:45 +0000 (0:00:00.233) 0:01:48.898 ******* 2020-11-20T11:43:45.169 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-11-20T11:43:45.171 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:43:45.204 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:45 +0000 (0:00:00.061) 0:01:48.960 ******* 2020-11-20T11:43:45.401 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-20T11:43:45.402 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.052481", "end": "2020-11-20 11:43:45.377351", "rc": 0, "start": "2020-11-20 11:43:43.324870", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:43:45.437 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:45 +0000 (0:00:00.232) 0:01:49.193 ******* 2020-11-20T11:43:45.466 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:43:45.501 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:45 +0000 (0:00:00.063) 0:01:49.257 ******* 2020-11-20T11:43:46.016 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-11-20T11:43:46.019 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-11-20T11:43:46.052 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:46 +0000 (0:00:00.550) 0:01:49.807 ******* 2020-11-20T11:43:46.079 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-11-20T11:43:46.129 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:46 +0000 (0:00:00.077) 0:01:49.885 ******* 2020-11-20T11:43:46.157 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-11-20T11:43:46.203 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:46 +0000 (0:00:00.073) 0:01:49.959 ******* 2020-11-20T11:43:46.234 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-11-20T11:43:46.236 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:43:46.268 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:46 +0000 (0:00:00.065) 0:01:50.024 ******* 2020-11-20T11:43:46.307 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-11-20T11:43:46.308 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-20T11:43:46.343 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:46 +0000 (0:00:00.074) 0:01:50.099 ******* 2020-11-20T11:43:46.373 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:43:46.406 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:46 +0000 (0:00:00.063) 0:01:50.162 ******* 2020-11-20T11:43:46.443 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:43:46.483 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:46 +0000 (0:00:00.076) 0:01:50.238 ******* 2020-11-20T11:43:46.531 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-11-20T11:43:46.533 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:43:46.569 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:46 +0000 (0:00:00.086) 0:01:50.325 ******* 2020-11-20T11:43:46.597 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:43:46.632 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:46 +0000 (0:00:00.062) 0:01:50.387 ******* 2020-11-20T11:43:46.670 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-20T11:43:46.671 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.975369", "end": "2020-11-20 11:43:46.644295", "rc": 0, "start": "2020-11-20 11:43:44.668926", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:43:46.716 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:46 +0000 (0:00:00.084) 0:01:50.471 ******* 2020-11-20T11:43:46.745 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-11-20T11:43:46.746 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:43:46.781 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:46 +0000 (0:00:00.065) 0:01:50.537 ******* 2020-11-20T11:43:46.830 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-11-20T11:43:46.832 INFO:teuthology.task.ansible.out:fatal: [smithi087.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006814", "end": "2020-11-20 11:43:46.806949", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 11:43:46.800135", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-11-20T11:43:46.867 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:46 +0000 (0:00:00.086) 0:01:50.623 ******* 2020-11-20T11:43:46.900 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:43:46.933 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:46 +0000 (0:00:00.065) 0:01:50.689 ******* 2020-11-20T11:43:47.245 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-11-20T11:43:47.247 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-11-20T11:43:47.291 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:47 +0000 (0:00:00.358) 0:01:51.047 ******* 2020-11-20T11:43:47.323 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-11-20T11:43:47.365 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:47 +0000 (0:00:00.073) 0:01:51.120 ******* 2020-11-20T11:43:47.393 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-11-20T11:43:47.427 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:47 +0000 (0:00:00.062) 0:01:51.183 ******* 2020-11-20T11:43:47.466 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-11-20T11:43:47.467 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:43:47.509 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:47 +0000 (0:00:00.081) 0:01:51.265 ******* 2020-11-20T11:43:47.547 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-11-20T11:43:47.549 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-11-20T11:43:47.560 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-20T11:43:47.598 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:47 +0000 (0:00:00.089) 0:01:51.354 ******* 2020-11-20T11:43:47.625 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-11-20T11:43:47.627 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:43:47.660 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:47 +0000 (0:00:00.061) 0:01:51.416 ******* 2020-11-20T11:43:47.687 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:43:47.689 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:43:47.723 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:47 +0000 (0:00:00.062) 0:01:51.478 ******* 2020-11-20T11:43:47.760 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-11-20T11:43:47.761 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:43:47.799 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:47 +0000 (0:00:00.076) 0:01:51.555 ******* 2020-11-20T11:43:47.837 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-11-20T11:43:47.839 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:43:47.872 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:47 +0000 (0:00:00.072) 0:01:51.628 ******* 2020-11-20T11:43:48.071 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-11-20T11:43:48.074 INFO:teuthology.task.ansible.out:fatal: [smithi146.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.007020", "end": "2020-11-20 11:43:48.043026", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 11:43:48.036006", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-11-20T11:43:48.124 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:48 +0000 (0:00:00.250) 0:01:51.878 ******* 2020-11-20T11:43:48.161 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-11-20T11:43:48.162 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:43:48.195 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:48 +0000 (0:00:00.073) 0:01:51.951 ******* 2020-11-20T11:43:51.503 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-11-20T11:43:51.506 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64"]} 2020-11-20T11:43:51.541 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:51 +0000 (0:00:03.345) 0:01:55.297 ******* 2020-11-20T11:43:53.248 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64"]} 2020-11-20T11:43:53.290 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:53 +0000 (0:00:01.748) 0:01:57.046 ******* 2020-11-20T11:43:54.446 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64"]} 2020-11-20T11:43:54.481 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:54 +0000 (0:00:01.191) 0:01:58.237 ******* 2020-11-20T11:43:57.509 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-11-20T11:43:57.511 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-10.el8.x86_64", "Removed: boost-random-1.66.0-10.el8.x86_64"]} 2020-11-20T11:43:57.544 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:57 +0000 (0:00:03.063) 0:02:01.300 ******* 2020-11-20T11:43:59.185 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-10.el8.x86_64", "Removed: boost-random-1.66.0-10.el8.x86_64"]} 2020-11-20T11:43:59.221 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:43:59 +0000 (0:00:01.676) 0:02:02.977 ******* 2020-11-20T11:44:00.291 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-10.el8.x86_64", "Removed: boost-random-1.66.0-10.el8.x86_64"]} 2020-11-20T11:44:00.325 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:00 +0000 (0:00:01.104) 0:02:04.081 ******* 2020-11-20T11:44:04.669 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T11:44:04.672 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: git-all", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: podman", "Installed: podman-docker", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: lvm2", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64", "Installed: boost-program-options-1.66.0-10.el8.x86_64"]} 2020-11-20T11:44:04.704 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:04 +0000 (0:00:04.379) 0:02:08.460 ******* 2020-11-20T11:44:06.235 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: git-all", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: podman", "Installed: podman-docker", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: lvm2", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64", "Installed: boost-program-options-1.66.0-10.el8.x86_64"]} 2020-11-20T11:44:06.269 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:06 +0000 (0:00:01.564) 0:02:10.025 ******* 2020-11-20T11:44:07.138 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-11-20T11:44:07.140 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: dbench"]} 2020-11-20T11:44:07.175 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:07 +0000 (0:00:00.905) 0:02:10.930 ******* 2020-11-20T11:44:07.331 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: git-all", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: podman", "Installed: podman-docker", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: lvm2", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64", "Installed: boost-program-options-1.66.0-10.el8.x86_64", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64"]} 2020-11-20T11:44:07.412 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:07 +0000 (0:00:00.191) 0:02:11.121 ******* 2020-11-20T11:44:08.754 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-11-20T11:44:08.756 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: dbench"]} 2020-11-20T11:44:08.790 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:08 +0000 (0:00:01.424) 0:02:12.545 ******* 2020-11-20T11:44:09.644 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-11-20T11:44:09.680 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:09 +0000 (0:00:00.890) 0:02:13.436 ******* 2020-11-20T11:44:09.718 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T11:44:09.720 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:09.753 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:09 +0000 (0:00:00.072) 0:02:13.509 ******* 2020-11-20T11:44:09.843 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-11-20T11:44:09.845 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: dbench"]} 2020-11-20T11:44:09.883 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:09 +0000 (0:00:00.130) 0:02:13.639 ******* 2020-11-20T11:44:10.043 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-11-20T11:44:10.049 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "dbus.socket polkit.service basic.target system.slice dbus.service sysinit.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "nftables.service ipset.service shutdown.target ip6tables.service iptables.service ebtables.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "D 2020-11-20T11:44:10.051 INFO:teuthology.task.ansible.out:evicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "Limi 2020-11-20T11:44:10.053 INFO:teuthology.task.ansible.out:tNOFILESoft": "1024", "LimitNPROC": "127237", "LimitNPROCSoft": "127237", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127237", "LimitSIGPENDINGSoft": "127237", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target dbus.socket system.slice", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "S 2020-11-20T11:44:10.054 INFO:teuthology.task.ansible.out:tartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203580", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-11-20T11:44:10.111 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:10 +0000 (0:00:00.227) 0:02:13.867 ******* 2020-11-20T11:44:10.438 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-11-20T11:44:10.440 INFO:teuthology.task.ansible.out:fatal: [smithi192.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-11-20T11:44:10.480 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:10 +0000 (0:00:00.369) 0:02:14.236 ******* 2020-11-20T11:44:11.144 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-11-20T11:44:11.146 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-11-20T11:44:11.178 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:11 +0000 (0:00:00.697) 0:02:14.934 ******* 2020-11-20T11:44:11.194 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-20T11:44:11.196 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-11-20T11:44:11.229 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:11 +0000 (0:00:00.051) 0:02:14.985 ******* 2020-11-20T11:44:11.236 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2020-11-20T11:44:11.238 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:11.271 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:11 +0000 (0:00:00.042) 0:02:15.027 ******* 2020-11-20T11:44:11.276 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T11:44:11.278 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:11.312 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:11 +0000 (0:00:00.040) 0:02:15.068 ******* 2020-11-20T11:44:11.318 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-11-20T11:44:11.320 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:11.353 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:11 +0000 (0:00:00.041) 0:02:15.109 ******* 2020-11-20T11:44:11.380 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2020-11-20T11:44:11.382 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:11.414 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:11 +0000 (0:00:00.060) 0:02:15.170 ******* 2020-11-20T11:44:11.441 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:11.475 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:11 +0000 (0:00:00.060) 0:02:15.230 ******* 2020-11-20T11:44:11.501 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2020-11-20T11:44:11.503 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:11.535 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:11 +0000 (0:00:00.060) 0:02:15.291 ******* 2020-11-20T11:44:11.562 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-11-20T11:44:11.564 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:11.596 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:11 +0000 (0:00:00.060) 0:02:15.352 ******* 2020-11-20T11:44:11.602 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-11-20T11:44:11.604 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "basic.target polkit.service sysinit.target system.slice dbus.socket dbus.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "iptables.service shutdown.target ip6tables.service ebtables.service ipset.service nftables.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "D 2020-11-20T11:44:11.605 INFO:teuthology.task.ansible.out:evicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "Limi 2020-11-20T11:44:11.607 INFO:teuthology.task.ansible.out:tNOFILESoft": "1024", "LimitNPROC": "127237", "LimitNPROCSoft": "127237", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127237", "LimitSIGPENDINGSoft": "127237", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "dbus.socket sysinit.target system.slice", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "S 2020-11-20T11:44:11.608 INFO:teuthology.task.ansible.out:tartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203579", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-11-20T11:44:11.639 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:11 +0000 (0:00:00.042) 0:02:15.395 ******* 2020-11-20T11:44:11.645 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-11-20T11:44:11.681 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:11 +0000 (0:00:00.042) 0:02:15.437 ******* 2020-11-20T11:44:11.708 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-11-20T11:44:11.709 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:11.746 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:11 +0000 (0:00:00.064) 0:02:15.501 ******* 2020-11-20T11:44:11.773 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-11-20T11:44:11.775 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:11.809 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:11 +0000 (0:00:00.063) 0:02:15.565 ******* 2020-11-20T11:44:11.858 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* skipping: [smithi192.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:11.886 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:11.904 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:11 +0000 (0:00:00.094) 0:02:15.660 ******* 2020-11-20T11:44:11.921 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ fatal: [smithi087.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-11-20T11:44:11.956 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:11 +0000 (0:00:00.051) 0:02:15.711 ******* 2020-11-20T11:44:11.963 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-11-20T11:44:11.965 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:11.999 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:11 +0000 (0:00:00.043) 0:02:15.755 ******* 2020-11-20T11:44:12.028 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-11-20T11:44:12.061 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:12 +0000 (0:00:00.062) 0:02:15.817 ******* 2020-11-20T11:44:12.091 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:12.135 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:12 +0000 (0:00:00.073) 0:02:15.891 ******* 2020-11-20T11:44:12.163 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:12.197 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:12 +0000 (0:00:00.061) 0:02:15.953 ******* 2020-11-20T11:44:12.224 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-11-20T11:44:12.225 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:12.258 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:12 +0000 (0:00:00.061) 0:02:16.014 ******* 2020-11-20T11:44:12.285 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T11:44:12.287 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:12.319 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:12 +0000 (0:00:00.060) 0:02:16.075 ******* 2020-11-20T11:44:12.336 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-11-20T11:44:12.338 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} TASK [testnode : Remove packages] ********************************************** ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-11-20T11:44:12.371 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:12 +0000 (0:00:00.051) 0:02:16.127 ******* 2020-11-20T11:44:12.402 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:12 +0000 (0:00:00.031) 0:02:16.158 ******* 2020-11-20T11:44:12.409 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-11-20T11:44:12.410 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install abrt] ************************************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:12.444 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:12 +0000 (0:00:00.041) 0:02:16.200 ******* 2020-11-20T11:44:12.475 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:12 +0000 (0:00:00.031) 0:02:16.231 ******* 2020-11-20T11:44:12.481 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T11:44:12.482 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable abrt-auto-reporting] *********************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:12.517 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:12 +0000 (0:00:00.041) 0:02:16.272 ******* 2020-11-20T11:44:12.548 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:12 +0000 (0:00:00.031) 0:02:16.304 ******* 2020-11-20T11:44:12.554 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:12.558 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:12.597 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:12 +0000 (0:00:00.049) 0:02:16.353 ******* 2020-11-20T11:44:12.631 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:12 +0000 (0:00:00.033) 0:02:16.387 ******* 2020-11-20T11:44:12.637 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2020-11-20T11:44:12.639 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:12.687 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:12 +0000 (0:00:00.055) 0:02:16.442 ******* 2020-11-20T11:44:12.697 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-11-20T11:44:12.698 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:12.737 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:12 +0000 (0:00:00.050) 0:02:16.493 ******* 2020-11-20T11:44:12.746 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2020-11-20T11:44:12.748 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:12.794 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:12 +0000 (0:00:00.056) 0:02:16.549 ******* 2020-11-20T11:44:12.801 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-11-20T11:44:12.802 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:12.847 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:12 +0000 (0:00:00.053) 0:02:16.603 ******* 2020-11-20T11:44:12.854 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:12.888 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:12 +0000 (0:00:00.041) 0:02:16.644 ******* 2020-11-20T11:44:12.896 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-11-20T11:44:12.898 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "polkit.service basic.target system.slice sysinit.target dbus.service dbus.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nftables.service ipset.service ip6tables.service iptables.service ebtables.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "D 2020-11-20T11:44:12.899 INFO:teuthology.task.ansible.out:evicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "Limi 2020-11-20T11:44:12.901 INFO:teuthology.task.ansible.out:tNOFILESoft": "1024", "LimitNPROC": "127237", "LimitNPROCSoft": "127237", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127237", "LimitSIGPENDINGSoft": "127237", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target dbus.socket", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "S 2020-11-20T11:44:12.903 INFO:teuthology.task.ansible.out:tartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203580", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:12.937 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:12 +0000 (0:00:00.045) 0:02:16.690 ******* 2020-11-20T11:44:12.967 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:12 +0000 (0:00:00.032) 0:02:16.722 ******* 2020-11-20T11:44:12.973 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-11-20T11:44:13.010 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:13 +0000 (0:00:00.043) 0:02:16.766 ******* 2020-11-20T11:44:13.017 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-11-20T11:44:13.019 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:13.060 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:13 +0000 (0:00:00.049) 0:02:16.815 ******* 2020-11-20T11:44:13.066 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-11-20T11:44:13.068 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:13.108 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:13 +0000 (0:00:00.048) 0:02:16.864 ******* 2020-11-20T11:44:13.115 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-11-20T11:44:13.117 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:13.158 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:13 +0000 (0:00:00.049) 0:02:16.913 ******* 2020-11-20T11:44:13.164 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-11-20T11:44:13.167 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:13.199 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:13 +0000 (0:00:00.041) 0:02:16.955 ******* 2020-11-20T11:44:13.206 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-11-20T11:44:13.208 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:13.242 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:13 +0000 (0:00:00.042) 0:02:16.998 ******* 2020-11-20T11:44:13.253 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ fatal: [smithi146.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-11-20T11:44:13.255 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* skipping: [smithi087.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:13.289 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:13 +0000 (0:00:00.046) 0:02:17.044 ******* 2020-11-20T11:44:13.320 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:13 +0000 (0:00:00.031) 0:02:17.075 ******* 2020-11-20T11:44:13.326 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-11-20T11:44:13.328 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install python-apt] ******************************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:13.362 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:13 +0000 (0:00:00.042) 0:02:17.118 ******* 2020-11-20T11:44:13.395 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:13 +0000 (0:00:00.032) 0:02:17.150 ******* 2020-11-20T11:44:13.400 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-11-20T11:44:13.441 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:13 +0000 (0:00:00.046) 0:02:17.197 ******* 2020-11-20T11:44:13.447 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-11-20T11:44:13.449 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:13.484 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:13 +0000 (0:00:00.042) 0:02:17.239 ******* 2020-11-20T11:44:13.489 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-11-20T11:44:13.491 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:13.525 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:13 +0000 (0:00:00.041) 0:02:17.281 ******* 2020-11-20T11:44:13.532 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-11-20T11:44:13.533 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:13.569 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:13 +0000 (0:00:00.043) 0:02:17.325 ******* 2020-11-20T11:44:13.575 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:13.612 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:13 +0000 (0:00:00.042) 0:02:17.367 ******* 2020-11-20T11:44:13.618 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-11-20T11:44:13.620 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:13.655 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:13 +0000 (0:00:00.043) 0:02:17.411 ******* 2020-11-20T11:44:13.687 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:13 +0000 (0:00:00.031) 0:02:17.443 ******* 2020-11-20T11:44:13.693 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-11-20T11:44:13.695 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install abrt] ************************************************* skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:13.730 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:13 +0000 (0:00:00.042) 0:02:17.486 ******* 2020-11-20T11:44:13.763 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:13 +0000 (0:00:00.032) 0:02:17.519 ******* 2020-11-20T11:44:13.772 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-11-20T11:44:13.774 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:13.807 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:13 +0000 (0:00:00.044) 0:02:17.563 ******* 2020-11-20T11:44:13.840 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:13 +0000 (0:00:00.032) 0:02:17.595 ******* 2020-11-20T11:44:13.846 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-11-20T11:44:13.848 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:13.884 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:13 +0000 (0:00:00.044) 0:02:17.639 ******* 2020-11-20T11:44:13.915 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:13 +0000 (0:00:00.031) 0:02:17.671 ******* 2020-11-20T11:44:13.921 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-20T11:44:13.923 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages] ********************************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:13.957 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:13 +0000 (0:00:00.042) 0:02:17.713 ******* 2020-11-20T11:44:13.988 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:13 +0000 (0:00:00.031) 0:02:17.744 ******* 2020-11-20T11:44:13.995 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2020-11-20T11:44:13.996 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install non aarch64 packages] ********************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:14.033 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:14 +0000 (0:00:00.044) 0:02:17.789 ******* 2020-11-20T11:44:14.068 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:14 +0000 (0:00:00.035) 0:02:17.824 ******* 2020-11-20T11:44:14.075 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-20T11:44:14.078 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:14.114 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:14 +0000 (0:00:00.045) 0:02:17.870 ******* 2020-11-20T11:44:14.146 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:14 +0000 (0:00:00.032) 0:02:17.902 ******* 2020-11-20T11:44:14.153 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:14.155 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:14.195 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:14 +0000 (0:00:00.048) 0:02:17.951 ******* 2020-11-20T11:44:14.243 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:14 +0000 (0:00:00.048) 0:02:17.999 ******* 2020-11-20T11:44:14.250 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-20T11:44:14.252 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure fuse group exists.] ************************************ skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:14.287 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:14 +0000 (0:00:00.043) 0:02:18.042 ******* 2020-11-20T11:44:14.319 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:14 +0000 (0:00:00.031) 0:02:18.074 ******* 2020-11-20T11:44:14.324 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2020-11-20T11:44:14.326 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload /etc/fuse.conf.] *************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:14.364 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:14 +0000 (0:00:00.045) 0:02:18.120 ******* 2020-11-20T11:44:14.400 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:14 +0000 (0:00:00.035) 0:02:18.155 ******* 2020-11-20T11:44:14.406 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-11-20T11:44:14.408 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:14.443 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:14 +0000 (0:00:00.043) 0:02:18.199 ******* 2020-11-20T11:44:14.476 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:14 +0000 (0:00:00.032) 0:02:18.232 ******* 2020-11-20T11:44:14.482 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-11-20T11:44:14.483 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set up static IP in /etc/hosts.] ****************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:14.519 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:14 +0000 (0:00:00.043) 0:02:18.275 ******* 2020-11-20T11:44:14.552 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:14 +0000 (0:00:00.033) 0:02:18.308 ******* 2020-11-20T11:44:14.559 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-11-20T11:44:14.560 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop apache2] ************************************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:14.595 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:14 +0000 (0:00:00.042) 0:02:18.351 ******* 2020-11-20T11:44:14.627 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:14 +0000 (0:00:00.032) 0:02:18.383 ******* 2020-11-20T11:44:14.633 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-11-20T11:44:14.635 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:14.670 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:14 +0000 (0:00:00.042) 0:02:18.426 ******* 2020-11-20T11:44:14.703 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:14 +0000 (0:00:00.033) 0:02:18.459 ******* 2020-11-20T11:44:14.710 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:44:14.712 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:14.749 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:14 +0000 (0:00:00.045) 0:02:18.505 ******* 2020-11-20T11:44:14.783 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:14 +0000 (0:00:00.033) 0:02:18.539 ******* 2020-11-20T11:44:14.790 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-11-20T11:44:14.791 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:14.827 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:14 +0000 (0:00:00.042) 0:02:18.582 ******* 2020-11-20T11:44:14.857 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:14 +0000 (0:00:00.031) 0:02:18.613 ******* 2020-11-20T11:44:14.864 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-20T11:44:14.866 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:14.906 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:14 +0000 (0:00:00.049) 0:02:18.662 ******* 2020-11-20T11:44:14.944 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:14 +0000 (0:00:00.037) 0:02:18.700 ******* 2020-11-20T11:44:14.950 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-11-20T11:44:14.952 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:14.986 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:14 +0000 (0:00:00.041) 0:02:18.742 ******* 2020-11-20T11:44:15.024 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:15 +0000 (0:00:00.037) 0:02:18.780 ******* 2020-11-20T11:44:15.030 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T11:44:15.032 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:15.081 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:15 +0000 (0:00:00.057) 0:02:18.837 ******* 2020-11-20T11:44:15.116 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:15 +0000 (0:00:00.034) 0:02:18.872 ******* 2020-11-20T11:44:15.122 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-11-20T11:44:15.125 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:15.159 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:15 +0000 (0:00:00.042) 0:02:18.914 ******* 2020-11-20T11:44:15.198 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:15 +0000 (0:00:00.039) 0:02:18.954 ******* 2020-11-20T11:44:15.207 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T11:44:15.209 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:15.258 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:15 +0000 (0:00:00.060) 0:02:19.014 ******* 2020-11-20T11:44:15.296 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:15 +0000 (0:00:00.037) 0:02:19.052 ******* 2020-11-20T11:44:15.302 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-11-20T11:44:15.304 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:15.338 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:15 +0000 (0:00:00.041) 0:02:19.094 ******* 2020-11-20T11:44:15.371 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:15 +0000 (0:00:00.032) 0:02:19.126 ******* 2020-11-20T11:44:15.379 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-20T11:44:15.380 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove packages] ********************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:15.416 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:15 +0000 (0:00:00.045) 0:02:19.172 ******* 2020-11-20T11:44:15.447 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:15 +0000 (0:00:00.031) 0:02:19.203 ******* 2020-11-20T11:44:15.453 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-11-20T11:44:15.454 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T11:44:15.454 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:15.488 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:15 +0000 (0:00:00.040) 0:02:19.244 ******* 2020-11-20T11:44:15.520 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:15 +0000 (0:00:00.032) 0:02:19.276 ******* 2020-11-20T11:44:15.526 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-20T11:44:15.527 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:15.560 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:15 +0000 (0:00:00.040) 0:02:19.316 ******* 2020-11-20T11:44:15.592 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:15 +0000 (0:00:00.031) 0:02:19.348 ******* 2020-11-20T11:44:15.599 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:15.600 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:15.634 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:15 +0000 (0:00:00.041) 0:02:19.389 ******* 2020-11-20T11:44:15.668 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:15 +0000 (0:00:00.034) 0:02:19.424 ******* 2020-11-20T11:44:15.674 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T11:44:15.675 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:15.708 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:15 +0000 (0:00:00.040) 0:02:19.464 ******* 2020-11-20T11:44:15.741 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:15 +0000 (0:00:00.032) 0:02:19.497 ******* 2020-11-20T11:44:15.747 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-11-20T11:44:15.748 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:15.781 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:15 +0000 (0:00:00.040) 0:02:19.537 ******* 2020-11-20T11:44:15.816 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:15 +0000 (0:00:00.034) 0:02:19.572 ******* 2020-11-20T11:44:15.822 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T11:44:15.824 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:15.857 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:15 +0000 (0:00:00.041) 0:02:19.613 ******* 2020-11-20T11:44:15.889 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:15 +0000 (0:00:00.032) 0:02:19.645 ******* 2020-11-20T11:44:15.894 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-11-20T11:44:15.896 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:15.931 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:15 +0000 (0:00:00.041) 0:02:19.687 ******* 2020-11-20T11:44:15.963 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:15 +0000 (0:00:00.031) 0:02:19.718 ******* 2020-11-20T11:44:15.969 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:15.971 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:16.005 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:16 +0000 (0:00:00.042) 0:02:19.761 ******* 2020-11-20T11:44:16.037 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:16 +0000 (0:00:00.032) 0:02:19.793 ******* 2020-11-20T11:44:16.044 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T11:44:16.046 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:16.080 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:16 +0000 (0:00:00.042) 0:02:19.836 ******* 2020-11-20T11:44:16.111 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:16 +0000 (0:00:00.031) 0:02:19.867 ******* 2020-11-20T11:44:16.119 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-20T11:44:16.120 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:16.120 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:16.154 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:16 +0000 (0:00:00.042) 0:02:19.910 ******* 2020-11-20T11:44:16.185 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:16 +0000 (0:00:00.031) 0:02:19.941 ******* 2020-11-20T11:44:16.191 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-11-20T11:44:16.192 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:16.226 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:16 +0000 (0:00:00.040) 0:02:19.982 ******* 2020-11-20T11:44:16.257 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:16 +0000 (0:00:00.030) 0:02:20.013 ******* 2020-11-20T11:44:16.264 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-20T11:44:16.265 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:16.298 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:16 +0000 (0:00:00.041) 0:02:20.054 ******* 2020-11-20T11:44:16.331 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:16 +0000 (0:00:00.032) 0:02:20.086 ******* 2020-11-20T11:44:16.336 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T11:44:16.337 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:16.374 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:16 +0000 (0:00:00.043) 0:02:20.130 ******* 2020-11-20T11:44:16.406 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:16 +0000 (0:00:00.031) 0:02:20.162 ******* 2020-11-20T11:44:16.412 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-20T11:44:16.414 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:16.448 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:16 +0000 (0:00:00.041) 0:02:20.204 ******* 2020-11-20T11:44:16.479 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:16 +0000 (0:00:00.031) 0:02:20.235 ******* 2020-11-20T11:44:16.485 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-11-20T11:44:16.487 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:16.521 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:16 +0000 (0:00:00.041) 0:02:20.277 ******* 2020-11-20T11:44:16.552 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:16 +0000 (0:00:00.031) 0:02:20.308 ******* 2020-11-20T11:44:16.559 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T11:44:16.560 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set grub config.] ********************************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:16.594 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:16 +0000 (0:00:00.042) 0:02:20.350 ******* 2020-11-20T11:44:16.626 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:16 +0000 (0:00:00.031) 0:02:20.382 ******* 2020-11-20T11:44:16.632 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-11-20T11:44:16.634 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove /etc/ceph] ********************************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:16.668 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:16 +0000 (0:00:00.041) 0:02:20.424 ******* 2020-11-20T11:44:16.699 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:16 +0000 (0:00:00.031) 0:02:20.455 ******* 2020-11-20T11:44:16.705 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T11:44:16.707 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-11-20T11:44:16.711 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:16.740 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:16 +0000 (0:00:00.040) 0:02:20.495 ******* 2020-11-20T11:44:16.771 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:16 +0000 (0:00:00.031) 0:02:20.527 ******* 2020-11-20T11:44:16.777 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-11-20T11:44:16.778 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:16.813 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:16 +0000 (0:00:00.042) 0:02:20.569 ******* 2020-11-20T11:44:16.846 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:16 +0000 (0:00:00.032) 0:02:20.602 ******* 2020-11-20T11:44:16.852 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-20T11:44:16.853 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload weekly kernel-clean crontab.] ************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:16.888 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:16 +0000 (0:00:00.041) 0:02:20.644 ******* 2020-11-20T11:44:16.919 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:16 +0000 (0:00:00.031) 0:02:20.675 ******* 2020-11-20T11:44:16.924 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-11-20T11:44:16.926 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:16.960 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:16 +0000 (0:00:00.041) 0:02:20.716 ******* 2020-11-20T11:44:16.991 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:16 +0000 (0:00:00.031) 0:02:20.747 ******* 2020-11-20T11:44:16.998 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T11:44:16.999 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable kernel modules to load at boot time.] ****************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:17.033 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:17 +0000 (0:00:00.042) 0:02:20.789 ******* 2020-11-20T11:44:17.068 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:17 +0000 (0:00:00.034) 0:02:20.824 ******* 2020-11-20T11:44:17.074 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-11-20T11:44:17.075 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:17.109 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:17 +0000 (0:00:00.040) 0:02:20.865 ******* 2020-11-20T11:44:17.145 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:17 +0000 (0:00:00.035) 0:02:20.901 ******* 2020-11-20T11:44:17.151 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T11:44:17.153 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:17.186 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:17 +0000 (0:00:00.041) 0:02:20.942 ******* 2020-11-20T11:44:17.219 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:17 +0000 (0:00:00.032) 0:02:20.975 ******* 2020-11-20T11:44:17.225 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-11-20T11:44:17.226 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop collectl] ************************************************ skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:17.261 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:17 +0000 (0:00:00.041) 0:02:21.016 ******* 2020-11-20T11:44:17.293 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:17 +0000 (0:00:00.032) 0:02:21.049 ******* 2020-11-20T11:44:17.299 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-11-20T11:44:17.301 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:17.334 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:17 +0000 (0:00:00.041) 0:02:21.090 ******* 2020-11-20T11:44:17.366 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:17 +0000 (0:00:00.031) 0:02:21.122 ******* 2020-11-20T11:44:17.372 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-11-20T11:44:17.373 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:17.407 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:17 +0000 (0:00:00.040) 0:02:21.163 ******* 2020-11-20T11:44:17.438 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:17 +0000 (0:00:00.031) 0:02:21.194 ******* 2020-11-20T11:44:17.444 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-11-20T11:44:17.446 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:17.479 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:17 +0000 (0:00:00.040) 0:02:21.235 ******* 2020-11-20T11:44:17.511 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:17 +0000 (0:00:00.031) 0:02:21.267 ******* 2020-11-20T11:44:17.517 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-11-20T11:44:17.519 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-11-20T11:44:17.552 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:17 +0000 (0:00:00.040) 0:02:21.308 ******* 2020-11-20T11:44:17.584 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:17 +0000 (0:00:00.031) 0:02:21.340 ******* 2020-11-20T11:44:17.591 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-11-20T11:44:17.593 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi087.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:17.626 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:17 +0000 (0:00:00.042) 0:02:21.382 ******* 2020-11-20T11:44:17.633 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-11-20T11:44:17.635 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:17.635 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi087.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:17.635 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:17.636 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:17.670 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:17 +0000 (0:00:00.043) 0:02:21.426 ******* 2020-11-20T11:44:17.677 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:17.678 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-20T11:44:17.679 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:17.717 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:17 +0000 (0:00:00.047) 0:02:21.473 ******* 2020-11-20T11:44:17.748 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:17 +0000 (0:00:00.031) 0:02:21.504 ******* 2020-11-20T11:44:17.754 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-11-20T11:44:17.755 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:17.795 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:17 +0000 (0:00:00.047) 0:02:21.551 ******* 2020-11-20T11:44:17.802 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-11-20T11:44:17.804 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:17.841 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:17 +0000 (0:00:00.046) 0:02:21.597 ******* 2020-11-20T11:44:17.847 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-11-20T11:44:17.850 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:17.883 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:17 +0000 (0:00:00.041) 0:02:21.639 ******* 2020-11-20T11:44:17.889 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-11-20T11:44:17.891 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:17.927 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:17 +0000 (0:00:00.043) 0:02:21.683 ******* 2020-11-20T11:44:17.933 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-20T11:44:17.935 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi087.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003191", "end": "2020-11-20 11:44:17.891821", "rc": 0, "start": "2020-11-20 11:44:17.888630", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-11-20T11:44:17.973 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:17 +0000 (0:00:00.046) 0:02:21.729 ******* 2020-11-20T11:44:18.005 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:17 +0000 (0:00:00.031) 0:02:21.760 ******* 2020-11-20T11:44:18.010 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-11-20T11:44:18.012 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:18.087 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:18 +0000 (0:00:00.045) 0:02:21.806 ******* Friday 20 November 2020 11:44:18 +0000 (0:00:00.031) 0:02:21.838 ******* 2020-11-20T11:44:18.088 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:18.089 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:18.124 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:18 +0000 (0:00:00.042) 0:02:21.880 ******* 2020-11-20T11:44:18.156 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:18 +0000 (0:00:00.031) 0:02:21.912 ******* 2020-11-20T11:44:18.163 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-11-20T11:44:18.165 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:18.199 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:18 +0000 (0:00:00.041) 0:02:21.954 ******* 2020-11-20T11:44:18.229 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:18 +0000 (0:00:00.030) 0:02:21.985 ******* 2020-11-20T11:44:18.235 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-20T11:44:18.237 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make sure apt dependencies are installed] ********************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:18.272 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:18 +0000 (0:00:00.043) 0:02:22.028 ******* 2020-11-20T11:44:18.319 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:18 +0000 (0:00:00.047) 0:02:22.075 ******* 2020-11-20T11:44:18.327 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-11-20T11:44:18.329 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:18.363 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:18 +0000 (0:00:00.044) 0:02:22.119 ******* 2020-11-20T11:44:18.369 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-11-20T11:44:18.371 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:18.404 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:18 +0000 (0:00:00.040) 0:02:22.160 ******* 2020-11-20T11:44:18.411 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-11-20T11:44:18.413 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:18.445 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:18 +0000 (0:00:00.040) 0:02:22.201 ******* 2020-11-20T11:44:18.465 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:18.494 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:18 +0000 (0:00:00.048) 0:02:22.250 ******* 2020-11-20T11:44:18.500 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-11-20T11:44:18.502 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:18.536 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:18 +0000 (0:00:00.042) 0:02:22.292 ******* 2020-11-20T11:44:18.542 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:44:18.544 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:18.577 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:18 +0000 (0:00:00.040) 0:02:22.333 ******* 2020-11-20T11:44:18.584 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:18.618 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:18 +0000 (0:00:00.040) 0:02:22.374 ******* 2020-11-20T11:44:18.624 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-20T11:44:18.626 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:18.660 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:18 +0000 (0:00:00.041) 0:02:22.416 ******* 2020-11-20T11:44:18.666 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-11-20T11:44:18.667 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:18.702 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:18 +0000 (0:00:00.042) 0:02:22.458 ******* 2020-11-20T11:44:18.708 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T11:44:18.710 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:18.745 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:18 +0000 (0:00:00.043) 0:02:22.501 ******* 2020-11-20T11:44:18.752 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:44:18.754 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-11-20T11:44:18.787 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:18 +0000 (0:00:00.041) 0:02:22.543 ******* 2020-11-20T11:44:18.793 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T11:44:18.795 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:18.830 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:18 +0000 (0:00:00.043) 0:02:22.586 ******* 2020-11-20T11:44:18.837 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-11-20T11:44:18.838 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:18.839 INFO:teuthology.task.ansible.out: ok: [smithi192.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi192.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:18.851 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-20T11:44:18.853 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:18.900 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:18 +0000 (0:00:00.070) 0:02:22.656 ******* 2020-11-20T11:44:18.907 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-11-20T11:44:18.909 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:18.948 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:18 +0000 (0:00:00.047) 0:02:22.704 ******* 2020-11-20T11:44:18.954 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-20T11:44:18.956 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:18.995 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:18 +0000 (0:00:00.046) 0:02:22.751 ******* 2020-11-20T11:44:19.024 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T11:44:19.026 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:19.058 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:19 +0000 (0:00:00.062) 0:02:22.813 ******* 2020-11-20T11:44:19.085 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T11:44:19.086 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:19.119 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:19 +0000 (0:00:00.061) 0:02:22.875 ******* 2020-11-20T11:44:19.147 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-11-20T11:44:19.149 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.002928", "end": "2020-11-20 11:44:19.125060", "rc": 0, "start": "2020-11-20 11:44:19.122132", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:19.187 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:19 +0000 (0:00:00.067) 0:02:22.943 ******* 2020-11-20T11:44:19.222 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:19 +0000 (0:00:00.035) 0:02:22.978 ******* 2020-11-20T11:44:19.228 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-20T11:44:19.230 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:19.269 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:19 +0000 (0:00:00.046) 0:02:23.025 ******* 2020-11-20T11:44:19.275 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-11-20T11:44:19.276 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:19.315 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:19 +0000 (0:00:00.046) 0:02:23.071 ******* 2020-11-20T11:44:19.320 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-20T11:44:19.322 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:19.356 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:19 +0000 (0:00:00.041) 0:02:23.112 ******* 2020-11-20T11:44:19.362 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-11-20T11:44:19.364 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:19.399 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:19 +0000 (0:00:00.042) 0:02:23.155 ******* 2020-11-20T11:44:19.405 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-20T11:44:19.407 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:19.442 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:19 +0000 (0:00:00.042) 0:02:23.198 ******* 2020-11-20T11:44:19.448 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:19.483 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:19 +0000 (0:00:00.041) 0:02:23.239 ******* 2020-11-20T11:44:19.489 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T11:44:19.491 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:19.524 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:19 +0000 (0:00:00.040) 0:02:23.280 ******* 2020-11-20T11:44:19.531 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-11-20T11:44:19.534 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:19.567 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:19 +0000 (0:00:00.043) 0:02:23.323 ******* 2020-11-20T11:44:19.575 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T11:44:19.576 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:19.622 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:19 +0000 (0:00:00.054) 0:02:23.377 ******* 2020-11-20T11:44:19.662 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-20T11:44:19.664 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:19.707 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:19 +0000 (0:00:00.085) 0:02:23.463 ******* 2020-11-20T11:44:19.738 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T11:44:19.740 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:19.783 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:19 +0000 (0:00:00.075) 0:02:23.538 ******* 2020-11-20T11:44:19.812 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T11:44:19.813 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:19.851 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:19 +0000 (0:00:00.068) 0:02:23.607 ******* 2020-11-20T11:44:19.879 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:19.914 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:19 +0000 (0:00:00.063) 0:02:23.670 ******* 2020-11-20T11:44:19.941 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-11-20T11:44:19.943 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:19.981 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:19 +0000 (0:00:00.061) 0:02:23.732 ******* 2020-11-20T11:44:20.003 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-11-20T11:44:20.005 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:20.037 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:20 +0000 (0:00:00.060) 0:02:23.792 ******* 2020-11-20T11:44:20.064 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:20.097 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:20 +0000 (0:00:00.060) 0:02:23.853 ******* 2020-11-20T11:44:20.131 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:20.176 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:20 +0000 (0:00:00.077) 0:02:23.931 ******* 2020-11-20T11:44:20.206 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-11-20T11:44:20.208 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:20.242 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:20 +0000 (0:00:00.067) 0:02:23.998 ******* 2020-11-20T11:44:20.269 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-11-20T11:44:20.271 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:20.303 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:20 +0000 (0:00:00.060) 0:02:24.059 ******* 2020-11-20T11:44:20.330 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:20.364 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:20 +0000 (0:00:00.060) 0:02:24.120 ******* 2020-11-20T11:44:20.390 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-11-20T11:44:20.392 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:20.425 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:20 +0000 (0:00:00.060) 0:02:24.180 ******* 2020-11-20T11:44:20.452 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:20.486 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:20 +0000 (0:00:00.061) 0:02:24.242 ******* 2020-11-20T11:44:20.514 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:20.547 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:20 +0000 (0:00:00.061) 0:02:24.303 ******* 2020-11-20T11:44:20.576 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:20.608 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:20 +0000 (0:00:00.061) 0:02:24.364 ******* 2020-11-20T11:44:20.635 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-11-20T11:44:20.637 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:20.669 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:20 +0000 (0:00:00.060) 0:02:24.425 ******* 2020-11-20T11:44:20.697 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:44:20.699 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-11-20T11:44:20.742 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:20 +0000 (0:00:00.072) 0:02:24.497 ******* 2020-11-20T11:44:20.750 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-11-20T11:44:20.755 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-11-20T11:44:20.795 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:20 +0000 (0:00:00.053) 0:02:24.551 ******* 2020-11-20T11:44:20.804 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi146.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:20.806 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-11-20T11:44:20.818 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:20.819 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:20.829 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:20.841 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ ok: [smithi087.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930442608640, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227158840, 'block_used': 12936268, 'inode_total': 61054976, 'inode_available': 60986977, 'inode_used': 67999, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227158840, "block_size": 4096, "block_total": 240095108, "block_used": 12936268, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986977, "inode_total": 61054976, "inode_used": 67999, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930442608640, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}} 2020-11-20T11:44:20.842 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-11-20T11:44:20.843 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:20.876 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:20 +0000 (0:00:00.081) 0:02:24.632 ******* 2020-11-20T11:44:20.967 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:21.010 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:21 +0000 (0:00:00.133) 0:02:24.766 ******* 2020-11-20T11:44:21.059 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-11-20T11:44:21.061 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005031", "end": "2020-11-20 11:44:21.038795", "rc": 0, "start": "2020-11-20 11:44:21.033764", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:21.095 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:21 +0000 (0:00:00.085) 0:02:24.851 ******* 2020-11-20T11:44:21.097 INFO:teuthology.task.ansible.out: 2020-11-20T11:44:21.206 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-11-20T11:44:21.208 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003118", "end": "2020-11-20 11:44:21.187808", "rc": 0, "start": "2020-11-20 11:44:21.184690", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-11-20T11:44:21.244 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:21 +0000 (0:00:00.149) 0:02:25.000 ******* 2020-11-20T11:44:21.261 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-11-20T11:44:21.263 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930442608640, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227158840, 'block_used': 12936268, 'inode_total': 61054976, 'inode_available': 60986977, 'inode_used': 67999, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227158840, "block_size": 4096, "block_total": 240095108, "block_used": 12936268, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986977, "inode_total": 61054976, "inode_used": 67999, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930442608640, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:21.296 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:21 +0000 (0:00:00.051) 0:02:25.052 ******* 2020-11-20T11:44:21.302 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-11-20T11:44:21.304 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:21.342 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:21 +0000 (0:00:00.045) 0:02:25.097 ******* 2020-11-20T11:44:21.348 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-11-20T11:44:21.383 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:21 +0000 (0:00:00.041) 0:02:25.139 ******* 2020-11-20T11:44:21.389 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-11-20T11:44:21.391 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:21.425 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:21 +0000 (0:00:00.042) 0:02:25.181 ******* 2020-11-20T11:44:21.451 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-11-20T11:44:21.453 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:21.485 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:21 +0000 (0:00:00.060) 0:02:25.241 ******* 2020-11-20T11:44:21.512 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:21.546 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:21 +0000 (0:00:00.060) 0:02:25.302 ******* 2020-11-20T11:44:22.034 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-11-20T11:44:22.037 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-11-20T11:44:22.070 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:22 +0000 (0:00:00.523) 0:02:25.825 ******* 2020-11-20T11:44:22.107 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-20T11:44:22.109 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930420977664, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227153559, 'block_used': 12941549, 'inode_total': 61054976, 'inode_available': 60986954, 'inode_used': 68022, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227153559, "block_size": 4096, "block_total": 240095108, "block_used": 12941549, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986954, "inode_total": 61054976, "inode_used": 68022, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930420977664, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}} 2020-11-20T11:44:22.142 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:22 +0000 (0:00:00.072) 0:02:25.898 ******* 2020-11-20T11:44:22.321 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-11-20T11:44:22.323 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005038", "end": "2020-11-20 11:44:22.301002", "rc": 0, "start": "2020-11-20 11:44:22.295964", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:22.355 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:22 +0000 (0:00:00.213) 0:02:26.111 ******* 2020-11-20T11:44:22.406 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [smithi192.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930420977664, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227153559, 'block_used': 12941549, 'inode_total': 61054976, 'inode_available': 60986954, 'inode_used': 68022, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227153559, "block_size": 4096, "block_total": 240095108, "block_used": 12941549, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986954, "inode_total": 61054976, "inode_used": 68022, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930420977664, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:22.454 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:22 +0000 (0:00:00.098) 0:02:26.210 ******* 2020-11-20T11:44:22.482 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-11-20T11:44:22.518 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:22 +0000 (0:00:00.064) 0:02:26.274 ******* 2020-11-20T11:44:23.050 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T11:44:23.052 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-w2t1gY9NsTZ8aL2XSlxNvmDXjU10WkLmJRgBRyuJixDZjtqaG3eRjJHU2Z1yBw1E'], 'uuids': ['b03e7682-c470-489f-9f3b-a9214b5864aa'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.311258", "end": "2020-11-20 11:44:22.868089", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-w2t1gY9NsTZ8aL2XSlxNvmDXjU10WkLmJRgBRyuJixDZjtqaG3eRjJHU2Z1yBw1E"], "labels": [], "masters": [], "uuids": ["b03e7682-c470-489f-9f3b-a9214b5864aa"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:44:21.556831", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:44:24.142 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-5pYqUX1Lb5VvYEPuxDnYKjMX51Xbk6haHmC2Lqnu0cQjcIpciFo3B9AD3kUGZv7O'], 'uuids': ['23de8bd1-3dfc-4cb5-8415-c2fc791f8c24'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.283726", "end": "2020-11-20 11:44:24.109752", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-5pYqUX1Lb5VvYEPuxDnYKjMX51Xbk6haHmC2Lqnu0cQjcIpciFo3B9AD3kUGZv7O"], "labels": [], "masters": [], "uuids": ["23de8bd1-3dfc-4cb5-8415-c2fc791f8c24"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:44:22.826026", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:44:24.208 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-oFTX7m-Qy7a-JAqS-fJij-R7Wu-9N6C-ce6Yh1', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400NQ400BGN', 'nvme-nvme.8086-504846543632303430304e5134303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.084188", "end": "2020-11-20 11:44:24.173296", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-oFTX7m-Qy7a-JAqS-fJij-R7Wu-9N6C-ce6Yh1", "nvme-INTEL_SSDPEDMD400G4_PHFT620400NQ400BGN", "nvme-nvme.8086-504846543632303430304e5134303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:44:23.089108", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-11-20T11:44:24.210 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:44:24.274 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-11-20T11:44:24.275 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-11-20T11:44:24.312 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:24 +0000 (0:00:01.794) 0:02:28.068 ******* 2020-11-20T11:44:24.352 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-20T11:44:24.354 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930442604544, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227158839, 'block_used': 12936269, 'inode_total': 61054976, 'inode_available': 60986977, 'inode_used': 67999, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227158839, "block_size": 4096, "block_total": 240095108, "block_used": 12936269, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986977, "inode_total": 61054976, "inode_used": 67999, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930442604544, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}} 2020-11-20T11:44:24.390 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:24 +0000 (0:00:00.077) 0:02:28.146 ******* 2020-11-20T11:44:24.574 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-11-20T11:44:24.576 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.004999", "end": "2020-11-20 11:44:24.551338", "rc": 0, "start": "2020-11-20 11:44:24.546339", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:24.611 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:24 +0000 (0:00:00.221) 0:02:28.367 ******* 2020-11-20T11:44:24.649 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-11-20T11:44:24.651 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930442604544, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227158839, 'block_used': 12936269, 'inode_total': 61054976, 'inode_available': 60986977, 'inode_used': 67999, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227158839, "block_size": 4096, "block_total": 240095108, "block_used": 12936269, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986977, "inode_total": 61054976, "inode_used": 67999, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930442604544, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:24.686 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:24 +0000 (0:00:00.075) 0:02:28.442 ******* 2020-11-20T11:44:24.715 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-11-20T11:44:24.748 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:24 +0000 (0:00:00.061) 0:02:28.504 ******* 2020-11-20T11:44:25.419 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T11:44:25.421 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-vyg9sX-tC7R-YVQs-P4Q7-BEHs-gQ04-fpUXq5', 'nvme-INTEL_SSDPEDMD400G4_PHFT620500NN400BGN', 'nvme-nvme.8086-504846543632303530304e4e34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.087779", "end": "2020-11-20 11:44:25.387850", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-vyg9sX-tC7R-YVQs-P4Q7-BEHs-gQ04-fpUXq5", "nvme-INTEL_SSDPEDMD400G4_PHFT620500NN400BGN", "nvme-nvme.8086-504846543632303530304e4e34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:44:24.300071", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-11-20T11:44:25.422 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:44:25.454 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-w2t1gY9NsTZ8aL2XSlxNvmDXjU10WkLmdzv4WceL5QyskVDFBtvqXHgj4LY1ItBT'], 'uuids': ['2f431555-b44e-4a49-8005-e7e32f262cdb'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.061450", "end": "2020-11-20 11:44:25.427428", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-w2t1gY9NsTZ8aL2XSlxNvmDXjU10WkLmdzv4WceL5QyskVDFBtvqXHgj4LY1ItBT"], "labels": [], "masters": [], "uuids": ["2f431555-b44e-4a49-8005-e7e32f262cdb"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:44:24.365978", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:44:26.240 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-olGxgw3jdPinb3O0ChIiBo3M8bz0Hp84P0LcofDINMqeu6rqSRlOZ7ui0esYIIUw'], 'uuids': ['e6b72355-d223-4a66-b0eb-2c489c86d24b'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.274992", "end": "2020-11-20 11:44:26.202956", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-olGxgw3jdPinb3O0ChIiBo3M8bz0Hp84P0LcofDINMqeu6rqSRlOZ7ui0esYIIUw"], "labels": [], "masters": [], "uuids": ["e6b72355-d223-4a66-b0eb-2c489c86d24b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:44:24.927964", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:44:26.690 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-5pYqUX1Lb5VvYEPuxDnYKjMX51Xbk6haVMCtrA9EB8vbAHoFqpf6yo3Ad3zPJM7a'], 'uuids': ['c3d2ea10-68ec-4f25-b157-07d0e8820b6c'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.086200", "end": "2020-11-20 11:44:26.656568", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-5pYqUX1Lb5VvYEPuxDnYKjMX51Xbk6haVMCtrA9EB8vbAHoFqpf6yo3Ad3zPJM7a"], "labels": [], "masters": [], "uuids": ["c3d2ea10-68ec-4f25-b157-07d0e8820b6c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:44:25.570368", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:44:26.723 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-w2t1gY9NsTZ8aL2XSlxNvmDXjU10WkLmYafQAxH6HK2i3YOlAPaTIponkZUiK39K'], 'uuids': ['142e572b-5dff-4bc3-9ec9-24922dd25c82'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.090723", "end": "2020-11-20 11:44:26.688516", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-w2t1gY9NsTZ8aL2XSlxNvmDXjU10WkLmYafQAxH6HK2i3YOlAPaTIponkZUiK39K"], "labels": [], "masters": [], "uuids": ["142e572b-5dff-4bc3-9ec9-24922dd25c82"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:44:25.597793", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:44:27.479 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-Kl1uYo-Ys2w-GrJ9-tRiS-BMxQ-lS1m-0WMV5m', 'nvme-INTEL_SSDPEDMD400G4_CVFT623300GB400BGN', 'nvme-nvme.8086-43564654363233333030474234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.064090", "end": "2020-11-20 11:44:27.450932", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-Kl1uYo-Ys2w-GrJ9-tRiS-BMxQ-lS1m-0WMV5m", "nvme-INTEL_SSDPEDMD400G4_CVFT623300GB400BGN", "nvme-nvme.8086-43564654363233333030474234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:44:26.386842", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-11-20T11:44:27.481 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:44:27.931 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-5pYqUX1Lb5VvYEPuxDnYKjMX51Xbk6ha9sTFE7CtfdscrHECGSZl8XRxT0kh3xkR'], 'uuids': ['6aa5703d-3e58-4dd0-ba94-684261b4c293'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.062816", "end": "2020-11-20 11:44:27.901053", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-5pYqUX1Lb5VvYEPuxDnYKjMX51Xbk6ha9sTFE7CtfdscrHECGSZl8XRxT0kh3xkR"], "labels": [], "masters": [], "uuids": ["6aa5703d-3e58-4dd0-ba94-684261b4c293"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:44:26.838237", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:44:27.996 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-w2t1gY9NsTZ8aL2XSlxNvmDXjU10WkLmbr1sI0w5es3kXbQ8pdTEvaheW65mu7ru'], 'uuids': ['ba9bd961-a4f3-4a2d-832d-b19e9b8a5eb9'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.099932", "end": "2020-11-20 11:44:27.966937", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-w2t1gY9NsTZ8aL2XSlxNvmDXjU10WkLmbr1sI0w5es3kXbQ8pdTEvaheW65mu7ru"], "labels": [], "masters": [], "uuids": ["ba9bd961-a4f3-4a2d-832d-b19e9b8a5eb9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:44:26.867005", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:44:28.008 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5LGPP', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5LGPP', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5LGPP', 'scsi-35000c500918e7eca', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5LGPP', 'wwn-0x5000c500918e7eca'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5LGPP', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500918e7eca', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5LGPP-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5LGPP-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5LGPP-part1', 'scsi-35000c500918e7eca-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5LGPP-part1', 'wwn-0x5000c500918e7eca-part1'], 'uuids': ['782d0384-b480-44b3-9c95-fe95daf886ae'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LGPP", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5LGPP", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5LGPP", "scsi-35000c500918e7eca", "scsi-SATA_ST1000NM0033-9ZM_Z1W5LGPP", "wwn-0x5000c500918e7eca"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LGPP-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5LGPP-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2020-11-20T11:44:28.010 INFO:teuthology.task.ansible.out:Z1W5LGPP-part1", "scsi-35000c500918e7eca-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5LGPP-part1", "wwn-0x5000c500918e7eca-part1"], "labels": [], "masters": [], "uuids": ["782d0384-b480-44b3-9c95-fe95daf886ae"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5LGPP", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500918e7eca"}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:28.720 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-olGxgw3jdPinb3O0ChIiBo3M8bz0Hp84DBVOCSCx5MIcgpQqk9NRSWUgMYfGEdLN'], 'uuids': ['68cc246a-679f-418d-bfe9-c21b0f022275'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.051149", "end": "2020-11-20 11:44:28.686530", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-olGxgw3jdPinb3O0ChIiBo3M8bz0Hp84DBVOCSCx5MIcgpQqk9NRSWUgMYfGEdLN"], "labels": [], "masters": [], "uuids": ["68cc246a-679f-418d-bfe9-c21b0f022275"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:44:27.635381", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:44:29.166 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-5pYqUX1Lb5VvYEPuxDnYKjMX51Xbk6haTdUwQh3QZ9CvyhB47W2zPJEytRwXRdCr'], 'uuids': ['3fd8f367-2fc1-4adb-a45d-bc5430ae241c'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.059561", "end": "2020-11-20 11:44:29.135570", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-5pYqUX1Lb5VvYEPuxDnYKjMX51Xbk6haTdUwQh3QZ9CvyhB47W2zPJEytRwXRdCr"], "labels": [], "masters": [], "uuids": ["3fd8f367-2fc1-4adb-a45d-bc5430ae241c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:44:28.076009", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:44:29.178 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XLLK', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XLLK', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XLLK', 'scsi-35000c50092939e0b', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XLLK', 'wwn-0x5000c50092939e0b'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XLLK', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50092939e0b', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XLLK-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XLLK-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XLLK-part1', 'scsi-35000c50092939e0b-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XLLK-part1', 'wwn-0x5000c50092939e0b-part1'], 'uuids': ['782d0384-b480-44b3-9c95-fe95daf886ae'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XLLK", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XLLK", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XLLK", "scsi-35000c50092939e0b", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XLLK", "wwn-0x5000c50092939e0b"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XLLK-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XLLK-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2020-11-20T11:44:29.181 INFO:teuthology.task.ansible.out:Z1W5XLLK-part1", "scsi-35000c50092939e0b-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XLLK-part1", "wwn-0x5000c50092939e0b-part1"], "labels": [], "masters": [], "uuids": ["782d0384-b480-44b3-9c95-fe95daf886ae"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XLLK", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092939e0b"}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:29.263 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-w2t1gY9NsTZ8aL2XSlxNvmDXjU10WkLmsW7vYRBsfr80u1y101IvDXV7We31qdXh'], 'uuids': ['d4c7c6f0-5559-4141-9d84-53f205c2bc5e'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.085063", "end": "2020-11-20 11:44:29.236137", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-w2t1gY9NsTZ8aL2XSlxNvmDXjU10WkLmsW7vYRBsfr80u1y101IvDXV7We31qdXh"], "labels": [], "masters": [], "uuids": ["d4c7c6f0-5559-4141-9d84-53f205c2bc5e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:44:28.151074", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:44:29.304 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:29 +0000 (0:00:04.556) 0:02:33.060 ******* 2020-11-20T11:44:29.685 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T11:44:29.687 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-w2t1gY9NsTZ8aL2XSlxNvmDXjU10WkLmJRgBRyuJixDZjtqaG3eRjJHU2Z1yBw1E'], 'uuids': ['b03e7682-c470-489f-9f3b-a9214b5864aa'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.148996", "end": "2020-11-20 11:44:29.653261", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-w2t1gY9NsTZ8aL2XSlxNvmDXjU10WkLmJRgBRyuJixDZjtqaG3eRjJHU2Z1yBw1E"], "labels": [], "masters": [], "uuids": ["b03e7682-c470-489f-9f3b-a9214b5864aa"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:44:29.504265", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.146306 s, 788 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.146306 s, 788 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:29.899 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-oFTX7m-Qy7a-JAqS-fJij-R7Wu-9N6C-ce6Yh1', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400NQ400BGN', 'nvme-nvme.8086-504846543632303430304e5134303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037593", "end": "2020-11-20 11:44:29.872294", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-oFTX7m-Qy7a-JAqS-fJij-R7Wu-9N6C-ce6Yh1", "nvme-INTEL_SSDPEDMD400G4_PHFT620400NQ400BGN", "nvme-nvme.8086-504846543632303430304e5134303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:44:29.834701", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0349073 s, 3.3 GB/s", "std 2020-11-20T11:44:29.901 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0349073 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:29.986 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T11:44:29.989 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-olGxgw3jdPinb3O0ChIiBo3M8bz0Hp84qqEsQUwowuyWSeIaCj4l0Q0WOETw0Nfs'], 'uuids': ['c3d2c8ed-6e86-4394-961e-63442bc64d6c'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.063529", "end": "2020-11-20 11:44:29.945711", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-olGxgw3jdPinb3O0ChIiBo3M8bz0Hp84qqEsQUwowuyWSeIaCj4l0Q0WOETw0Nfs"], "labels": [], "masters": [], "uuids": ["c3d2c8ed-6e86-4394-961e-63442bc64d6c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:44:28.882182", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:44:30.219 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-w2t1gY9NsTZ8aL2XSlxNvmDXjU10WkLmdzv4WceL5QyskVDFBtvqXHgj4LY1ItBT'], 'uuids': ['2f431555-b44e-4a49-8005-e7e32f262cdb'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.142162", "end": "2020-11-20 11:44:30.190335", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-w2t1gY9NsTZ8aL2XSlxNvmDXjU10WkLmdzv4WceL5QyskVDFBtvqXHgj4LY1ItBT"], "labels": [], "masters": [], "uuids": ["2f431555-b44e-4a49-8005-e7e32f262cdb"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:44:30.048173", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.139698 s, 826 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.139698 s, 826 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:30.420 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T11:44:30.422 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-5pYqUX1Lb5VvYEPuxDnYKjMX51Xbk6haE6vnMvlKt2gO3HVAGmfrI8SDbveFyCdV'], 'uuids': ['5fdedd8b-8d0e-4e14-ae36-0774a63ae260'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.063592", "end": "2020-11-20 11:44:30.385752", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-5pYqUX1Lb5VvYEPuxDnYKjMX51Xbk6haE6vnMvlKt2gO3HVAGmfrI8SDbveFyCdV"], "labels": [], "masters": [], "uuids": ["5fdedd8b-8d0e-4e14-ae36-0774a63ae260"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:44:29.322160", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:44:30.462 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:30 +0000 (0:00:01.158) 0:02:34.218 ******* 2020-11-20T11:44:30.532 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T11:44:30.534 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-w2t1gY9NsTZ8aL2XSlxNvmDXjU10WkLmYafQAxH6HK2i3YOlAPaTIponkZUiK39K'], 'uuids': ['142e572b-5dff-4bc3-9ec9-24922dd25c82'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.141328", "end": "2020-11-20 11:44:30.501478", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-w2t1gY9NsTZ8aL2XSlxNvmDXjU10WkLmYafQAxH6HK2i3YOlAPaTIponkZUiK39K"], "labels": [], "masters": [], "uuids": ["142e572b-5dff-4bc3-9ec9-24922dd25c82"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:44:30.360150", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138814 s, 831 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138814 s, 831 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:30.819 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-5pYqUX1Lb5VvYEPuxDnYKjMX51Xbk6haHmC2Lqnu0cQjcIpciFo3B9AD3kUGZv7O'], 'uuids': ['23de8bd1-3dfc-4cb5-8415-c2fc791f8c24'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.138810", "end": "2020-11-20 11:44:30.787342", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-5pYqUX1Lb5VvYEPuxDnYKjMX51Xbk6haHmC2Lqnu0cQjcIpciFo3B9AD3kUGZv7O"], "labels": [], "masters": [], "uuids": ["23de8bd1-3dfc-4cb5-8415-c2fc791f8c24"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:44:30.648532", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136141 s, 847 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136141 s, 847 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:30.854 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-w2t1gY9NsTZ8aL2XSlxNvmDXjU10WkLmbr1sI0w5es3kXbQ8pdTEvaheW65mu7ru'], 'uuids': ['ba9bd961-a4f3-4a2d-832d-b19e9b8a5eb9'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.142673", "end": "2020-11-20 11:44:30.826394", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-w2t1gY9NsTZ8aL2XSlxNvmDXjU10WkLmbr1sI0w5es3kXbQ8pdTEvaheW65mu7ru"], "labels": [], "masters": [], "uuids": ["ba9bd961-a4f3-4a2d-832d-b19e9b8a5eb9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:44:30.683721", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.1402 s, 823 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.1402 s, 823 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:30.867 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5LGPP', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5LGPP', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5LGPP', 'scsi-35000c500918e7eca', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5LGPP', 'wwn-0x5000c500918e7eca'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5LGPP', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500918e7eca', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5LGPP-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5LGPP-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5LGPP-part1', 'scsi-35000c500918e7eca-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5LGPP-part1', 'wwn-0x5000c500918e7eca-part1'], 'uuids': ['782d0384-b480-44b3-9c95-fe95daf886ae'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LGPP", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5LGPP", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5LGPP", "scsi-35000c500918e7eca", "scsi-SATA_ST1000NM0033-9ZM_Z1W5LGPP", "wwn-0x5000c500918e7eca"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LGPP-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5LGPP-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2020-11-20T11:44:30.869 INFO:teuthology.task.ansible.out:Z1W5LGPP-part1", "scsi-35000c500918e7eca-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5LGPP-part1", "wwn-0x5000c500918e7eca-part1"], "labels": [], "masters": [], "uuids": ["782d0384-b480-44b3-9c95-fe95daf886ae"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5LGPP", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500918e7eca"}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:31.090 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-vyg9sX-tC7R-YVQs-P4Q7-BEHs-gQ04-fpUXq5', 'nvme-INTEL_SSDPEDMD400G4_PHFT620500NN400BGN', 'nvme-nvme.8086-504846543632303530304e4e34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037573", "end": "2020-11-20 11:44:31.065758", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-vyg9sX-tC7R-YVQs-P4Q7-BEHs-gQ04-fpUXq5", "nvme-INTEL_SSDPEDMD400G4_PHFT620500NN400BGN", "nvme-nvme.8086-504846543632303530304e4e34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:44:31.028185", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0349568 s, 3.3 GB/s", "std 2020-11-20T11:44:31.092 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0349568 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:31.234 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-w2t1gY9NsTZ8aL2XSlxNvmDXjU10WkLmsW7vYRBsfr80u1y101IvDXV7We31qdXh'], 'uuids': ['d4c7c6f0-5559-4141-9d84-53f205c2bc5e'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.141847", "end": "2020-11-20 11:44:31.196316", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-w2t1gY9NsTZ8aL2XSlxNvmDXjU10WkLmsW7vYRBsfr80u1y101IvDXV7We31qdXh"], "labels": [], "masters": [], "uuids": ["d4c7c6f0-5559-4141-9d84-53f205c2bc5e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:44:31.054469", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.139274 s, 828 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.139274 s, 828 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:31.235 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T11:44:31.237 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-olGxgw3jdPinb3O0ChIiBo3M8bz0Hp84OgsmGzAjSUL0I8X2VbJtOgt4fmQaD01G'], 'uuids': ['a535660a-8cc2-485f-9412-748da375e467'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.057765", "end": "2020-11-20 11:44:31.195591", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-olGxgw3jdPinb3O0ChIiBo3M8bz0Hp84OgsmGzAjSUL0I8X2VbJtOgt4fmQaD01G"], "labels": [], "masters": [], "uuids": ["a535660a-8cc2-485f-9412-748da375e467"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:44:30.137826", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:44:31.241 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T11:44:31.248 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T11:44:31.250 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFPH', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XFPH', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XFPH', 'scsi-35000c50092925063', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XFPH', 'wwn-0x5000c50092925063'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XFPH', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50092925063', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFPH-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XFPH-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XFPH-part1', 'scsi-35000c50092925063-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XFPH-part1', 'wwn-0x5000c50092925063-part1'], 'uuids': ['782d0384-b480-44b3-9c95-fe95daf886ae'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFPH", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XFPH", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XFPH", "scsi-35000c50092925063", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XFPH", "wwn-0x5000c50092925063"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFPH-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XFPH-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2020-11-20T11:44:31.252 INFO:teuthology.task.ansible.out:Z1W5XFPH-part1", "scsi-35000c50092925063-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XFPH-part1", "wwn-0x5000c50092925063-part1"], "labels": [], "masters": [], "uuids": ["782d0384-b480-44b3-9c95-fe95daf886ae"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFPH", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092925063"}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:31.290 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:31 +0000 (0:00:00.827) 0:02:35.046 ******* 2020-11-20T11:44:31.413 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T11:44:31.414 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-5pYqUX1Lb5VvYEPuxDnYKjMX51Xbk6haVMCtrA9EB8vbAHoFqpf6yo3Ad3zPJM7a'], 'uuids': ['c3d2ea10-68ec-4f25-b157-07d0e8820b6c'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.139786", "end": "2020-11-20 11:44:31.380982", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-5pYqUX1Lb5VvYEPuxDnYKjMX51Xbk6haVMCtrA9EB8vbAHoFqpf6yo3Ad3zPJM7a"], "labels": [], "masters": [], "uuids": ["c3d2ea10-68ec-4f25-b157-07d0e8820b6c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:44:31.241196", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137146 s, 841 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137146 s, 841 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:31.540 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-11-20T11:44:31.541 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.058991", "end": "2020-11-20 11:44:31.508887", "rc": 0, "start": "2020-11-20 11:44:31.449896", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:31.573 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:31 +0000 (0:00:00.283) 0:02:35.329 ******* 2020-11-20T11:44:31.716 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T11:44:31.717 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-5pYqUX1Lb5VvYEPuxDnYKjMX51Xbk6ha9sTFE7CtfdscrHECGSZl8XRxT0kh3xkR'], 'uuids': ['6aa5703d-3e58-4dd0-ba94-684261b4c293'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.139902", "end": "2020-11-20 11:44:31.691955", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-5pYqUX1Lb5VvYEPuxDnYKjMX51Xbk6ha9sTFE7CtfdscrHECGSZl8XRxT0kh3xkR"], "labels": [], "masters": [], "uuids": ["6aa5703d-3e58-4dd0-ba94-684261b4c293"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:44:31.552053", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137304 s, 840 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137304 s, 840 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:31.791 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-11-20T11:44:31.793 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.041766", "end": "2020-11-20 11:44:31.769498", "rc": 0, "start": "2020-11-20 11:44:31.727732", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:31.827 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:31 +0000 (0:00:00.253) 0:02:35.582 ******* 2020-11-20T11:44:31.853 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-11-20T11:44:31.890 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:31 +0000 (0:00:00.063) 0:02:35.646 ******* 2020-11-20T11:44:31.917 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:31.955 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:31 +0000 (0:00:00.064) 0:02:35.711 ******* 2020-11-20T11:44:31.992 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:32.029 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:32 +0000 (0:00:00.073) 0:02:35.785 ******* 2020-11-20T11:44:32.030 INFO:teuthology.task.ansible.out: 2020-11-20T11:44:32.036 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T11:44:32.036 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-5pYqUX1Lb5VvYEPuxDnYKjMX51Xbk6haTdUwQh3QZ9CvyhB47W2zPJEytRwXRdCr'], 'uuids': ['3fd8f367-2fc1-4adb-a45d-bc5430ae241c'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.143232", "end": "2020-11-20 11:44:32.000220", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-5pYqUX1Lb5VvYEPuxDnYKjMX51Xbk6haTdUwQh3QZ9CvyhB47W2zPJEytRwXRdCr"], "labels": [], "masters": [], "uuids": ["3fd8f367-2fc1-4adb-a45d-bc5430ae241c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:44:31.856988", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.140604 s, 820 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.140604 s, 820 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:32.038 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XLLK', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XLLK', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XLLK', 'scsi-35000c50092939e0b', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XLLK', 'wwn-0x5000c50092939e0b'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XLLK', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50092939e0b', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XLLK-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XLLK-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XLLK-part1', 'scsi-35000c50092939e0b-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XLLK-part1', 'wwn-0x5000c50092939e0b-part1'], 'uuids': ['782d0384-b480-44b3-9c95-fe95daf886ae'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XLLK", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XLLK", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XLLK", "scsi-35000c50092939e0b", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XLLK", "wwn-0x5000c50092939e0b"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XLLK-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XLLK-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2020-11-20T11:44:32.040 INFO:teuthology.task.ansible.out:Z1W5XLLK-part1", "scsi-35000c50092939e0b-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XLLK-part1", "wwn-0x5000c50092939e0b-part1"], "labels": [], "masters": [], "uuids": ["782d0384-b480-44b3-9c95-fe95daf886ae"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XLLK", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092939e0b"}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:32.050 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-20T11:44:32.051 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:32.086 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:32 +0000 (0:00:00.057) 0:02:35.842 ******* 2020-11-20T11:44:32.113 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-11-20T11:44:32.114 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:32.147 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:32 +0000 (0:00:00.060) 0:02:35.903 ******* 2020-11-20T11:44:32.322 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-11-20T11:44:32.324 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:44:32.357 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:32 +0000 (0:00:00.210) 0:02:36.113 ******* 2020-11-20T11:44:32.364 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T11:44:32.364 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-5pYqUX1Lb5VvYEPuxDnYKjMX51Xbk6haE6vnMvlKt2gO3HVAGmfrI8SDbveFyCdV'], 'uuids': ['5fdedd8b-8d0e-4e14-ae36-0774a63ae260'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.139542", "end": "2020-11-20 11:44:32.313410", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-5pYqUX1Lb5VvYEPuxDnYKjMX51Xbk6haE6vnMvlKt2gO3HVAGmfrI8SDbveFyCdV"], "labels": [], "masters": [], "uuids": ["5fdedd8b-8d0e-4e14-ae36-0774a63ae260"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:44:32.173868", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136931 s, 842 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136931 s, 842 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:32.407 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:32 +0000 (0:00:00.050) 0:02:36.163 ******* 2020-11-20T11:44:32.413 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-20T11:44:32.415 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930442608640, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227158840, 'block_used': 12936268, 'inode_total': 61054976, 'inode_available': 60986977, 'inode_used': 67999, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227158840, "block_size": 4096, "block_total": 240095108, "block_used": 12936268, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986977, "inode_total": 61054976, "inode_used": 67999, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930442608640, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:32.451 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:32 +0000 (0:00:00.043) 0:02:36.207 ******* 2020-11-20T11:44:32.478 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-11-20T11:44:32.480 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:32.512 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:32 +0000 (0:00:00.061) 0:02:36.268 ******* 2020-11-20T11:44:32.519 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T11:44:32.521 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-olGxgw3jdPinb3O0ChIiBo3M8bz0Hp84lXY0lMYz9RW42IAOGBB3WV3LlH4onomn'], 'uuids': ['7ee77e26-bbe5-441b-aed1-edbd6796275c'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.072691", "end": "2020-11-20 11:44:32.461432", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-olGxgw3jdPinb3O0ChIiBo3M8bz0Hp84lXY0lMYz9RW42IAOGBB3WV3LlH4onomn"], "labels": [], "masters": [], "uuids": ["7ee77e26-bbe5-441b-aed1-edbd6796275c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:44:31.388741", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:44:32.561 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:32 +0000 (0:00:00.048) 0:02:36.317 ******* 2020-11-20T11:44:32.567 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:44:32.569 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:32.604 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:32 +0000 (0:00:00.042) 0:02:36.359 ******* 2020-11-20T11:44:32.777 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 11:44:32 +0000 (0:00:00.061) 0:02:36.421 ******* TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi192.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.060902", "end": "2020-11-20 11:44:32.621653", "rc": 0, "start": "2020-11-20 11:44:32.560751", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} Friday 20 November 2020 11:44:32 +0000 (0:00:00.042) 0:02:36.463 ******* TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 11:44:32 +0000 (0:00:00.042) 0:02:36.506 ******* TASK [testnode : Determine desired logical volume percentage size] ************* 2020-11-20T11:44:32.778 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:32.811 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:32 +0000 (0:00:00.061) 0:02:36.567 ******* 2020-11-20T11:44:32.838 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:32.872 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:32 +0000 (0:00:00.060) 0:02:36.628 ******* 2020-11-20T11:44:32.941 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T11:44:32.942 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-olGxgw3jdPinb3O0ChIiBo3M8bz0Hp84P0LcofDINMqeu6rqSRlOZ7ui0esYIIUw'], 'uuids': ['e6b72355-d223-4a66-b0eb-2c489c86d24b'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.141279", "end": "2020-11-20 11:44:32.913409", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-olGxgw3jdPinb3O0ChIiBo3M8bz0Hp84P0LcofDINMqeu6rqSRlOZ7ui0esYIIUw"], "labels": [], "masters": [], "uuids": ["e6b72355-d223-4a66-b0eb-2c489c86d24b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:44:32.772130", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138555 s, 832 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138555 s, 832 MB/s"], "stdout": "", "stdout_lines": []} TASK [testnode : Check for physical volumes] *********************************** changed: [smithi192.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.056615", "end": "2020-11-20 11:44:32.918387", "rc": 0, "start": "2020-11-20 11:44:32.861772", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:32.981 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:32 +0000 (0:00:00.109) 0:02:36.737 ******* 2020-11-20T11:44:33.009 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-11-20T11:44:33.046 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:33 +0000 (0:00:00.064) 0:02:36.801 ******* 2020-11-20T11:44:33.075 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:33.113 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:33 +0000 (0:00:00.067) 0:02:36.869 ******* 2020-11-20T11:44:33.140 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-11-20T11:44:33.142 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:33.176 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:33 +0000 (0:00:00.063) 0:02:36.932 ******* 2020-11-20T11:44:33.182 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T11:44:33.184 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-Kl1uYo-Ys2w-GrJ9-tRiS-BMxQ-lS1m-0WMV5m', 'nvme-INTEL_SSDPEDMD400G4_CVFT623300GB400BGN', 'nvme-nvme.8086-43564654363233333030474234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037585", "end": "2020-11-20 11:44:33.134033", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-Kl1uYo-Ys2w-GrJ9-tRiS-BMxQ-lS1m-0WMV5m", "nvme-INTEL_SSDPEDMD400G4_CVFT623300GB400BGN", "nvme-nvme.8086-43564654363233333030474234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:44:33.096448", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0349826 s, 3.3 GB/s", "std 2020-11-20T11:44:33.186 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0349826 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:33.195 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-20T11:44:33.197 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:33.233 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:33 +0000 (0:00:00.055) 0:02:36.988 ******* 2020-11-20T11:44:33.259 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-11-20T11:44:33.261 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:33.294 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:33 +0000 (0:00:00.061) 0:02:37.050 ******* 2020-11-20T11:44:33.482 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-11-20T11:44:33.517 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:33 +0000 (0:00:00.223) 0:02:37.273 ******* 2020-11-20T11:44:33.525 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-11-20T11:44:33.527 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:44:33.527 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T11:44:33.528 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-olGxgw3jdPinb3O0ChIiBo3M8bz0Hp84DBVOCSCx5MIcgpQqk9NRSWUgMYfGEdLN'], 'uuids': ['68cc246a-679f-418d-bfe9-c21b0f022275'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.139602", "end": "2020-11-20 11:44:33.473186", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-olGxgw3jdPinb3O0ChIiBo3M8bz0Hp84DBVOCSCx5MIcgpQqk9NRSWUgMYfGEdLN"], "labels": [], "masters": [], "uuids": ["68cc246a-679f-418d-bfe9-c21b0f022275"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:44:33.333584", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.13712 s, 841 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.13712 s, 841 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:33.566 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:33 +0000 (0:00:00.048) 0:02:37.322 ******* 2020-11-20T11:44:33.606 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ skipping: [smithi192.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930420977664, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227153559, 'block_used': 12941549, 'inode_total': 61054976, 'inode_available': 60986954, 'inode_used': 68022, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227153559, "block_size": 4096, "block_total": 240095108, "block_used": 12941549, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986954, "inode_total": 61054976, "inode_used": 68022, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930420977664, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:33.645 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:33 +0000 (0:00:00.078) 0:02:37.401 ******* 2020-11-20T11:44:33.682 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-11-20T11:44:33.684 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:33.717 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:33 +0000 (0:00:00.071) 0:02:37.473 ******* 2020-11-20T11:44:33.744 INFO:teuthology.task.ansible.out: 2020-11-20T11:44:33.746 INFO:teuthology.task.ansible.out:TASK [testnode : set_fact] ***************************************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:33.778 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:33 +0000 (0:00:00.061) 0:02:37.534 ******* 2020-11-20T11:44:33.807 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:33.842 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:33 +0000 (0:00:00.063) 0:02:37.598 ******* 2020-11-20T11:44:33.859 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T11:44:33.861 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-olGxgw3jdPinb3O0ChIiBo3M8bz0Hp84qqEsQUwowuyWSeIaCj4l0Q0WOETw0Nfs'], 'uuids': ['c3d2c8ed-6e86-4394-961e-63442bc64d6c'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.149625", "end": "2020-11-20 11:44:33.819773", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-olGxgw3jdPinb3O0ChIiBo3M8bz0Hp84qqEsQUwowuyWSeIaCj4l0Q0WOETw0Nfs"], "labels": [], "masters": [], "uuids": ["c3d2c8ed-6e86-4394-961e-63442bc64d6c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:44:33.670148", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.146993 s, 785 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.146993 s, 785 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:33.875 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:33.908 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:33 +0000 (0:00:00.064) 0:02:37.663 ******* 2020-11-20T11:44:33.945 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-11-20T11:44:33.947 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:33.986 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:33 +0000 (0:00:00.078) 0:02:37.741 ******* 2020-11-20T11:44:34.013 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-11-20T11:44:34.014 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:34.055 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:34 +0000 (0:00:00.069) 0:02:37.811 ******* 2020-11-20T11:44:34.062 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T11:44:34.064 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:44:34.175 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-olGxgw3jdPinb3O0ChIiBo3M8bz0Hp84OgsmGzAjSUL0I8X2VbJtOgt4fmQaD01G'], 'uuids': ['a535660a-8cc2-485f-9412-748da375e467'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.141199", "end": "2020-11-20 11:44:34.147595", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-olGxgw3jdPinb3O0ChIiBo3M8bz0Hp84OgsmGzAjSUL0I8X2VbJtOgt4fmQaD01G"], "labels": [], "masters": [], "uuids": ["a535660a-8cc2-485f-9412-748da375e467"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:44:34.006396", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138609 s, 832 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138609 s, 832 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:34.188 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFPH', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XFPH', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XFPH', 'scsi-35000c50092925063', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XFPH', 'wwn-0x5000c50092925063'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XFPH', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50092925063', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFPH-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XFPH-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XFPH-part1', 'scsi-35000c50092925063-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XFPH-part1', 'wwn-0x5000c50092925063-part1'], 'uuids': ['782d0384-b480-44b3-9c95-fe95daf886ae'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFPH", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XFPH", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XFPH", "scsi-35000c50092925063", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XFPH", "wwn-0x5000c50092925063"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFPH-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XFPH-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2020-11-20T11:44:34.190 INFO:teuthology.task.ansible.out:Z1W5XFPH-part1", "scsi-35000c50092925063-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XFPH-part1", "wwn-0x5000c50092925063-part1"], "labels": [], "masters": [], "uuids": ["782d0384-b480-44b3-9c95-fe95daf886ae"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFPH", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092925063"}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:34.329 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T11:44:34.331 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:44:34.497 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T11:44:34.499 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-olGxgw3jdPinb3O0ChIiBo3M8bz0Hp84lXY0lMYz9RW42IAOGBB3WV3LlH4onomn'], 'uuids': ['7ee77e26-bbe5-441b-aed1-edbd6796275c'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.140231", "end": "2020-11-20 11:44:34.470840", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-olGxgw3jdPinb3O0ChIiBo3M8bz0Hp84lXY0lMYz9RW42IAOGBB3WV3LlH4onomn"], "labels": [], "masters": [], "uuids": ["7ee77e26-bbe5-441b-aed1-edbd6796275c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:44:34.330609", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137655 s, 838 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137655 s, 838 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:34.549 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:34 +0000 (0:00:00.493) 0:02:38.305 ******* 2020-11-20T11:44:34.556 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-11-20T11:44:34.594 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:34 +0000 (0:00:00.044) 0:02:38.349 ******* 2020-11-20T11:44:34.632 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:44:34.792 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-11-20T11:44:34.794 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.048010", "end": "2020-11-20 11:44:34.760463", "rc": 0, "start": "2020-11-20 11:44:34.712453", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:34.827 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:34 +0000 (0:00:00.233) 0:02:38.583 ******* 2020-11-20T11:44:34.962 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T11:44:34.964 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:44:34.995 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:44:35.060 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.041016", "end": "2020-11-20 11:44:35.029331", "rc": 0, "start": "2020-11-20 11:44:34.988315", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:35.097 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:35 +0000 (0:00:00.269) 0:02:38.853 ******* 2020-11-20T11:44:35.124 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-11-20T11:44:35.162 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:35 +0000 (0:00:00.065) 0:02:38.918 ******* 2020-11-20T11:44:35.190 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-11-20T11:44:35.192 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:35.228 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:35 +0000 (0:00:00.065) 0:02:38.984 ******* 2020-11-20T11:44:35.260 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-11-20T11:44:35.262 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:35.296 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:35 +0000 (0:00:00.067) 0:02:39.052 ******* 2020-11-20T11:44:35.303 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T11:44:35.304 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:44:35.342 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:35 +0000 (0:00:00.046) 0:02:39.098 ******* 2020-11-20T11:44:35.349 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-20T11:44:35.350 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:44:35.387 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:35 +0000 (0:00:00.044) 0:02:39.143 ******* 2020-11-20T11:44:35.415 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:35.449 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:35 +0000 (0:00:00.061) 0:02:39.204 ******* 2020-11-20T11:44:35.524 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-20T11:44:35.526 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-11-20T11:44:35.559 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:35 +0000 (0:00:00.110) 0:02:39.314 ******* 2020-11-20T11:44:35.628 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-11-20T11:44:35.630 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:44:35.664 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:35 +0000 (0:00:00.105) 0:02:39.420 ******* 2020-11-20T11:44:35.670 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T11:44:35.672 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:44:35.714 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-20T11:44:35.716 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930442604544, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227158839, 'block_used': 12936269, 'inode_total': 61054976, 'inode_available': 60986977, 'inode_used': 67999, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227158839, "block_size": 4096, "block_total": 240095108, "block_used": 12936269, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986977, "inode_total": 61054976, "inode_used": 67999, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930442604544, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:35.749 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:35 +0000 (0:00:00.084) 0:02:39.505 ******* 2020-11-20T11:44:35.767 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:44:35.778 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-11-20T11:44:35.780 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:35.817 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:35 +0000 (0:00:00.068) 0:02:39.573 ******* 2020-11-20T11:44:35.845 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:44:35.846 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:35.880 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:35 +0000 (0:00:00.062) 0:02:39.636 ******* 2020-11-20T11:44:35.919 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:44:35.920 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:35.953 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:35 +0000 (0:00:00.072) 0:02:39.708 ******* 2020-11-20T11:44:35.959 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T11:44:35.961 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:44:35.982 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-11-20T11:44:35.984 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:44:36.026 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:36 +0000 (0:00:00.073) 0:02:39.782 ******* 2020-11-20T11:44:36.056 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-11-20T11:44:36.057 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:36.091 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:36 +0000 (0:00:00.064) 0:02:39.846 ******* 2020-11-20T11:44:36.098 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T11:44:36.100 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:44:36.121 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-11-20T11:44:36.122 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:36.159 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:36 +0000 (0:00:00.067) 0:02:39.914 ******* 2020-11-20T11:44:36.261 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T11:44:36.263 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:44:36.273 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:36.331 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:36 +0000 (0:00:00.172) 0:02:40.087 ******* 2020-11-20T11:44:36.341 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T11:44:36.343 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:44:36.385 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:36 +0000 (0:00:00.053) 0:02:40.141 ******* 2020-11-20T11:44:36.530 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-11-20T11:44:36.534 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:44:36.565 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:36 +0000 (0:00:00.180) 0:02:40.321 ******* 2020-11-20T11:44:36.583 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-20T11:44:36.584 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-11-20T11:44:36.619 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:36 +0000 (0:00:00.053) 0:02:40.375 ******* 2020-11-20T11:44:36.628 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-11-20T11:44:36.629 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create volume group(s)] *************************************** 2020-11-20T11:44:36.630 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-11-20T11:44:36.671 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:36 +0000 (0:00:00.052) 0:02:40.427 ******* 2020-11-20T11:44:36.707 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:36 +0000 (0:00:00.031) 0:02:40.458 ******* 2020-11-20T11:44:36.819 INFO:teuthology.task.ansible.out: 2020-11-20T11:44:36.821 INFO:teuthology.task.ansible.out:TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:44:36.821 INFO:teuthology.task.ansible.out: 2020-11-20T11:44:36.994 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:44:37.079 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-11-20T11:44:37.081 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true} TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:44:37.134 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:37 +0000 (0:00:00.430) 0:02:40.889 ******* 2020-11-20T11:44:37.163 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T11:44:37.165 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:44:37.325 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:44:37.347 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:37.384 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:37 +0000 (0:00:00.250) 0:02:41.140 ******* 2020-11-20T11:44:37.412 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T11:44:37.415 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:44:37.562 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-11-20T11:44:37.620 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:37 +0000 (0:00:00.236) 0:02:41.376 ******* 2020-11-20T11:44:37.630 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-11-20T11:44:37.632 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:44:37.667 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:37 +0000 (0:00:00.046) 0:02:41.422 ******* 2020-11-20T11:44:37.672 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:37.709 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:37 +0000 (0:00:00.042) 0:02:41.465 ******* 2020-11-20T11:44:37.715 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-11-20T11:44:37.717 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:37.751 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:37 +0000 (0:00:00.042) 0:02:41.507 ******* 2020-11-20T11:44:37.759 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:44:37.761 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:37.802 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:37 +0000 (0:00:00.050) 0:02:41.558 ******* 2020-11-20T11:44:37.829 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-11-20T11:44:37.831 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:37.871 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:37 +0000 (0:00:00.069) 0:02:41.627 ******* 2020-11-20T11:44:37.900 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-11-20T11:44:37.902 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:37.935 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:37 +0000 (0:00:00.063) 0:02:41.691 ******* 2020-11-20T11:44:37.966 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:38.013 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:38 +0000 (0:00:00.077) 0:02:41.769 ******* 2020-11-20T11:44:38.031 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-11-20T11:44:38.033 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"changed": true} 2020-11-20T11:44:38.072 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:38 +0000 (0:00:00.059) 0:02:41.828 ******* 2020-11-20T11:44:38.080 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-11-20T11:44:38.082 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:44:38.126 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:38 +0000 (0:00:00.052) 0:02:41.881 ******* 2020-11-20T11:44:38.165 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-11-20T11:44:38.167 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:38.221 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:38 +0000 (0:00:00.095) 0:02:41.976 ******* 2020-11-20T11:44:38.251 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-11-20T11:44:38.253 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:38.303 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:38 +0000 (0:00:00.082) 0:02:42.059 ******* 2020-11-20T11:44:38.342 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:38.385 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:38 +0000 (0:00:00.082) 0:02:42.141 ******* 2020-11-20T11:44:38.395 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T11:44:38.397 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:44:38.410 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi192.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-11-20T11:44:38.412 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:38.447 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:38 +0000 (0:00:00.062) 0:02:42.203 ******* 2020-11-20T11:44:38.490 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:38 +0000 (0:00:00.043) 0:02:42.246 ******* 2020-11-20T11:44:38.547 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:38 +0000 (0:00:00.056) 0:02:42.303 ******* 2020-11-20T11:44:38.557 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-11-20T11:44:38.559 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:38.594 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:38 +0000 (0:00:00.046) 0:02:42.350 ******* 2020-11-20T11:44:38.601 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-11-20T11:44:38.603 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:38.637 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:38 +0000 (0:00:00.042) 0:02:42.393 ******* 2020-11-20T11:44:38.664 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-11-20T11:44:38.666 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:38.718 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:38 +0000 (0:00:00.080) 0:02:42.474 ******* 2020-11-20T11:44:38.729 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-11-20T11:44:38.767 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:38 +0000 (0:00:00.048) 0:02:42.523 ******* 2020-11-20T11:44:38.774 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:38.818 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:38 +0000 (0:00:00.050) 0:02:42.574 ******* 2020-11-20T11:44:38.851 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:38.914 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:38 +0000 (0:00:00.095) 0:02:42.670 ******* 2020-11-20T11:44:38.945 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.000 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:38 +0000 (0:00:00.085) 0:02:42.755 ******* 2020-11-20T11:44:39.019 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T11:44:39.024 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:44:39.033 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.066 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:39 +0000 (0:00:00.066) 0:02:42.822 ******* 2020-11-20T11:44:39.094 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-11-20T11:44:39.096 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.148 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:39 +0000 (0:00:00.081) 0:02:42.903 ******* 2020-11-20T11:44:39.187 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:39 +0000 (0:00:00.038) 0:02:42.942 ******* 2020-11-20T11:44:39.195 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T11:44:39.197 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:44:39.213 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-11-20T11:44:39.215 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.273 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:39 +0000 (0:00:00.084) 0:02:43.027 ******* 2020-11-20T11:44:39.315 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-11-20T11:44:39.316 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.358 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:39 +0000 (0:00:00.086) 0:02:43.114 ******* 2020-11-20T11:44:39.364 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T11:44:39.375 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:44:39.388 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.425 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:39 +0000 (0:00:00.066) 0:02:43.180 ******* 2020-11-20T11:44:39.462 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-11-20T11:44:39.465 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make sure ntpd is running.] *********************************** 2020-11-20T11:44:39.467 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 11:40:56 UTC", "ActiveEnterTimestampMonotonic": "15121295", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount basic.target sntp.service ntpdate.service sysinit.target systemd-journald.socket system.slice tmp.mount systemd-tmpfiles-setup.service ntpd.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 11:40:55 UTC", "AssertTimestampMonotonic": "13965780", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 11:40:55 UTC", "ConditionTimestampMonotonic": "13965744", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service ntpd.service", "ControlGro 2020-11-20T11:44:39.468 INFO:teuthology.task.ansible.out:up": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "901", "ExecMainStartTimestamp": "Fri 2020-11-20 11:40:56 UTC", "ExecMainStartTimestampMonotonic": "15034132", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[Fri 2020-11-20 11:40:55 UTC] ; stop_time=[Fri 2020-11-20 11:40:56 UTC] ; pid=872 ; code=exited ; status=0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[Fri 2020-11-20 11:40:56 UTC] ; stop_time=[Fri 2020-11-20 11:40:56 UTC] ; pid=964 ; code=exited ; status=0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 11:40:55 UTC", "InactiveExitTimestampMonotonic": "14029365", "InvocationID": "9a89d06fd6c6426babe22cfd4bb0555f", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "Limit 2020-11-20T11:44:39.470 INFO:teuthology.task.ansible.out:AS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127237", "LimitNPROCSoft": "127237", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127237", "LimitSIGPENDINGSoft": "127237", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "901", "MemoryAccounting": "yes", "MemoryCurrent": "3203072", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "R 2020-11-20T11:44:39.471 INFO:teuthology.task.ansible.out:equires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 11:40:56 UTC", "StateChangeTimestampMonotonic": "15121295", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203579", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 11:40:56 UTC", "WatchdogTimestampMonotonic": "15034142", "WatchdogUSec": "0"}} 2020-11-20T11:44:39.503 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:39 +0000 (0:00:00.078) 0:02:43.259 ******* 2020-11-20T11:44:39.537 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:39 +0000 (0:00:00.033) 0:02:43.292 ******* 2020-11-20T11:44:39.544 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:44:39.550 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi146.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:44:39.551 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.606 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:39 +0000 (0:00:00.070) 0:02:43.362 ******* 2020-11-20T11:44:39.694 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:39 +0000 (0:00:00.087) 0:02:43.450 ******* 2020-11-20T11:44:39.704 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-11-20T11:44:39.747 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:39 +0000 (0:00:00.053) 0:02:43.503 ******* 2020-11-20T11:44:39.798 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-11-20T11:44:39.800 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.835 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:39 +0000 (0:00:00.088) 0:02:43.591 ******* 2020-11-20T11:44:39.864 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-11-20T11:44:39.866 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.899 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:39 +0000 (0:00:00.063) 0:02:43.655 ******* 2020-11-20T11:44:39.909 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:44:39.942 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:39 +0000 (0:00:00.042) 0:02:43.697 ******* 2020-11-20T11:44:39.948 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-11-20T11:44:39.950 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:39.984 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:39 +0000 (0:00:00.042) 0:02:43.740 ******* 2020-11-20T11:44:39.990 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-11-20T11:44:39.992 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.027 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:40 +0000 (0:00:00.043) 0:02:43.783 ******* 2020-11-20T11:44:40.055 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-11-20T11:44:40.058 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-11-20T11:44:40.091 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:40 +0000 (0:00:00.063) 0:02:43.846 ******* 2020-11-20T11:44:40.171 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-11-20T11:44:40.173 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-11-20T11:44:40.206 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:40 +0000 (0:00:00.115) 0:02:43.961 ******* 2020-11-20T11:44:40.372 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-11-20T11:44:40.373 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 11:41:00 UTC", "ActiveEnterTimestampMonotonic": "15582139", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket system.slice sntp.service tmp.mount ntpd.service -.mount ntpdate.service basic.target sysinit.target systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 11:40:58 UTC", "AssertTimestampMonotonic": "14179636", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 11:40:58 UTC", "ConditionTimestampMonotonic": "14179595", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target ntpd.service", "ControlGro 2020-11-20T11:44:40.375 INFO:teuthology.task.ansible.out:up": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "873", "ExecMainStartTimestamp": "Fri 2020-11-20 11:40:59 UTC", "ExecMainStartTimestampMonotonic": "15431855", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[Fri 2020-11-20 11:40:58 UTC] ; stop_time=[Fri 2020-11-20 11:40:59 UTC] ; pid=868 ; code=exited ; status=0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[Fri 2020-11-20 11:40:59 UTC] ; stop_time=[Fri 2020-11-20 11:41:00 UTC] ; pid=964 ; code=exited ; status=0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 11:40:58 UTC", "InactiveExitTimestampMonotonic": "14241443", "InvocationID": "4be2cdb570c043518b0ee5e8584e5e32", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "Limit 2020-11-20T11:44:40.376 INFO:teuthology.task.ansible.out:AS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127237", "LimitNPROCSoft": "127237", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127237", "LimitSIGPENDINGSoft": "127237", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "873", "MemoryAccounting": "yes", "MemoryCurrent": "3153920", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "R 2020-11-20T11:44:40.378 INFO:teuthology.task.ansible.out:equires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 11:41:00 UTC", "StateChangeTimestampMonotonic": "15582139", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203580", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 11:40:59 UTC", "WatchdogTimestampMonotonic": "15431864", "WatchdogUSec": "0"}} 2020-11-20T11:44:40.409 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:40 +0000 (0:00:00.202) 0:02:44.165 ******* 2020-11-20T11:44:40.436 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:44:40.437 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-11-20T11:44:40.470 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:40 +0000 (0:00:00.061) 0:02:44.226 ******* 2020-11-20T11:44:40.508 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:44:40.514 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-11-20T11:44:40.548 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:40 +0000 (0:00:00.076) 0:02:44.303 ******* 2020-11-20T11:44:40.574 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-11-20T11:44:40.576 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.608 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:40 +0000 (0:00:00.060) 0:02:44.364 ******* 2020-11-20T11:44:40.634 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-11-20T11:44:40.636 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.671 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:40 +0000 (0:00:00.063) 0:02:44.427 ******* 2020-11-20T11:44:40.678 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-11-20T11:44:40.679 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-11-20T11:44:40.715 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:40 +0000 (0:00:00.043) 0:02:44.470 ******* 2020-11-20T11:44:40.724 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:40.759 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:40 +0000 (0:00:00.045) 0:02:44.515 ******* 2020-11-20T11:44:40.972 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-11-20T11:44:40.974 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-11-20T11:44:41.016 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:41 +0000 (0:00:00.255) 0:02:44.771 ******* 2020-11-20T11:44:41.307 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-11-20T11:44:41.309 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true} 2020-11-20T11:44:41.341 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:41 +0000 (0:00:00.325) 0:02:45.097 ******* 2020-11-20T11:44:41.495 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-11-20T11:44:41.496 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-11-20T11:44:41.531 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:41 +0000 (0:00:00.189) 0:02:45.287 ******* 2020-11-20T11:44:41.652 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-11-20T11:44:41.654 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-11-20T11:44:41.688 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:41 +0000 (0:00:00.156) 0:02:45.444 ******* 2020-11-20T11:44:41.715 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-11-20T11:44:41.717 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.749 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:41 +0000 (0:00:00.061) 0:02:45.505 ******* 2020-11-20T11:44:41.775 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-11-20T11:44:41.777 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.810 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:41 +0000 (0:00:00.061) 0:02:45.566 ******* 2020-11-20T11:44:41.839 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-11-20T11:44:41.841 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.875 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:41 +0000 (0:00:00.064) 0:02:45.631 ******* 2020-11-20T11:44:41.882 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-11-20T11:44:41.920 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:41 +0000 (0:00:00.045) 0:02:45.676 ******* 2020-11-20T11:44:41.927 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-11-20T11:44:41.929 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:41.970 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:41 +0000 (0:00:00.050) 0:02:45.726 ******* 2020-11-20T11:44:41.977 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-11-20T11:44:41.979 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:42.013 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:42 +0000 (0:00:00.041) 0:02:45.767 ******* 2020-11-20T11:44:42.018 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-11-20T11:44:42.023 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:42.058 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:42 +0000 (0:00:00.046) 0:02:45.814 ******* 2020-11-20T11:44:42.065 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-11-20T11:44:42.068 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-11-20T11:44:42.100 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:42 +0000 (0:00:00.042) 0:02:45.856 ******* 2020-11-20T11:44:42.107 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-11-20T11:44:42.109 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:42.143 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:42 +0000 (0:00:00.042) 0:02:45.899 ******* 2020-11-20T11:44:42.170 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-11-20T11:44:42.172 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:42.206 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:42 +0000 (0:00:00.062) 0:02:45.962 ******* 2020-11-20T11:44:42.234 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:42.267 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:42 +0000 (0:00:00.060) 0:02:46.023 ******* 2020-11-20T11:44:42.284 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-11-20T11:44:42.286 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-11-20T11:44:42.321 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:42 +0000 (0:00:00.053) 0:02:46.076 ******* 2020-11-20T11:44:42.327 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-11-20T11:44:42.329 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:42.363 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:42 +0000 (0:00:00.042) 0:02:46.119 ******* 2020-11-20T11:44:42.370 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-11-20T11:44:42.371 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:42.405 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:42 +0000 (0:00:00.042) 0:02:46.161 ******* 2020-11-20T11:44:42.413 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:42.447 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:42 +0000 (0:00:00.041) 0:02:46.203 ******* 2020-11-20T11:44:42.453 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-11-20T11:44:42.455 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-11-20T11:44:42.490 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:42 +0000 (0:00:00.042) 0:02:46.245 ******* 2020-11-20T11:44:42.496 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-11-20T11:44:42.497 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:42.531 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:42 +0000 (0:00:00.041) 0:02:46.287 ******* 2020-11-20T11:44:42.538 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-11-20T11:44:42.539 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:42.575 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:42 +0000 (0:00:00.043) 0:02:46.331 ******* 2020-11-20T11:44:42.583 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-11-20T11:44:42.585 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-11-20T11:44:42.618 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:42 +0000 (0:00:00.043) 0:02:46.374 ******* 2020-11-20T11:44:42.646 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-11-20T11:44:42.647 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:42.682 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:42 +0000 (0:00:00.063) 0:02:46.437 ******* 2020-11-20T11:44:42.708 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-11-20T11:44:42.710 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-11-20T11:44:42.742 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:42 +0000 (0:00:00.060) 0:02:46.498 ******* 2020-11-20T11:44:42.758 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-11-20T11:44:42.760 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-11-20T11:44:42.800 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:42 +0000 (0:00:00.057) 0:02:46.555 ******* 2020-11-20T11:44:42.921 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-11-20T11:44:42.923 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-11-20T11:44:42.964 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:42 +0000 (0:00:00.164) 0:02:46.719 ******* 2020-11-20T11:44:42.993 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-11-20T11:44:42.995 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create the chrony.conf file] ********************************** ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-11-20T11:44:43.029 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:43 +0000 (0:00:00.065) 0:02:46.785 ******* 2020-11-20T11:44:43.062 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:43 +0000 (0:00:00.032) 0:02:46.817 ******* 2020-11-20T11:44:43.069 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-11-20T11:44:43.070 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-11-20T11:44:43.118 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:43 +0000 (0:00:00.056) 0:02:46.874 ******* 2020-11-20T11:44:43.126 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi192.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-11-20T11:44:43.174 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:43 +0000 (0:00:00.055) 0:02:46.930 ******* 2020-11-20T11:44:43.180 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-11-20T11:44:43.182 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:43.221 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:43 +0000 (0:00:00.047) 0:02:46.977 ******* 2020-11-20T11:44:43.229 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-11-20T11:44:43.231 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:43.265 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:43 +0000 (0:00:00.044) 0:02:47.021 ******* 2020-11-20T11:44:43.271 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-11-20T11:44:43.274 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:43.284 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:43.286 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:43.321 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:43 +0000 (0:00:00.055) 0:02:47.077 ******* 2020-11-20T11:44:43.338 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-11-20T11:44:43.340 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 11:41:07 UTC", "ActiveEnterTimestampMonotonic": "15701365", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sntp.service basic.target ntpdate.service systemd-tmpfiles-setup.service sysinit.target systemd-journald.socket system.slice ntpd.service tmp.mount -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 11:41:05 UTC", "AssertTimestampMonotonic": "14162031", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 11:41:05 UTC", "ConditionTimestampMonotonic": "14161985", "ConfigurationDirectoryMode": "0755", "Conflicts": "ntpd.service systemd-timesyncd.service shutdown.target", "ControlGro 2020-11-20T11:44:43.342 INFO:teuthology.task.ansible.out:up": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "927", "ExecMainStartTimestamp": "Fri 2020-11-20 11:41:07 UTC", "ExecMainStartTimestampMonotonic": "15557984", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[Fri 2020-11-20 11:41:05 UTC] ; stop_time=[Fri 2020-11-20 11:41:07 UTC] ; pid=892 ; code=exited ; status=0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[Fri 2020-11-20 11:41:07 UTC] ; stop_time=[Fri 2020-11-20 11:41:07 UTC] ; pid=987 ; code=exited ; status=0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 11:41:05 UTC", "InactiveExitTimestampMonotonic": "14192895", "InvocationID": "a45e394d25834aca87ae3b5dd2afcda5", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "Limit 2020-11-20T11:44:43.344 INFO:teuthology.task.ansible.out:AS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127237", "LimitNPROCSoft": "127237", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127237", "LimitSIGPENDINGSoft": "127237", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "927", "MemoryAccounting": "yes", "MemoryCurrent": "3444736", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "R 2020-11-20T11:44:43.345 INFO:teuthology.task.ansible.out:equires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 11:41:07 UTC", "StateChangeTimestampMonotonic": "15701365", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203580", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 11:41:07 UTC", "WatchdogTimestampMonotonic": "15558335", "WatchdogUSec": "0"}} 2020-11-20T11:44:43.377 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:43 +0000 (0:00:00.056) 0:02:47.133 ******* 2020-11-20T11:44:43.384 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-11-20T11:44:43.386 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:43.387 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditiona 2020-11-20T11:44:43.389 INFO:teuthology.task.ansible.out:l result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:43.423 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:43 +0000 (0:00:00.045) 0:02:47.178 ******* 2020-11-20T11:44:43.430 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-11-20T11:44:43.467 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:43 +0000 (0:00:00.042) 0:02:47.221 ******* 2020-11-20T11:44:43.472 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-11-20T11:44:43.474 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:43.510 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:43 +0000 (0:00:00.044) 0:02:47.266 ******* 2020-11-20T11:44:43.542 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:43 +0000 (0:00:00.031) 0:02:47.298 ******* 2020-11-20T11:44:43.547 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:44:43.549 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-11-20T11:44:43.550 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-11-20T11:44:43.550 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:43.585 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:43 +0000 (0:00:00.042) 0:02:47.341 ******* 2020-11-20T11:44:43.617 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:43 +0000 (0:00:00.032) 0:02:47.373 ******* 2020-11-20T11:44:43.624 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-11-20T11:44:43.626 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:43.662 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:43 +0000 (0:00:00.044) 0:02:47.418 ******* 2020-11-20T11:44:43.669 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-11-20T11:44:43.670 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:43.703 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:43 +0000 (0:00:00.041) 0:02:47.459 ******* 2020-11-20T11:44:43.710 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-11-20T11:44:43.712 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:43.749 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:43 +0000 (0:00:00.045) 0:02:47.504 ******* 2020-11-20T11:44:43.756 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi192.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-11-20T11:44:43.758 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:43.792 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:43 +0000 (0:00:00.042) 0:02:47.547 ******* 2020-11-20T11:44:43.825 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:43 +0000 (0:00:00.032) 0:02:47.581 ******* 2020-11-20T11:44:43.831 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-11-20T11:44:43.832 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:43.869 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:43 +0000 (0:00:00.044) 0:02:47.625 ******* 2020-11-20T11:44:43.901 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:43 +0000 (0:00:00.031) 0:02:47.657 ******* 2020-11-20T11:44:43.907 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-11-20T11:44:43.909 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:43.948 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:43 +0000 (0:00:00.046) 0:02:47.703 ******* 2020-11-20T11:44:43.982 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:43 +0000 (0:00:00.033) 0:02:47.736 ******* 2020-11-20T11:44:43.989 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:44.035 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:44 +0000 (0:00:00.053) 0:02:47.790 ******* 2020-11-20T11:44:44.041 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-11-20T11:44:44.044 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:44.044 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:44.056 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:44.057 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-11-20T11:44:44.057 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:44.091 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:44 +0000 (0:00:00.056) 0:02:47.847 ******* 2020-11-20T11:44:44.124 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:44 +0000 (0:00:00.032) 0:02:47.880 ******* 2020-11-20T11:44:44.130 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-11-20T11:44:44.132 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-11-20T11:44:44.168 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:44 +0000 (0:00:00.044) 0:02:47.924 ******* 2020-11-20T11:44:44.199 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-11-20T11:44:44.201 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:44.211 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi192.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:44.223 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:44.225 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:44.261 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:44 +0000 (0:00:00.092) 0:02:48.017 ******* 2020-11-20T11:44:44.297 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:44:44.299 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:44.338 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:44 +0000 (0:00:00.076) 0:02:48.093 ******* 2020-11-20T11:44:44.345 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi087.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005115", "end": "2020-11-20 11:44:44.301882", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-11-20 11:44:44.296767", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:44.369 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:44.403 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:44 +0000 (0:00:00.065) 0:02:48.159 ******* 2020-11-20T11:44:44.430 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-11-20T11:44:44.432 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:44.484 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:44 +0000 (0:00:00.080) 0:02:48.240 ******* 2020-11-20T11:44:44.519 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-11-20T11:44:44.520 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:44.521 INFO:teuthology.task.ansible.out: 2020-11-20T11:44:44.556 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:44 +0000 (0:00:00.072) 0:02:48.312 ******* 2020-11-20T11:44:44.562 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-20T11:44:44.564 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003157", "end": "2020-11-20 11:44:44.503060", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-11-20 11:44:44.499903", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:44.595 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:44.637 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:44 +0000 (0:00:00.081) 0:02:48.393 ******* 2020-11-20T11:44:44.663 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-11-20T11:44:44.665 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:44.700 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:44 +0000 (0:00:00.062) 0:02:48.455 ******* 2020-11-20T11:44:44.707 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-11-20T11:44:44.766 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:44 +0000 (0:00:00.064) 0:02:48.520 ******* 2020-11-20T11:44:44.774 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi087.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002784", "end": "2020-11-20 11:44:44.685220", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 11:44:44.682436", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:44.778 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:44.819 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:44 +0000 (0:00:00.054) 0:02:48.575 ******* 2020-11-20T11:44:44.848 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-11-20T11:44:44.849 INFO:teuthology.task.ansible.out:skipping: [smithi192.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:44.893 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:44 +0000 (0:00:00.073) 0:02:48.649 ******* 2020-11-20T11:44:44.921 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-20T11:44:44.923 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.015517", "end": "2020-11-20 11:44:44.883410", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-11-20 11:44:44.867893", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:44.959 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:44 +0000 (0:00:00.065) 0:02:48.714 ******* 2020-11-20T11:44:44.986 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-11-20T11:44:45.024 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:45 +0000 (0:00:00.065) 0:02:48.780 ******* 2020-11-20T11:44:45.129 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-20T11:44:45.131 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005079", "end": "2020-11-20 11:44:45.093278", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-11-20 11:44:45.088199", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:45.236 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-11-20T11:44:45.238 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-20T11:44:45.317 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-20T11:44:45.319 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.002972", "end": "2020-11-20 11:44:45.279183", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-11-20 11:44:45.276211", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:45.487 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002747", "end": "2020-11-20 11:44:45.456399", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 11:44:45.453652", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:45.677 INFO:teuthology.task.ansible.out:ok: [smithi192.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.016831", "end": "2020-11-20 11:44:45.639882", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-11-20 11:44:45.623051", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:45.712 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:45 +0000 (0:00:00.687) 0:02:49.468 ******* 2020-11-20T11:44:45.740 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-11-20T11:44:45.774 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:45 +0000 (0:00:00.061) 0:02:49.530 ******* 2020-11-20T11:44:45.780 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-11-20T11:44:45.782 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-11-20T11:44:45.821 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:45 +0000 (0:00:00.046) 0:02:49.577 ******* 2020-11-20T11:44:45.848 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-11-20T11:44:45.850 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:45.882 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:45 +0000 (0:00:00.061) 0:02:49.638 ******* 2020-11-20T11:44:45.920 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-11-20T11:44:45.922 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-11-20T11:44:45.968 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:45 +0000 (0:00:00.085) 0:02:49.724 ******* 2020-11-20T11:44:45.975 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-11-20T11:44:45.977 INFO:teuthology.task.ansible.out:changed: [smithi192.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-20T11:44:46.144 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-11-20T11:44:46.146 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-11-20T11:44:46.178 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:46 +0000 (0:00:00.210) 0:02:49.934 ******* 2020-11-20T11:44:46.205 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-11-20T11:44:46.207 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:46.241 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:46 +0000 (0:00:00.062) 0:02:49.996 ******* 2020-11-20T11:44:46.267 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi146.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-11-20T11:44:46.301 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:46 +0000 (0:00:00.061) 0:02:50.057 ******* 2020-11-20T11:44:46.339 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-11-20T11:44:46.341 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:46.376 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:46 +0000 (0:00:00.074) 0:02:50.132 ******* 2020-11-20T11:44:46.565 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-11-20T11:44:46.566 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-11-20T11:44:46.599 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:46 +0000 (0:00:00.222) 0:02:50.355 ******* 2020-11-20T11:44:46.784 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-11-20T11:44:46.786 INFO:teuthology.task.ansible.out:changed: [smithi146.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-11-20T11:44:46.829 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:46 +0000 (0:00:00.230) 0:02:50.585 ******* 2020-11-20T11:44:46.856 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-11-20T11:44:46.858 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:46.891 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:46 +0000 (0:00:00.061) 0:02:50.647 ******* 2020-11-20T11:44:46.928 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-11-20T11:44:46.930 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:46.940 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:46.941 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:46.953 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-11-20T11:44:46.989 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:46 +0000 (0:00:00.097) 0:02:50.744 ******* 2020-11-20T11:44:47.026 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-11-20T11:44:47.029 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi146.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:47.039 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:47.041 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:47.078 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:47 +0000 (0:00:00.089) 0:02:50.834 ******* 2020-11-20T11:44:47.105 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:44:47.109 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:47.146 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:47 +0000 (0:00:00.068) 0:02:50.902 ******* 2020-11-20T11:44:47.174 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-11-20T11:44:47.175 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:47.210 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:47 +0000 (0:00:00.063) 0:02:50.966 ******* 2020-11-20T11:44:47.237 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-11-20T11:44:47.239 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:47.277 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:47 +0000 (0:00:00.066) 0:02:51.033 ******* 2020-11-20T11:44:47.304 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-11-20T11:44:47.307 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:47.339 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:47 +0000 (0:00:00.062) 0:02:51.095 ******* 2020-11-20T11:44:47.366 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-11-20T11:44:47.368 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:47.402 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:47 +0000 (0:00:00.062) 0:02:51.158 ******* 2020-11-20T11:44:47.429 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-11-20T11:44:47.431 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:47.467 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:47 +0000 (0:00:00.064) 0:02:51.223 ******* 2020-11-20T11:44:47.504 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:47.542 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:47 +0000 (0:00:00.075) 0:02:51.298 ******* 2020-11-20T11:44:47.569 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-11-20T11:44:47.571 INFO:teuthology.task.ansible.out:skipping: [smithi146.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:44:47.603 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:47 +0000 (0:00:00.060) 0:02:51.359 ******* 2020-11-20T11:44:47.817 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-20T11:44:47.819 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005143", "end": "2020-11-20 11:44:47.777779", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-11-20 11:44:47.772636", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:47.976 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.002914", "end": "2020-11-20 11:44:47.947051", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-11-20 11:44:47.944137", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:48.143 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002837", "end": "2020-11-20 11:44:48.112969", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 11:44:48.110132", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:48.321 INFO:teuthology.task.ansible.out:ok: [smithi146.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.016547", "end": "2020-11-20 11:44:48.291746", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-11-20 11:44:48.275199", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:44:48.357 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:48 +0000 (0:00:00.753) 0:02:52.113 ******* 2020-11-20T11:44:48.383 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-11-20T11:44:48.417 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:44:48 +0000 (0:00:00.059) 0:02:52.173 ******* 2020-11-20T11:44:48.611 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** changed: [smithi146.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-20T11:44:49.007 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched PLAY [paddles] ***************************************************************** skipping: no hosts matched PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY RECAP ********************************************************************* smithi087.front.sepia.ceph.com : ok=125 changed=36 unreachable=0 failed=0 skipped=171 rescued=0 ignored=4 smithi146.front.sepia.ceph.com : ok=125 changed=35 unreachable=0 failed=0 skipped=171 rescued=0 ignored=4 smithi192.front.sepia.ceph.com : ok=125 changed=35 unreachable=0 failed=0 skipped=171 rescued=0 ignored=4 Friday 20 November 2020 11:44:48 +0000 (0:00:00.296) 0:02:52.469 ******* =============================================================================== common : nrpe - Load SELinux policy package ---------------------------- 13.11s common : nrpe - Remove SELinux policy package -------------------------- 13.03s common : Register with subscription-manager. --------------------------- 10.61s testnode : Zap all non-root disks --------------------------------------- 4.56s testnode : Install packages --------------------------------------------- 4.38s testnode : Ensure ceph packages are not present. ------------------------ 3.35s testnode : Ensure ceph dependency packages are not present. ------------- 3.06s Gathering Facts --------------------------------------------------------- 1.60s testnode : Install epel packages ---------------------------------------- 1.42s common : Install Kerberos Packages (RedHat) ----------------------------- 1.19s common : Disable all rhsm repos ----------------------------------------- 1.19s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 1.01s common : Install CA Cert from Satellite Server -------------- 2020-11-20T11:44:49.009 INFO:teuthology.task.ansible.out:------------ 0.93s ansible-managed : Add authorized keys for the ansible user. ------------- 0.86s common : nrpe - Ensure SELinux policy is up to date --------------------- 0.86s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 0.85s common : nrpe - Install SELinux dependencies ---------------------------- 0.83s testnode : List any leftover Ceph artifacts from previous jobs ---------- 0.75s common : Enable necessary rhsm repos ------------------------------------ 0.69s common : Get list of enabled RHSM repos --------------------------------- 0.69s 2020-11-20T11:44:49.113 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi192.front.sepia.ceph.com'), Remote(name='ubuntu@smithi146.front.sepia.ceph.com'), Remote(name='ubuntu@smithi087.front.sepia.ceph.com')] 2020-11-20T11:44:49.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T11:44:49.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:44:49.184 INFO:teuthology.orchestra.run.smithi192:> true 2020-11-20T11:44:49.277 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T11:44:49.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:44:49.347 INFO:teuthology.orchestra.run.smithi146:> true 2020-11-20T11:44:49.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T11:44:49.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:44:49.506 INFO:teuthology.orchestra.run.smithi087:> true 2020-11-20T11:44:49.601 INFO:teuthology.run_tasks:Running task clock... 2020-11-20T11:44:49.612 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-11-20T11:44:49.612 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-11-20T11:44:49.613 INFO:teuthology.orchestra.run.smithi192:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-11-20T11:44:49.651 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-11-20T11:44:49.667 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-11-20T11:44:49.700 INFO:teuthology.orchestra.run.smithi192.stderr:sudo: ntpd: command not found 2020-11-20T11:44:49.710 INFO:teuthology.orchestra.run.smithi192.stdout:506 Cannot talk to daemon 2020-11-20T11:44:49.725 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-11-20T11:44:49.739 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-11-20T11:44:49.794 INFO:teuthology.orchestra.run.smithi192.stderr:bash: ntpq: command not found 2020-11-20T11:44:49.797 INFO:teuthology.orchestra.run.smithi192.stdout:210 Number of sources = 4 2020-11-20T11:44:49.797 INFO:teuthology.orchestra.run.smithi192.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-11-20T11:44:49.797 INFO:teuthology.orchestra.run.smithi192.stdout:=============================================================================== 2020-11-20T11:44:49.797 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:44:49.798 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:44:49.798 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:44:49.798 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:44:49.799 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-11-20T11:44:49.799 INFO:teuthology.orchestra.run.smithi146:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-11-20T11:44:49.833 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-11-20T11:44:49.848 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-11-20T11:44:49.890 INFO:teuthology.orchestra.run.smithi146.stderr:sudo: ntpd: command not found 2020-11-20T11:44:49.900 INFO:teuthology.orchestra.run.smithi146.stdout:506 Cannot talk to daemon 2020-11-20T11:44:49.915 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-11-20T11:44:49.929 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-11-20T11:44:49.989 INFO:teuthology.orchestra.run.smithi146.stderr:bash: ntpq: command not found 2020-11-20T11:44:49.991 INFO:teuthology.orchestra.run.smithi146.stdout:210 Number of sources = 4 2020-11-20T11:44:49.992 INFO:teuthology.orchestra.run.smithi146.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-11-20T11:44:49.992 INFO:teuthology.orchestra.run.smithi146.stdout:=============================================================================== 2020-11-20T11:44:49.992 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:44:49.993 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:44:49.993 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:44:49.994 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:44:49.995 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-11-20T11:44:49.997 INFO:teuthology.orchestra.run.smithi087:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-11-20T11:44:50.039 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-11-20T11:44:50.060 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-11-20T11:44:50.090 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: ntpd: command not found 2020-11-20T11:44:50.102 INFO:teuthology.orchestra.run.smithi087.stdout:506 Cannot talk to daemon 2020-11-20T11:44:50.116 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-11-20T11:44:50.131 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-11-20T11:44:50.189 INFO:teuthology.orchestra.run.smithi087.stderr:bash: ntpq: command not found 2020-11-20T11:44:50.192 INFO:teuthology.orchestra.run.smithi087.stdout:210 Number of sources = 4 2020-11-20T11:44:50.192 INFO:teuthology.orchestra.run.smithi087.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-11-20T11:44:50.192 INFO:teuthology.orchestra.run.smithi087.stdout:=============================================================================== 2020-11-20T11:44:50.193 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:44:50.193 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:44:50.193 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:44:50.193 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T11:44:50.194 INFO:teuthology.run_tasks:Running task install... 2020-11-20T11:44:50.207 DEBUG:teuthology.task.install:project ceph 2020-11-20T11:44:50.208 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'}} 2020-11-20T11:44:50.208 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'} 2020-11-20T11:44:50.208 INFO:teuthology.task.install:Using flavor: basic 2020-11-20T11:44:50.215 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-11-20T11:44:50.215 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2020-11-20T11:44:50.216 INFO:teuthology.orchestra.run.smithi192:> sudo lsb_release -is 2020-11-20T11:44:50.255 INFO:teuthology.orchestra.run.smithi192.stdout:RedHatEnterprise 2020-11-20T11:44:50.257 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-20T11:44:50.258 INFO:teuthology.orchestra.run.smithi146:> sudo lsb_release -is 2020-11-20T11:44:50.259 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb', 'tag': None, 'wait_for_package': False} 2020-11-20T11:44:50.259 INFO:teuthology.orchestra.run.smithi192:> sudo lsb_release -is 2020-11-20T11:44:50.295 INFO:teuthology.orchestra.run.smithi146.stdout:RedHatEnterprise 2020-11-20T11:44:50.296 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-20T11:44:50.297 INFO:teuthology.orchestra.run.smithi087:> sudo lsb_release -is 2020-11-20T11:44:50.298 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb', 'tag': None, 'wait_for_package': False} 2020-11-20T11:44:50.298 INFO:teuthology.orchestra.run.smithi146:> sudo lsb_release -is 2020-11-20T11:44:50.334 INFO:teuthology.orchestra.run.smithi192.stdout:RedHatEnterprise 2020-11-20T11:44:50.336 INFO:teuthology.orchestra.run.smithi087.stdout:RedHatEnterprise 2020-11-20T11:44:50.337 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-20T11:44:50.338 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-20T11:44:50.339 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:44:50.344 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb', 'tag': None, 'wait_for_package': False} 2020-11-20T11:44:50.344 INFO:teuthology.orchestra.run.smithi087:> sudo lsb_release -is 2020-11-20T11:44:50.380 INFO:teuthology.orchestra.run.smithi146.stdout:RedHatEnterprise 2020-11-20T11:44:50.380 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-20T11:44:50.381 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:44:50.416 INFO:teuthology.orchestra.run.smithi087.stdout:RedHatEnterprise 2020-11-20T11:44:50.417 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-20T11:44:50.417 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:44:50.523 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/ 2020-11-20T11:44:50.523 INFO:teuthology.task.install.rpm:Package version is 16.0.0-7397.gb86e691b 2020-11-20T11:44:50.553 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/ 2020-11-20T11:44:50.554 INFO:teuthology.task.install.rpm:Package version is 16.0.0-7397.gb86e691b 2020-11-20T11:44:50.593 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/ 2020-11-20T11:44:50.593 INFO:teuthology.task.install.rpm:Package version is 16.0.0-7397.gb86e691b 2020-11-20T11:44:50.785 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-11-20T11:44:50.786 INFO:teuthology.orchestra.run.smithi192:> set -ex 2020-11-20T11:44:50.786 INFO:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T11:44:50.804 INFO:teuthology.orchestra.run.smithi192.stderr:+ sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T11:44:50.814 INFO:teuthology.orchestra.run.smithi192.stderr:1+1 records in 2020-11-20T11:44:50.814 INFO:teuthology.orchestra.run.smithi192.stderr:1+1 records out 2020-11-20T11:44:50.815 INFO:teuthology.orchestra.run.smithi192.stderr:676 bytes copied, 4.0049e-05 s, 16.9 MB/s 2020-11-20T11:44:50.816 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2020-11-20T11:44:50.816 INFO:teuthology.orchestra.run.smithi192:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b86e691bf191566922a8f08e2a5abf64fde8cfcb/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-11-20T11:44:50.825 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-11-20T11:44:50.826 INFO:teuthology.orchestra.run.smithi146:> set -ex 2020-11-20T11:44:50.826 INFO:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T11:44:50.846 INFO:teuthology.orchestra.run.smithi146.stderr:+ sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T11:44:50.856 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-11-20T11:44:50.857 INFO:teuthology.orchestra.run.smithi087:> set -ex 2020-11-20T11:44:50.857 INFO:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T11:44:50.859 INFO:teuthology.orchestra.run.smithi146.stderr:1+1 records in 2020-11-20T11:44:50.859 INFO:teuthology.orchestra.run.smithi146.stderr:1+1 records out 2020-11-20T11:44:50.859 INFO:teuthology.orchestra.run.smithi146.stderr:676 bytes copied, 3.9856e-05 s, 17.0 MB/s 2020-11-20T11:44:50.860 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2020-11-20T11:44:50.860 INFO:teuthology.orchestra.run.smithi146:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b86e691bf191566922a8f08e2a5abf64fde8cfcb/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-11-20T11:44:50.877 INFO:teuthology.orchestra.run.smithi087.stderr:+ sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T11:44:50.887 INFO:teuthology.orchestra.run.smithi087.stderr:1+1 records in 2020-11-20T11:44:50.888 INFO:teuthology.orchestra.run.smithi087.stderr:1+1 records out 2020-11-20T11:44:50.888 INFO:teuthology.orchestra.run.smithi087.stderr:676 bytes copied, 3.932e-05 s, 17.2 MB/s 2020-11-20T11:44:50.890 INFO:teuthology.orchestra.run.smithi192:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-11-20T11:44:50.890 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2020-11-20T11:44:50.890 INFO:teuthology.orchestra.run.smithi087:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b86e691bf191566922a8f08e2a5abf64fde8cfcb/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-11-20T11:44:50.938 INFO:teuthology.orchestra.run.smithi146:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-11-20T11:44:50.969 INFO:teuthology.orchestra.run.smithi087:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-11-20T11:44:50.972 INFO:teuthology.orchestra.run.smithi192:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-11-20T11:44:51.025 INFO:teuthology.orchestra.run.smithi146:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-11-20T11:44:51.039 INFO:teuthology.orchestra.run.smithi192.stdout:check_obsoletes = 1 2020-11-20T11:44:51.040 INFO:teuthology.orchestra.run.smithi192:> sudo yum clean all 2020-11-20T11:44:51.056 INFO:teuthology.orchestra.run.smithi087:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-11-20T11:44:51.106 INFO:teuthology.orchestra.run.smithi146.stdout:check_obsoletes = 1 2020-11-20T11:44:51.107 INFO:teuthology.orchestra.run.smithi146:> sudo yum clean all 2020-11-20T11:44:51.132 INFO:teuthology.orchestra.run.smithi087.stdout:check_obsoletes = 1 2020-11-20T11:44:51.133 INFO:teuthology.orchestra.run.smithi087:> sudo yum clean all 2020-11-20T11:44:51.348 INFO:teuthology.orchestra.run.smithi192.stdout:Updating Subscription Management repositories. 2020-11-20T11:44:51.465 INFO:teuthology.orchestra.run.smithi146.stdout:Updating Subscription Management repositories. 2020-11-20T11:44:51.489 INFO:teuthology.orchestra.run.smithi087.stdout:Updating Subscription Management repositories. 2020-11-20T11:44:51.608 INFO:teuthology.orchestra.run.smithi192.stdout:38 files removed 2020-11-20T11:44:51.645 INFO:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2020-11-20T11:44:51.725 INFO:teuthology.orchestra.run.smithi146.stdout:38 files removed 2020-11-20T11:44:51.751 INFO:teuthology.orchestra.run.smithi087.stdout:38 files removed 2020-11-20T11:44:51.762 INFO:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2020-11-20T11:44:51.789 INFO:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2020-11-20T11:44:51.915 INFO:teuthology.orchestra.run.smithi192.stdout:Updating Subscription Management repositories. 2020-11-20T11:44:52.027 INFO:teuthology.orchestra.run.smithi146.stdout:Updating Subscription Management repositories. 2020-11-20T11:44:52.051 INFO:teuthology.orchestra.run.smithi087.stdout:Updating Subscription Management repositories. 2020-11-20T11:44:52.560 INFO:teuthology.orchestra.run.smithi192.stdout:ceph packages for x86_64 294 kB/s | 72 kB 00:00 2020-11-20T11:44:52.658 INFO:teuthology.orchestra.run.smithi146.stdout:ceph packages for x86_64 293 kB/s | 72 kB 00:00 2020-11-20T11:44:52.682 INFO:teuthology.orchestra.run.smithi087.stdout:ceph packages for x86_64 292 kB/s | 72 kB 00:00 2020-11-20T11:44:52.794 INFO:teuthology.orchestra.run.smithi192.stdout:ceph noarch packages 73 kB/s | 15 kB 00:00 2020-11-20T11:44:52.951 INFO:teuthology.orchestra.run.smithi146.stdout:ceph noarch packages 56 kB/s | 15 kB 00:00 2020-11-20T11:44:52.982 INFO:teuthology.orchestra.run.smithi087.stdout:ceph noarch packages 55 kB/s | 15 kB 00:00 2020-11-20T11:44:53.076 INFO:teuthology.orchestra.run.smithi192.stdout:ceph source packages 5.4 kB/s | 1.4 kB 00:00 2020-11-20T11:44:53.178 INFO:teuthology.orchestra.run.smithi146.stdout:ceph source packages 6.9 kB/s | 1.4 kB 00:00 2020-11-20T11:44:53.206 INFO:teuthology.orchestra.run.smithi087.stdout:ceph source packages 7.0 kB/s | 1.4 kB 00:00 2020-11-20T11:44:53.471 INFO:teuthology.orchestra.run.smithi192.stdout:Extra Packages for Enterprise Linux 22 MB/s | 8.3 MB 00:00 2020-11-20T11:44:53.522 INFO:teuthology.orchestra.run.smithi146.stdout:Extra Packages for Enterprise Linux 26 MB/s | 8.3 MB 00:00 2020-11-20T11:44:53.792 INFO:teuthology.orchestra.run.smithi087.stdout:Extra Packages for Enterprise Linux 15 MB/s | 8.3 MB 00:00 2020-11-20T11:44:55.168 INFO:teuthology.orchestra.run.smithi192.stdout:lab-extras 4.3 MB/s | 23 kB 00:00 2020-11-20T11:44:55.203 INFO:teuthology.orchestra.run.smithi146.stdout:lab-extras 5.3 MB/s | 23 kB 00:00 2020-11-20T11:44:55.425 INFO:teuthology.orchestra.run.smithi192.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 121 MB/s | 25 MB 00:00 2020-11-20T11:44:55.474 INFO:teuthology.orchestra.run.smithi146.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 109 MB/s | 24 MB 00:00 2020-11-20T11:44:55.481 INFO:teuthology.orchestra.run.smithi087.stdout:lab-extras 5.4 MB/s | 23 kB 00:00 2020-11-20T11:44:55.742 INFO:teuthology.orchestra.run.smithi087.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 118 MB/s | 25 MB 00:00 2020-11-20T11:44:59.130 INFO:teuthology.orchestra.run.smithi146.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 115 MB/s | 25 MB 00:00 2020-11-20T11:44:59.141 INFO:teuthology.orchestra.run.smithi192.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 106 MB/s | 24 MB 00:00 2020-11-20T11:44:59.414 INFO:teuthology.orchestra.run.smithi087.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 111 MB/s | 24 MB 00:00 2020-11-20T11:45:04.680 INFO:teuthology.orchestra.run.smithi146.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T11:45:04.681 INFO:teuthology.orchestra.run.smithi146.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T11:45:04.687 INFO:teuthology.orchestra.run.smithi146.stdout:Package NetworkManager-1:1.26.0-8.el8.x86_64 is already installed. 2020-11-20T11:45:04.688 INFO:teuthology.orchestra.run.smithi146.stdout:Package iproute-5.3.0-5.el8.x86_64 is already installed. 2020-11-20T11:45:04.688 INFO:teuthology.orchestra.run.smithi146.stdout:Package util-linux-2.32.1-24.el8.x86_64 is already installed. 2020-11-20T11:45:04.689 INFO:teuthology.orchestra.run.smithi146.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-11-20T11:45:04.690 INFO:teuthology.orchestra.run.smithi146.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-11-20T11:45:04.692 INFO:teuthology.orchestra.run.smithi146.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-11-20T11:45:04.693 INFO:teuthology.orchestra.run.smithi146.stdout:Package xfsprogs-5.0.0-4.el8.x86_64 is already installed. 2020-11-20T11:45:04.871 INFO:teuthology.orchestra.run.smithi192.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T11:45:04.872 INFO:teuthology.orchestra.run.smithi192.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T11:45:04.878 INFO:teuthology.orchestra.run.smithi192.stdout:Package NetworkManager-1:1.26.0-8.el8.x86_64 is already installed. 2020-11-20T11:45:04.879 INFO:teuthology.orchestra.run.smithi192.stdout:Package iproute-5.3.0-5.el8.x86_64 is already installed. 2020-11-20T11:45:04.879 INFO:teuthology.orchestra.run.smithi192.stdout:Package util-linux-2.32.1-24.el8.x86_64 is already installed. 2020-11-20T11:45:04.880 INFO:teuthology.orchestra.run.smithi192.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-11-20T11:45:04.881 INFO:teuthology.orchestra.run.smithi192.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-11-20T11:45:04.883 INFO:teuthology.orchestra.run.smithi192.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-11-20T11:45:04.884 INFO:teuthology.orchestra.run.smithi192.stdout:Package xfsprogs-5.0.0-4.el8.x86_64 is already installed. 2020-11-20T11:45:04.966 INFO:teuthology.orchestra.run.smithi087.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T11:45:04.966 INFO:teuthology.orchestra.run.smithi087.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T11:45:04.973 INFO:teuthology.orchestra.run.smithi087.stdout:Package NetworkManager-1:1.26.0-8.el8.x86_64 is already installed. 2020-11-20T11:45:04.974 INFO:teuthology.orchestra.run.smithi087.stdout:Package iproute-5.3.0-5.el8.x86_64 is already installed. 2020-11-20T11:45:04.974 INFO:teuthology.orchestra.run.smithi087.stdout:Package util-linux-2.32.1-24.el8.x86_64 is already installed. 2020-11-20T11:45:04.975 INFO:teuthology.orchestra.run.smithi087.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-11-20T11:45:04.976 INFO:teuthology.orchestra.run.smithi087.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-11-20T11:45:04.978 INFO:teuthology.orchestra.run.smithi087.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-11-20T11:45:04.979 INFO:teuthology.orchestra.run.smithi087.stdout:Package xfsprogs-5.0.0-4.el8.x86_64 is already installed. 2020-11-20T11:45:05.015 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2020-11-20T11:45:05.043 INFO:teuthology.orchestra.run.smithi146.stdout:====================================================================================================================== 2020-11-20T11:45:05.043 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository Size 2020-11-20T11:45:05.044 INFO:teuthology.orchestra.run.smithi146.stdout:====================================================================================================================== 2020-11-20T11:45:05.044 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2020-11-20T11:45:05.044 INFO:teuthology.orchestra.run.smithi146.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2020-11-20T11:45:05.044 INFO:teuthology.orchestra.run.smithi146.stdout: ceph x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 6.4 k 2020-11-20T11:45:05.044 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 6.0 M 2020-11-20T11:45:05.045 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-fuse x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 632 k 2020-11-20T11:45:05.045 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-immutable-object-cache x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T11:45:05.045 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 1.5 M 2020-11-20T11:45:05.045 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-cephadm noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 66 k 2020-11-20T11:45:05.045 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 3.2 M 2020-11-20T11:45:05.046 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-local noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.6 M 2020-11-20T11:45:05.046 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-rook noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 27 k 2020-11-20T11:45:05.046 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-radosgw x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 12 M 2020-11-20T11:45:05.046 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-test x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 48 M 2020-11-20T11:45:05.047 INFO:teuthology.orchestra.run.smithi146.stdout: cephadm noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 57 k 2020-11-20T11:45:05.047 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libelf-devel x86_64 0.180-1.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2020-11-20T11:45:05.047 INFO:teuthology.orchestra.run.smithi146.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2020-11-20T11:45:05.047 INFO:teuthology.orchestra.run.smithi146.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2020-11-20T11:45:05.047 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs-devel x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 24 k 2020-11-20T11:45:05.048 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs2 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 562 k 2020-11-20T11:45:05.048 INFO:teuthology.orchestra.run.smithi146.stdout: librados-devel x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 131 k 2020-11-20T11:45:05.048 INFO:teuthology.orchestra.run.smithi146.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2020-11-20T11:45:05.048 INFO:teuthology.orchestra.run.smithi146.stdout: libuuid-devel x86_64 2.32.1-24.el8 rhel-8-for-x86_64-baseos-rpms 96 k 2020-11-20T11:45:05.048 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-devel x86_64 1:1.1.1g-11.el8 rhel-8-for-x86_64-baseos-rpms 2.3 M 2020-11-20T11:45:05.049 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cephfs x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T11:45:05.049 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rados x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 375 k 2020-11-20T11:45:05.049 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rbd x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 353 k 2020-11-20T11:45:05.049 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rgw x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 113 k 2020-11-20T11:45:05.049 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-fuse x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 88 k 2020-11-20T11:45:05.050 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-mirror x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 3.2 M 2020-11-20T11:45:05.050 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-nbd x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 171 k 2020-11-20T11:45:05.050 INFO:teuthology.orchestra.run.smithi146.stdout: xfsprogs-devel x86_64 5.0.0-4.el8 rhel-8-for-x86_64-baseos-rpms 69 k 2020-11-20T11:45:05.050 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrading: 2020-11-20T11:45:05.050 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 2.4 M 2020-11-20T11:45:05.051 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-libnm x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 1.7 M 2020-11-20T11:45:05.051 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-team x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 141 k 2020-11-20T11:45:05.051 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-tui x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 320 k 2020-11-20T11:45:05.051 INFO:teuthology.orchestra.run.smithi146.stdout: librados2 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T11:45:05.051 INFO:teuthology.orchestra.run.smithi146.stdout: librbd1 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 2.4 M 2020-11-20T11:45:05.052 INFO:teuthology.orchestra.run.smithi146.stdout:Installing dependencies: 2020-11-20T11:45:05.052 INFO:teuthology.orchestra.run.smithi146.stdout: automake noarch 1.16.1-6.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2020-11-20T11:45:05.052 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-common x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 23 M 2020-11-20T11:45:05.052 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-grafana-dashboards noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 24 k 2020-11-20T11:45:05.052 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mds x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 2.1 M 2020-11-20T11:45:05.053 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 198 k 2020-11-20T11:45:05.053 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 5.0 M 2020-11-20T11:45:05.053 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-osd x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 18 M 2020-11-20T11:45:05.053 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-prometheus-alerts noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.8 k 2020-11-20T11:45:05.053 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-selinux x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 25 k 2020-11-20T11:45:05.054 INFO:teuthology.orchestra.run.smithi146.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2020-11-20T11:45:05.054 INFO:teuthology.orchestra.run.smithi146.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2020-11-20T11:45:05.054 INFO:teuthology.orchestra.run.smithi146.stdout: fuse-common x86_64 3.2.1-12.el8 rhel-8-for-x86_64-baseos-rpms 21 k 2020-11-20T11:45:05.054 INFO:teuthology.orchestra.run.smithi146.stdout: gperftools-libs x86_64 2.7-6.el8 epel 315 k 2020-11-20T11:45:05.055 INFO:teuthology.orchestra.run.smithi146.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2020-11-20T11:45:05.055 INFO:teuthology.orchestra.run.smithi146.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2020-11-20T11:45:05.055 INFO:teuthology.orchestra.run.smithi146.stdout: krb5-devel x86_64 1.18.2-5.el8 rhel-8-for-x86_64-baseos-rpms 558 k 2020-11-20T11:45:05.055 INFO:teuthology.orchestra.run.smithi146.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2020-11-20T11:45:05.055 INFO:teuthology.orchestra.run.smithi146.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2020-11-20T11:45:05.056 INFO:teuthology.orchestra.run.smithi146.stdout: libgfortran x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2020-11-20T11:45:05.056 INFO:teuthology.orchestra.run.smithi146.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2020-11-20T11:45:05.056 INFO:teuthology.orchestra.run.smithi146.stdout: libquadmath x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2020-11-20T11:45:05.056 INFO:teuthology.orchestra.run.smithi146.stdout: librabbitmq x86_64 0.9.0-2.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2020-11-20T11:45:05.056 INFO:teuthology.orchestra.run.smithi146.stdout: libradosstriper1 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 486 k 2020-11-20T11:45:05.057 INFO:teuthology.orchestra.run.smithi146.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2020-11-20T11:45:05.057 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T11:45:05.057 INFO:teuthology.orchestra.run.smithi146.stdout: libselinux-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 199 k 2020-11-20T11:45:05.057 INFO:teuthology.orchestra.run.smithi146.stdout: libsepol-devel x86_64 2.9-1.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2020-11-20T11:45:05.057 INFO:teuthology.orchestra.run.smithi146.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2020-11-20T11:45:05.058 INFO:teuthology.orchestra.run.smithi146.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2020-11-20T11:45:05.058 INFO:teuthology.orchestra.run.smithi146.stdout: libxslt x86_64 1.1.32-5.el8 rhel-8-for-x86_64-baseos-rpms 250 k 2020-11-20T11:45:05.058 INFO:teuthology.orchestra.run.smithi146.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2020-11-20T11:45:05.058 INFO:teuthology.orchestra.run.smithi146.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2020-11-20T11:45:05.058 INFO:teuthology.orchestra.run.smithi146.stdout: openblas x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.3 M 2020-11-20T11:45:05.059 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-threads x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.4 M 2020-11-20T11:45:05.059 INFO:teuthology.orchestra.run.smithi146.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2020-11-20T11:45:05.059 INFO:teuthology.orchestra.run.smithi146.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2020-11-20T11:45:05.059 INFO:teuthology.orchestra.run.smithi146.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2020-11-20T11:45:05.059 INFO:teuthology.orchestra.run.smithi146.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2020-11-20T11:45:05.060 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asn1crypto noarch 0.24.0-3.el8 rhel-8-for-x86_64-baseos-rpms 181 k 2020-11-20T11:45:05.060 INFO:teuthology.orchestra.run.smithi146.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2020-11-20T11:45:05.060 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2020-11-20T11:45:05.060 INFO:teuthology.orchestra.run.smithi146.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2020-11-20T11:45:05.060 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2020-11-20T11:45:05.061 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-argparse x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 40 k 2020-11-20T11:45:05.061 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 73 k 2020-11-20T11:45:05.061 INFO:teuthology.orchestra.run.smithi146.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2020-11-20T11:45:05.061 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2020-11-20T11:45:05.061 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cheroot noarch 8.2.1-1.el8 epel 145 k 2020-11-20T11:45:05.062 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2020-11-20T11:45:05.062 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cryptography x86_64 2.3-3.el8 rhel-8-for-x86_64-baseos-rpms 511 k 2020-11-20T11:45:05.062 INFO:teuthology.orchestra.run.smithi146.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2020-11-20T11:45:05.062 INFO:teuthology.orchestra.run.smithi146.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2020-11-20T11:45:05.062 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2020-11-20T11:45:05.063 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2020-11-20T11:45:05.063 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2020-11-20T11:45:05.063 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-11-20T11:45:05.063 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2020-11-20T11:45:05.063 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-11-20T11:45:05.064 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes noarch 11.0.0-2.el8 epel 1.2 M 2020-11-20T11:45:05.064 INFO:teuthology.orchestra.run.smithi146.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2020-11-20T11:45:05.064 INFO:teuthology.orchestra.run.smithi146.stdout: python3-lxml x86_64 4.2.3-1.el8 rhel-8-for-x86_64-appstream-rpms 1.5 M 2020-11-20T11:45:05.064 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2020-11-20T11:45:05.064 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2020-11-20T11:45:05.065 INFO:teuthology.orchestra.run.smithi146.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2020-11-20T11:45:05.065 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2020-11-20T11:45:05.065 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2020-11-20T11:45:05.065 INFO:teuthology.orchestra.run.smithi146.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2020-11-20T11:45:05.065 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2020-11-20T11:45:05.066 INFO:teuthology.orchestra.run.smithi146.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2020-11-20T11:45:05.066 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2020-11-20T11:45:05.066 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyOpenSSL noarch 18.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2020-11-20T11:45:05.066 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2020-11-20T11:45:05.066 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2020-11-20T11:45:05.067 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2020-11-20T11:45:05.067 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2020-11-20T11:45:05.067 INFO:teuthology.orchestra.run.smithi146.stdout: python3-remoto noarch 1.1.4-4.el8 epel 48 k 2020-11-20T11:45:05.067 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2020-11-20T11:45:05.067 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-11-20T11:45:05.068 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2020-11-20T11:45:05.068 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rsa noarch 3.4.2-15.el8 epel 73 k 2020-11-20T11:45:05.068 INFO:teuthology.orchestra.run.smithi146.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2020-11-20T11:45:05.068 INFO:teuthology.orchestra.run.smithi146.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2020-11-20T11:45:05.068 INFO:teuthology.orchestra.run.smithi146.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2020-11-20T11:45:05.069 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2020-11-20T11:45:05.069 INFO:teuthology.orchestra.run.smithi146.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2020-11-20T11:45:05.069 INFO:teuthology.orchestra.run.smithi146.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2020-11-20T11:45:05.069 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webencodings noarch 0.5.1-6.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-11-20T11:45:05.069 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2020-11-20T11:45:05.070 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2020-11-20T11:45:05.070 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2020-11-20T11:45:05.070 INFO:teuthology.orchestra.run.smithi146.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2020-11-20T11:45:05.070 INFO:teuthology.orchestra.run.smithi146.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2020-11-20T11:45:05.070 INFO:teuthology.orchestra.run.smithi146.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2020-11-20T11:45:05.071 INFO:teuthology.orchestra.run.smithi146.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2020-11-20T11:45:05.071 INFO:teuthology.orchestra.run.smithi146.stdout: zlib-devel x86_64 1.2.11-16.el8_2 rhel-8-for-x86_64-baseos-rpms 57 k 2020-11-20T11:45:05.071 INFO:teuthology.orchestra.run.smithi146.stdout:Installing weak dependencies: 2020-11-20T11:45:05.071 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2020-11-20T11:45:05.072 INFO:teuthology.orchestra.run.smithi146.stdout: python3-html5lib noarch 1:0.999999999-6.el8 rhel-8-for-x86_64-appstream-rpms 214 k 2020-11-20T11:45:05.072 INFO:teuthology.orchestra.run.smithi146.stdout: 2020-11-20T11:45:05.072 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2020-11-20T11:45:05.072 INFO:teuthology.orchestra.run.smithi146.stdout:====================================================================================================================== 2020-11-20T11:45:05.073 INFO:teuthology.orchestra.run.smithi146.stdout:Install 127 Packages 2020-11-20T11:45:05.073 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrade 6 Packages 2020-11-20T11:45:05.073 INFO:teuthology.orchestra.run.smithi146.stdout: 2020-11-20T11:45:05.074 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 199 M 2020-11-20T11:45:05.074 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2020-11-20T11:45:05.159 INFO:teuthology.orchestra.run.smithi146.stdout:(1/133): ceph-16.0.0-7397.gb86e691b.el8.x86_64. 64 kB/s | 6.4 kB 00:00 2020-11-20T11:45:05.197 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2020-11-20T11:45:05.214 INFO:teuthology.orchestra.run.smithi192.stdout:====================================================================================================================== 2020-11-20T11:45:05.215 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2020-11-20T11:45:05.215 INFO:teuthology.orchestra.run.smithi192.stdout:====================================================================================================================== 2020-11-20T11:45:05.215 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2020-11-20T11:45:05.215 INFO:teuthology.orchestra.run.smithi192.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2020-11-20T11:45:05.216 INFO:teuthology.orchestra.run.smithi192.stdout: ceph x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 6.4 k 2020-11-20T11:45:05.216 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 6.0 M 2020-11-20T11:45:05.217 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-fuse x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 632 k 2020-11-20T11:45:05.217 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-immutable-object-cache x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T11:45:05.217 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 1.5 M 2020-11-20T11:45:05.217 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-cephadm noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 66 k 2020-11-20T11:45:05.218 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-dashboard noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 3.2 M 2020-11-20T11:45:05.218 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-diskprediction-local noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.6 M 2020-11-20T11:45:05.218 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-rook noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 27 k 2020-11-20T11:45:05.218 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-radosgw x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 12 M 2020-11-20T11:45:05.218 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-test x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 48 M 2020-11-20T11:45:05.219 INFO:teuthology.orchestra.run.smithi192.stdout: cephadm noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 57 k 2020-11-20T11:45:05.219 INFO:teuthology.orchestra.run.smithi192.stdout: elfutils-libelf-devel x86_64 0.180-1.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2020-11-20T11:45:05.219 INFO:teuthology.orchestra.run.smithi192.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2020-11-20T11:45:05.219 INFO:teuthology.orchestra.run.smithi192.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2020-11-20T11:45:05.220 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs-devel x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 24 k 2020-11-20T11:45:05.220 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs2 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 562 k 2020-11-20T11:45:05.221 INFO:teuthology.orchestra.run.smithi192.stdout: librados-devel x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 131 k 2020-11-20T11:45:05.221 INFO:teuthology.orchestra.run.smithi192.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2020-11-20T11:45:05.221 INFO:teuthology.orchestra.run.smithi192.stdout: libuuid-devel x86_64 2.32.1-24.el8 rhel-8-for-x86_64-baseos-rpms 96 k 2020-11-20T11:45:05.222 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-devel x86_64 1:1.1.1g-11.el8 rhel-8-for-x86_64-baseos-rpms 2.3 M 2020-11-20T11:45:05.222 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cephfs x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T11:45:05.223 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rados x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 375 k 2020-11-20T11:45:05.223 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rbd x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 353 k 2020-11-20T11:45:05.223 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rgw x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 113 k 2020-11-20T11:45:05.224 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-fuse x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 88 k 2020-11-20T11:45:05.224 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-mirror x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 3.2 M 2020-11-20T11:45:05.225 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-nbd x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 171 k 2020-11-20T11:45:05.225 INFO:teuthology.orchestra.run.smithi192.stdout: xfsprogs-devel x86_64 5.0.0-4.el8 rhel-8-for-x86_64-baseos-rpms 69 k 2020-11-20T11:45:05.226 INFO:teuthology.orchestra.run.smithi192.stdout:Upgrading: 2020-11-20T11:45:05.226 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 2.4 M 2020-11-20T11:45:05.227 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-libnm x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 1.7 M 2020-11-20T11:45:05.227 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-team x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 141 k 2020-11-20T11:45:05.227 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-tui x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 320 k 2020-11-20T11:45:05.228 INFO:teuthology.orchestra.run.smithi192.stdout: librados2 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T11:45:05.228 INFO:teuthology.orchestra.run.smithi192.stdout: librbd1 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 2.4 M 2020-11-20T11:45:05.229 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2020-11-20T11:45:05.229 INFO:teuthology.orchestra.run.smithi192.stdout: automake noarch 1.16.1-6.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2020-11-20T11:45:05.229 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-common x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 23 M 2020-11-20T11:45:05.230 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-grafana-dashboards noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 24 k 2020-11-20T11:45:05.230 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mds x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 2.1 M 2020-11-20T11:45:05.231 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-modules-core noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 198 k 2020-11-20T11:45:05.231 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mon x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 5.0 M 2020-11-20T11:45:05.231 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-osd x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 18 M 2020-11-20T11:45:05.232 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-prometheus-alerts noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.8 k 2020-11-20T11:45:05.232 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-selinux x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 25 k 2020-11-20T11:45:05.232 INFO:teuthology.orchestra.run.smithi192.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2020-11-20T11:45:05.233 INFO:teuthology.orchestra.run.smithi192.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2020-11-20T11:45:05.233 INFO:teuthology.orchestra.run.smithi192.stdout: fuse-common x86_64 3.2.1-12.el8 rhel-8-for-x86_64-baseos-rpms 21 k 2020-11-20T11:45:05.234 INFO:teuthology.orchestra.run.smithi192.stdout: gperftools-libs x86_64 2.7-6.el8 epel 315 k 2020-11-20T11:45:05.234 INFO:teuthology.orchestra.run.smithi192.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2020-11-20T11:45:05.234 INFO:teuthology.orchestra.run.smithi192.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2020-11-20T11:45:05.235 INFO:teuthology.orchestra.run.smithi192.stdout: krb5-devel x86_64 1.18.2-5.el8 rhel-8-for-x86_64-baseos-rpms 558 k 2020-11-20T11:45:05.235 INFO:teuthology.orchestra.run.smithi192.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2020-11-20T11:45:05.235 INFO:teuthology.orchestra.run.smithi192.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2020-11-20T11:45:05.235 INFO:teuthology.orchestra.run.smithi192.stdout: libgfortran x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2020-11-20T11:45:05.236 INFO:teuthology.orchestra.run.smithi192.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2020-11-20T11:45:05.236 INFO:teuthology.orchestra.run.smithi192.stdout: libquadmath x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2020-11-20T11:45:05.236 INFO:teuthology.orchestra.run.smithi192.stdout: librabbitmq x86_64 0.9.0-2.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2020-11-20T11:45:05.236 INFO:teuthology.orchestra.run.smithi192.stdout: libradosstriper1 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 486 k 2020-11-20T11:45:05.236 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2020-11-20T11:45:05.237 INFO:teuthology.orchestra.run.smithi192.stdout: librgw2 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T11:45:05.237 INFO:teuthology.orchestra.run.smithi192.stdout: libselinux-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 199 k 2020-11-20T11:45:05.237 INFO:teuthology.orchestra.run.smithi192.stdout: libsepol-devel x86_64 2.9-1.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2020-11-20T11:45:05.237 INFO:teuthology.orchestra.run.smithi192.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2020-11-20T11:45:05.237 INFO:teuthology.orchestra.run.smithi192.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2020-11-20T11:45:05.238 INFO:teuthology.orchestra.run.smithi192.stdout: libxslt x86_64 1.1.32-5.el8 rhel-8-for-x86_64-baseos-rpms 250 k 2020-11-20T11:45:05.238 INFO:teuthology.orchestra.run.smithi192.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2020-11-20T11:45:05.238 INFO:teuthology.orchestra.run.smithi192.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2020-11-20T11:45:05.238 INFO:teuthology.orchestra.run.smithi192.stdout: openblas x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.3 M 2020-11-20T11:45:05.239 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-threads x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.4 M 2020-11-20T11:45:05.239 INFO:teuthology.orchestra.run.smithi192.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2020-11-20T11:45:05.239 INFO:teuthology.orchestra.run.smithi192.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2020-11-20T11:45:05.239 INFO:teuthology.orchestra.run.smithi192.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2020-11-20T11:45:05.239 INFO:teuthology.orchestra.run.smithi192.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2020-11-20T11:45:05.240 INFO:teuthology.orchestra.run.smithi192.stdout: python3-asn1crypto noarch 0.24.0-3.el8 rhel-8-for-x86_64-baseos-rpms 181 k 2020-11-20T11:45:05.240 INFO:teuthology.orchestra.run.smithi192.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2020-11-20T11:45:05.240 INFO:teuthology.orchestra.run.smithi192.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2020-11-20T11:45:05.241 INFO:teuthology.orchestra.run.smithi192.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2020-11-20T11:45:05.241 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2020-11-20T11:45:05.241 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 40 k 2020-11-20T11:45:05.242 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-common x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 73 k 2020-11-20T11:45:05.242 INFO:teuthology.orchestra.run.smithi192.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2020-11-20T11:45:05.243 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2020-11-20T11:45:05.243 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cheroot noarch 8.2.1-1.el8 epel 145 k 2020-11-20T11:45:05.243 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2020-11-20T11:45:05.244 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cryptography x86_64 2.3-3.el8 rhel-8-for-x86_64-baseos-rpms 511 k 2020-11-20T11:45:05.244 INFO:teuthology.orchestra.run.smithi192.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2020-11-20T11:45:05.244 INFO:teuthology.orchestra.run.smithi192.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2020-11-20T11:45:05.245 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2020-11-20T11:45:05.245 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2020-11-20T11:45:05.246 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2020-11-20T11:45:05.246 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-11-20T11:45:05.246 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2020-11-20T11:45:05.247 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-11-20T11:45:05.247 INFO:teuthology.orchestra.run.smithi192.stdout: python3-kubernetes noarch 11.0.0-2.el8 epel 1.2 M 2020-11-20T11:45:05.248 INFO:teuthology.orchestra.run.smithi192.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2020-11-20T11:45:05.248 INFO:teuthology.orchestra.run.smithi192.stdout: python3-lxml x86_64 4.2.3-1.el8 rhel-8-for-x86_64-appstream-rpms 1.5 M 2020-11-20T11:45:05.248 INFO:teuthology.orchestra.run.smithi192.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2020-11-20T11:45:05.249 INFO:teuthology.orchestra.run.smithi192.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2020-11-20T11:45:05.249 INFO:teuthology.orchestra.run.smithi192.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2020-11-20T11:45:05.250 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2020-11-20T11:45:05.250 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2020-11-20T11:45:05.250 INFO:teuthology.orchestra.run.smithi192.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2020-11-20T11:45:05.251 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2020-11-20T11:45:05.251 INFO:teuthology.orchestra.run.smithi192.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2020-11-20T11:45:05.252 INFO:teuthology.orchestra.run.smithi192.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2020-11-20T11:45:05.252 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyOpenSSL noarch 18.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2020-11-20T11:45:05.252 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2020-11-20T11:45:05.253 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2020-11-20T11:45:05.253 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2020-11-20T11:45:05.254 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2020-11-20T11:45:05.254 INFO:teuthology.orchestra.run.smithi192.stdout: python3-remoto noarch 1.1.4-4.el8 epel 48 k 2020-11-20T11:45:05.254 INFO:teuthology.orchestra.run.smithi192.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2020-11-20T11:45:05.255 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-11-20T11:45:05.255 INFO:teuthology.orchestra.run.smithi192.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2020-11-20T11:45:05.256 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rsa noarch 3.4.2-15.el8 epel 73 k 2020-11-20T11:45:05.256 INFO:teuthology.orchestra.run.smithi192.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2020-11-20T11:45:05.256 INFO:teuthology.orchestra.run.smithi192.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2020-11-20T11:45:05.257 INFO:teuthology.orchestra.run.smithi192.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2020-11-20T11:45:05.257 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2020-11-20T11:45:05.258 INFO:teuthology.orchestra.run.smithi192.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2020-11-20T11:45:05.258 INFO:teuthology.orchestra.run.smithi192.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2020-11-20T11:45:05.258 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webencodings noarch 0.5.1-6.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-11-20T11:45:05.259 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2020-11-20T11:45:05.259 INFO:teuthology.orchestra.run.smithi192.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2020-11-20T11:45:05.260 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2020-11-20T11:45:05.260 INFO:teuthology.orchestra.run.smithi192.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2020-11-20T11:45:05.260 INFO:teuthology.orchestra.run.smithi192.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2020-11-20T11:45:05.261 INFO:teuthology.orchestra.run.smithi192.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2020-11-20T11:45:05.261 INFO:teuthology.orchestra.run.smithi192.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2020-11-20T11:45:05.262 INFO:teuthology.orchestra.run.smithi192.stdout: zlib-devel x86_64 1.2.11-16.el8_2 rhel-8-for-x86_64-baseos-rpms 57 k 2020-11-20T11:45:05.262 INFO:teuthology.orchestra.run.smithi192.stdout:Installing weak dependencies: 2020-11-20T11:45:05.262 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2020-11-20T11:45:05.263 INFO:teuthology.orchestra.run.smithi192.stdout: python3-html5lib noarch 1:0.999999999-6.el8 rhel-8-for-x86_64-appstream-rpms 214 k 2020-11-20T11:45:05.263 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:45:05.264 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2020-11-20T11:45:05.264 INFO:teuthology.orchestra.run.smithi192.stdout:====================================================================================================================== 2020-11-20T11:45:05.264 INFO:teuthology.orchestra.run.smithi192.stdout:Install 127 Packages 2020-11-20T11:45:05.265 INFO:teuthology.orchestra.run.smithi192.stdout:Upgrade 6 Packages 2020-11-20T11:45:05.265 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:45:05.266 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 199 M 2020-11-20T11:45:05.266 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2020-11-20T11:45:05.296 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2020-11-20T11:45:05.307 INFO:teuthology.orchestra.run.smithi146.stdout:(2/133): ceph-fuse-16.0.0-7397.gb86e691b.el8.x8 4.2 MB/s | 632 kB 00:00 2020-11-20T11:45:05.318 INFO:teuthology.orchestra.run.smithi087.stdout:====================================================================================================================== 2020-11-20T11:45:05.318 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2020-11-20T11:45:05.318 INFO:teuthology.orchestra.run.smithi087.stdout:====================================================================================================================== 2020-11-20T11:45:05.318 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2020-11-20T11:45:05.319 INFO:teuthology.orchestra.run.smithi087.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2020-11-20T11:45:05.319 INFO:teuthology.orchestra.run.smithi087.stdout: ceph x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 6.4 k 2020-11-20T11:45:05.319 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 6.0 M 2020-11-20T11:45:05.319 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-fuse x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 632 k 2020-11-20T11:45:05.320 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-immutable-object-cache x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T11:45:05.320 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 1.5 M 2020-11-20T11:45:05.320 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-cephadm noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 66 k 2020-11-20T11:45:05.320 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-dashboard noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 3.2 M 2020-11-20T11:45:05.320 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-diskprediction-local noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.6 M 2020-11-20T11:45:05.321 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-rook noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 27 k 2020-11-20T11:45:05.321 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-radosgw x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 12 M 2020-11-20T11:45:05.321 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-test x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 48 M 2020-11-20T11:45:05.321 INFO:teuthology.orchestra.run.smithi087.stdout: cephadm noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 57 k 2020-11-20T11:45:05.321 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libelf-devel x86_64 0.180-1.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2020-11-20T11:45:05.322 INFO:teuthology.orchestra.run.smithi087.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2020-11-20T11:45:05.322 INFO:teuthology.orchestra.run.smithi087.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2020-11-20T11:45:05.322 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs-devel x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 24 k 2020-11-20T11:45:05.322 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs2 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 562 k 2020-11-20T11:45:05.322 INFO:teuthology.orchestra.run.smithi087.stdout: librados-devel x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 131 k 2020-11-20T11:45:05.323 INFO:teuthology.orchestra.run.smithi087.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2020-11-20T11:45:05.323 INFO:teuthology.orchestra.run.smithi087.stdout: libuuid-devel x86_64 2.32.1-24.el8 rhel-8-for-x86_64-baseos-rpms 96 k 2020-11-20T11:45:05.323 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-devel x86_64 1:1.1.1g-11.el8 rhel-8-for-x86_64-baseos-rpms 2.3 M 2020-11-20T11:45:05.323 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cephfs x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T11:45:05.323 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 375 k 2020-11-20T11:45:05.324 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rbd x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 353 k 2020-11-20T11:45:05.324 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rgw x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 113 k 2020-11-20T11:45:05.324 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-fuse x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 88 k 2020-11-20T11:45:05.324 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-mirror x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 3.2 M 2020-11-20T11:45:05.324 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-nbd x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 171 k 2020-11-20T11:45:05.325 INFO:teuthology.orchestra.run.smithi087.stdout: xfsprogs-devel x86_64 5.0.0-4.el8 rhel-8-for-x86_64-baseos-rpms 69 k 2020-11-20T11:45:05.325 INFO:teuthology.orchestra.run.smithi087.stdout:Upgrading: 2020-11-20T11:45:05.325 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 2.4 M 2020-11-20T11:45:05.325 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-libnm x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 1.7 M 2020-11-20T11:45:05.325 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-team x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 141 k 2020-11-20T11:45:05.326 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-tui x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 320 k 2020-11-20T11:45:05.326 INFO:teuthology.orchestra.run.smithi087.stdout: librados2 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T11:45:05.326 INFO:teuthology.orchestra.run.smithi087.stdout: librbd1 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 2.4 M 2020-11-20T11:45:05.326 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2020-11-20T11:45:05.326 INFO:teuthology.orchestra.run.smithi087.stdout: automake noarch 1.16.1-6.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2020-11-20T11:45:05.327 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-common x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 23 M 2020-11-20T11:45:05.327 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-grafana-dashboards noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 24 k 2020-11-20T11:45:05.327 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mds x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 2.1 M 2020-11-20T11:45:05.327 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 198 k 2020-11-20T11:45:05.327 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mon x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 5.0 M 2020-11-20T11:45:05.328 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-osd x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 18 M 2020-11-20T11:45:05.328 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-prometheus-alerts noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.8 k 2020-11-20T11:45:05.328 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-selinux x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 25 k 2020-11-20T11:45:05.328 INFO:teuthology.orchestra.run.smithi087.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2020-11-20T11:45:05.328 INFO:teuthology.orchestra.run.smithi087.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2020-11-20T11:45:05.329 INFO:teuthology.orchestra.run.smithi087.stdout: fuse-common x86_64 3.2.1-12.el8 rhel-8-for-x86_64-baseos-rpms 21 k 2020-11-20T11:45:05.329 INFO:teuthology.orchestra.run.smithi087.stdout: gperftools-libs x86_64 2.7-6.el8 epel 315 k 2020-11-20T11:45:05.329 INFO:teuthology.orchestra.run.smithi087.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2020-11-20T11:45:05.329 INFO:teuthology.orchestra.run.smithi087.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2020-11-20T11:45:05.329 INFO:teuthology.orchestra.run.smithi087.stdout: krb5-devel x86_64 1.18.2-5.el8 rhel-8-for-x86_64-baseos-rpms 558 k 2020-11-20T11:45:05.330 INFO:teuthology.orchestra.run.smithi087.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2020-11-20T11:45:05.330 INFO:teuthology.orchestra.run.smithi087.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2020-11-20T11:45:05.330 INFO:teuthology.orchestra.run.smithi087.stdout: libgfortran x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2020-11-20T11:45:05.330 INFO:teuthology.orchestra.run.smithi087.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2020-11-20T11:45:05.330 INFO:teuthology.orchestra.run.smithi087.stdout: libquadmath x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2020-11-20T11:45:05.331 INFO:teuthology.orchestra.run.smithi087.stdout: librabbitmq x86_64 0.9.0-2.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2020-11-20T11:45:05.331 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 486 k 2020-11-20T11:45:05.331 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2020-11-20T11:45:05.331 INFO:teuthology.orchestra.run.smithi087.stdout: librgw2 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T11:45:05.331 INFO:teuthology.orchestra.run.smithi087.stdout: libselinux-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 199 k 2020-11-20T11:45:05.332 INFO:teuthology.orchestra.run.smithi087.stdout: libsepol-devel x86_64 2.9-1.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2020-11-20T11:45:05.332 INFO:teuthology.orchestra.run.smithi087.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2020-11-20T11:45:05.332 INFO:teuthology.orchestra.run.smithi087.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2020-11-20T11:45:05.332 INFO:teuthology.orchestra.run.smithi087.stdout: libxslt x86_64 1.1.32-5.el8 rhel-8-for-x86_64-baseos-rpms 250 k 2020-11-20T11:45:05.332 INFO:teuthology.orchestra.run.smithi087.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2020-11-20T11:45:05.333 INFO:teuthology.orchestra.run.smithi087.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2020-11-20T11:45:05.333 INFO:teuthology.orchestra.run.smithi087.stdout: openblas x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.3 M 2020-11-20T11:45:05.333 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-threads x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.4 M 2020-11-20T11:45:05.333 INFO:teuthology.orchestra.run.smithi087.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2020-11-20T11:45:05.333 INFO:teuthology.orchestra.run.smithi087.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2020-11-20T11:45:05.334 INFO:teuthology.orchestra.run.smithi087.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2020-11-20T11:45:05.334 INFO:teuthology.orchestra.run.smithi087.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2020-11-20T11:45:05.334 INFO:teuthology.orchestra.run.smithi087.stdout: python3-asn1crypto noarch 0.24.0-3.el8 rhel-8-for-x86_64-baseos-rpms 181 k 2020-11-20T11:45:05.334 INFO:teuthology.orchestra.run.smithi087.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2020-11-20T11:45:05.334 INFO:teuthology.orchestra.run.smithi087.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2020-11-20T11:45:05.335 INFO:teuthology.orchestra.run.smithi087.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2020-11-20T11:45:05.335 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2020-11-20T11:45:05.335 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-argparse x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 40 k 2020-11-20T11:45:05.335 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-common x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 73 k 2020-11-20T11:45:05.335 INFO:teuthology.orchestra.run.smithi087.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2020-11-20T11:45:05.335 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2020-11-20T11:45:05.336 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cheroot noarch 8.2.1-1.el8 epel 145 k 2020-11-20T11:45:05.336 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2020-11-20T11:45:05.336 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography x86_64 2.3-3.el8 rhel-8-for-x86_64-baseos-rpms 511 k 2020-11-20T11:45:05.336 INFO:teuthology.orchestra.run.smithi087.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2020-11-20T11:45:05.336 INFO:teuthology.orchestra.run.smithi087.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2020-11-20T11:45:05.337 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2020-11-20T11:45:05.337 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2020-11-20T11:45:05.337 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2020-11-20T11:45:05.337 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-11-20T11:45:05.337 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2020-11-20T11:45:05.338 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-11-20T11:45:05.338 INFO:teuthology.orchestra.run.smithi087.stdout: python3-kubernetes noarch 11.0.0-2.el8 epel 1.2 M 2020-11-20T11:45:05.338 INFO:teuthology.orchestra.run.smithi087.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2020-11-20T11:45:05.338 INFO:teuthology.orchestra.run.smithi087.stdout: python3-lxml x86_64 4.2.3-1.el8 rhel-8-for-x86_64-appstream-rpms 1.5 M 2020-11-20T11:45:05.338 INFO:teuthology.orchestra.run.smithi087.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2020-11-20T11:45:05.339 INFO:teuthology.orchestra.run.smithi087.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2020-11-20T11:45:05.339 INFO:teuthology.orchestra.run.smithi087.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2020-11-20T11:45:05.339 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2020-11-20T11:45:05.339 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2020-11-20T11:45:05.339 INFO:teuthology.orchestra.run.smithi087.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2020-11-20T11:45:05.340 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2020-11-20T11:45:05.340 INFO:teuthology.orchestra.run.smithi087.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2020-11-20T11:45:05.340 INFO:teuthology.orchestra.run.smithi087.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2020-11-20T11:45:05.340 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyOpenSSL noarch 18.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2020-11-20T11:45:05.340 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2020-11-20T11:45:05.341 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2020-11-20T11:45:05.341 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2020-11-20T11:45:05.341 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2020-11-20T11:45:05.341 INFO:teuthology.orchestra.run.smithi087.stdout: python3-remoto noarch 1.1.4-4.el8 epel 48 k 2020-11-20T11:45:05.341 INFO:teuthology.orchestra.run.smithi087.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2020-11-20T11:45:05.342 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-11-20T11:45:05.342 INFO:teuthology.orchestra.run.smithi087.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2020-11-20T11:45:05.342 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rsa noarch 3.4.2-15.el8 epel 73 k 2020-11-20T11:45:05.342 INFO:teuthology.orchestra.run.smithi087.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2020-11-20T11:45:05.342 INFO:teuthology.orchestra.run.smithi087.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2020-11-20T11:45:05.343 INFO:teuthology.orchestra.run.smithi087.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2020-11-20T11:45:05.343 INFO:teuthology.orchestra.run.smithi087.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2020-11-20T11:45:05.343 INFO:teuthology.orchestra.run.smithi087.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2020-11-20T11:45:05.343 INFO:teuthology.orchestra.run.smithi087.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2020-11-20T11:45:05.343 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webencodings noarch 0.5.1-6.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-11-20T11:45:05.343 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2020-11-20T11:45:05.344 INFO:teuthology.orchestra.run.smithi087.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2020-11-20T11:45:05.344 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2020-11-20T11:45:05.344 INFO:teuthology.orchestra.run.smithi087.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2020-11-20T11:45:05.344 INFO:teuthology.orchestra.run.smithi087.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2020-11-20T11:45:05.344 INFO:teuthology.orchestra.run.smithi087.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2020-11-20T11:45:05.345 INFO:teuthology.orchestra.run.smithi087.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2020-11-20T11:45:05.345 INFO:teuthology.orchestra.run.smithi087.stdout: zlib-devel x86_64 1.2.11-16.el8_2 rhel-8-for-x86_64-baseos-rpms 57 k 2020-11-20T11:45:05.345 INFO:teuthology.orchestra.run.smithi087.stdout:Installing weak dependencies: 2020-11-20T11:45:05.345 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2020-11-20T11:45:05.345 INFO:teuthology.orchestra.run.smithi087.stdout: python3-html5lib noarch 1:0.999999999-6.el8 rhel-8-for-x86_64-appstream-rpms 214 k 2020-11-20T11:45:05.346 INFO:teuthology.orchestra.run.smithi087.stdout: 2020-11-20T11:45:05.346 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2020-11-20T11:45:05.346 INFO:teuthology.orchestra.run.smithi087.stdout:====================================================================================================================== 2020-11-20T11:45:05.346 INFO:teuthology.orchestra.run.smithi087.stdout:Install 127 Packages 2020-11-20T11:45:05.346 INFO:teuthology.orchestra.run.smithi087.stdout:Upgrade 6 Packages 2020-11-20T11:45:05.347 INFO:teuthology.orchestra.run.smithi087.stdout: 2020-11-20T11:45:05.347 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 199 M 2020-11-20T11:45:05.347 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2020-11-20T11:45:05.370 INFO:teuthology.orchestra.run.smithi146.stdout:(3/133): ceph-immutable-object-cache-16.0.0-739 3.2 MB/s | 204 kB 00:00 2020-11-20T11:45:05.415 INFO:teuthology.orchestra.run.smithi192.stdout:(1/133): ceph-16.0.0-7397.gb86e691b.el8.x86_64. 35 kB/s | 6.4 kB 00:00 2020-11-20T11:45:05.636 INFO:teuthology.orchestra.run.smithi087.stdout:(1/133): ceph-16.0.0-7397.gb86e691b.el8.x86_64. 21 kB/s | 6.4 kB 00:00 2020-11-20T11:45:05.734 INFO:teuthology.orchestra.run.smithi146.stdout:(4/133): ceph-base-16.0.0-7397.gb86e691b.el8.x8 8.8 MB/s | 6.0 MB 00:00 2020-11-20T11:45:05.741 INFO:teuthology.orchestra.run.smithi146.stdout:(5/133): ceph-mds-16.0.0-7397.gb86e691b.el8.x86 5.8 MB/s | 2.1 MB 00:00 2020-11-20T11:45:05.916 INFO:teuthology.orchestra.run.smithi146.stdout:(6/133): ceph-mgr-16.0.0-7397.gb86e691b.el8.x86 8.5 MB/s | 1.5 MB 00:00 2020-11-20T11:45:06.203 INFO:teuthology.orchestra.run.smithi087.stdout:(2/133): ceph-fuse-16.0.0-7397.gb86e691b.el8.x8 1.1 MB/s | 632 kB 00:00 2020-11-20T11:45:06.366 INFO:teuthology.orchestra.run.smithi087.stdout:(3/133): ceph-immutable-object-cache-16.0.0-739 1.2 MB/s | 204 kB 00:00 2020-11-20T11:45:06.510 INFO:teuthology.orchestra.run.smithi146.stdout:(7/133): ceph-mon-16.0.0-7397.gb86e691b.el8.x86 6.5 MB/s | 5.0 MB 00:00 2020-11-20T11:45:06.734 INFO:teuthology.orchestra.run.smithi192.stdout:(2/133): ceph-fuse-16.0.0-7397.gb86e691b.el8.x8 479 kB/s | 632 kB 00:01 2020-11-20T11:45:07.089 INFO:teuthology.orchestra.run.smithi192.stdout:(3/133): ceph-immutable-object-cache-16.0.0-739 574 kB/s | 204 kB 00:00 2020-11-20T11:45:07.738 INFO:teuthology.orchestra.run.smithi087.stdout:(4/133): ceph-mds-16.0.0-7397.gb86e691b.el8.x86 1.6 MB/s | 2.1 MB 00:01 2020-11-20T11:45:07.840 INFO:teuthology.orchestra.run.smithi146.stdout:(8/133): ceph-common-16.0.0-7397.gb86e691b.el8. 8.3 MB/s | 23 MB 00:02 2020-11-20T11:45:07.894 INFO:teuthology.orchestra.run.smithi146.stdout:(9/133): ceph-selinux-16.0.0-7397.gb86e691b.el8 466 kB/s | 25 kB 00:00 2020-11-20T11:45:08.198 INFO:teuthology.orchestra.run.smithi146.stdout:(10/133): ceph-osd-16.0.0-7397.gb86e691b.el8.x8 7.8 MB/s | 18 MB 00:02 2020-11-20T11:45:08.207 INFO:teuthology.orchestra.run.smithi087.stdout:(5/133): ceph-base-16.0.0-7397.gb86e691b.el8.x8 2.1 MB/s | 6.0 MB 00:02 2020-11-20T11:45:08.250 INFO:teuthology.orchestra.run.smithi146.stdout:(11/133): libcephfs-devel-16.0.0-7397.gb86e691b 458 kB/s | 24 kB 00:00 2020-11-20T11:45:08.332 INFO:teuthology.orchestra.run.smithi146.stdout:(12/133): libcephfs2-16.0.0-7397.gb86e691b.el8. 6.8 MB/s | 562 kB 00:00 2020-11-20T11:45:08.397 INFO:teuthology.orchestra.run.smithi146.stdout:(13/133): librados-devel-16.0.0-7397.gb86e691b. 2.0 MB/s | 131 kB 00:00 2020-11-20T11:45:08.476 INFO:teuthology.orchestra.run.smithi146.stdout:(14/133): libradosstriper1-16.0.0-7397.gb86e691 6.0 MB/s | 486 kB 00:00 2020-11-20T11:45:08.496 INFO:teuthology.orchestra.run.smithi087.stdout:(6/133): ceph-mgr-16.0.0-7397.gb86e691b.el8.x86 2.0 MB/s | 1.5 MB 00:00 2020-11-20T11:45:08.589 INFO:teuthology.orchestra.run.smithi146.stdout:(15/133): ceph-radosgw-16.0.0-7397.gb86e691b.el 5.7 MB/s | 12 MB 00:02 2020-11-20T11:45:08.657 INFO:teuthology.orchestra.run.smithi146.stdout:(16/133): python3-ceph-argparse-16.0.0-7397.gb8 582 kB/s | 40 kB 00:00 2020-11-20T11:45:08.727 INFO:teuthology.orchestra.run.smithi146.stdout:(17/133): python3-ceph-common-16.0.0-7397.gb86e 1.0 MB/s | 73 kB 00:00 2020-11-20T11:45:08.801 INFO:teuthology.orchestra.run.smithi146.stdout:(18/133): python3-cephfs-16.0.0-7397.gb86e691b. 2.7 MB/s | 204 kB 00:00 2020-11-20T11:45:08.882 INFO:teuthology.orchestra.run.smithi146.stdout:(19/133): python3-rados-16.0.0-7397.gb86e691b.e 4.5 MB/s | 375 kB 00:00 2020-11-20T11:45:08.963 INFO:teuthology.orchestra.run.smithi146.stdout:(20/133): python3-rbd-16.0.0-7397.gb86e691b.el8 4.3 MB/s | 353 kB 00:00 2020-11-20T11:45:08.985 INFO:teuthology.orchestra.run.smithi146.stdout:(21/133): librgw2-16.0.0-7397.gb86e691b.el8.x86 7.3 MB/s | 3.7 MB 00:00 2020-11-20T11:45:09.019 INFO:teuthology.orchestra.run.smithi146.stdout:(22/133): python3-rgw-16.0.0-7397.gb86e691b.el8 2.0 MB/s | 113 kB 00:00 2020-11-20T11:45:09.039 INFO:teuthology.orchestra.run.smithi146.stdout:(23/133): rbd-fuse-16.0.0-7397.gb86e691b.el8.x8 1.6 MB/s | 88 kB 00:00 2020-11-20T11:45:09.108 INFO:teuthology.orchestra.run.smithi146.stdout:(24/133): rbd-nbd-16.0.0-7397.gb86e691b.el8.x86 2.4 MB/s | 171 kB 00:00 2020-11-20T11:45:09.172 INFO:teuthology.orchestra.run.smithi146.stdout:(25/133): ceph-grafana-dashboards-16.0.0-7397.g 379 kB/s | 24 kB 00:00 2020-11-20T11:45:09.238 INFO:teuthology.orchestra.run.smithi146.stdout:(26/133): ceph-mgr-cephadm-16.0.0-7397.gb86e691 1.0 MB/s | 66 kB 00:00 2020-11-20T11:45:09.595 INFO:teuthology.orchestra.run.smithi146.stdout:(27/133): rbd-mirror-16.0.0-7397.gb86e691b.el8. 5.5 MB/s | 3.2 MB 00:00 2020-11-20T11:45:09.597 INFO:teuthology.orchestra.run.smithi192.stdout:(4/133): ceph-mds-16.0.0-7397.gb86e691b.el8.x86 877 kB/s | 2.1 MB 00:02 2020-11-20T11:45:09.745 INFO:teuthology.orchestra.run.smithi146.stdout:(28/133): ceph-mgr-dashboard-16.0.0-7397.gb86e6 6.2 MB/s | 3.2 MB 00:00 2020-11-20T11:45:09.807 INFO:teuthology.orchestra.run.smithi146.stdout:(29/133): ceph-mgr-modules-core-16.0.0-7397.gb8 3.1 MB/s | 198 kB 00:00 2020-11-20T11:45:09.869 INFO:teuthology.orchestra.run.smithi146.stdout:(30/133): ceph-mgr-rook-16.0.0-7397.gb86e691b.e 453 kB/s | 27 kB 00:00 2020-11-20T11:45:09.923 INFO:teuthology.orchestra.run.smithi146.stdout:(31/133): ceph-prometheus-alerts-16.0.0-7397.gb 160 kB/s | 8.8 kB 00:00 2020-11-20T11:45:09.978 INFO:teuthology.orchestra.run.smithi146.stdout:(32/133): cephadm-16.0.0-7397.gb86e691b.el8.noa 1.0 MB/s | 57 kB 00:00 2020-11-20T11:45:09.995 INFO:teuthology.orchestra.run.smithi087.stdout:(7/133): ceph-mon-16.0.0-7397.gb86e691b.el8.x86 2.8 MB/s | 5.0 MB 00:01 2020-11-20T11:45:10.060 INFO:teuthology.orchestra.run.smithi146.stdout:(33/133): fmt-6.2.1-1.el8.x86_64.rpm 1.4 MB/s | 116 kB 00:00 2020-11-20T11:45:10.094 INFO:teuthology.orchestra.run.smithi146.stdout:(34/133): gperftools-libs-2.7-6.el8.x86_64.rpm 9.2 MB/s | 315 kB 00:00 2020-11-20T11:45:10.112 INFO:teuthology.orchestra.run.smithi146.stdout:(35/133): leveldb-1.22-1.el8.x86_64.rpm 10 MB/s | 181 kB 00:00 2020-11-20T11:45:10.128 INFO:teuthology.orchestra.run.smithi146.stdout:(36/133): liboath-2.6.2-3.el8.x86_64.rpm 3.5 MB/s | 59 kB 00:00 2020-11-20T11:45:10.149 INFO:teuthology.orchestra.run.smithi146.stdout:(37/133): libunwind-1.3.1-3.el8.x86_64.rpm 4.3 MB/s | 75 kB 00:00 2020-11-20T11:45:10.162 INFO:teuthology.orchestra.run.smithi146.stdout:(38/133): python3-apipkg-1.5-6.el8.noarch.rpm 1.3 MB/s | 21 kB 00:00 2020-11-20T11:45:10.179 INFO:teuthology.orchestra.run.smithi146.stdout:(39/133): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 2.5 MB/s | 44 kB 00:00 2020-11-20T11:45:10.197 INFO:teuthology.orchestra.run.smithi146.stdout:(40/133): python3-beautifulsoup4-4.6.3-2.el8.1. 10 MB/s | 185 kB 00:00 2020-11-20T11:45:10.214 INFO:teuthology.orchestra.run.smithi146.stdout:(41/133): python3-cachetools-3.1.1-4.el8.noarch 2.0 MB/s | 33 kB 00:00 2020-11-20T11:45:10.230 INFO:teuthology.orchestra.run.smithi146.stdout:(42/133): python3-certifi-2018.10.15-7.el8.noar 1.0 MB/s | 16 kB 00:00 2020-11-20T11:45:10.248 INFO:teuthology.orchestra.run.smithi146.stdout:(43/133): python3-cheroot-8.2.1-1.el8.noarch.rp 8.1 MB/s | 145 kB 00:00 2020-11-20T11:45:10.268 INFO:teuthology.orchestra.run.smithi146.stdout:(44/133): python3-cherrypy-18.4.0-1.el8.noarch. 20 MB/s | 384 kB 00:00 2020-11-20T11:45:10.285 INFO:teuthology.orchestra.run.smithi146.stdout:(45/133): python3-cssselect-0.9.2-10.el8.noarch 2.3 MB/s | 40 kB 00:00 2020-11-20T11:45:10.303 INFO:teuthology.orchestra.run.smithi146.stdout:(46/133): python3-execnet-1.7.1-1.el8.noarch.rp 19 MB/s | 355 kB 00:00 2020-11-20T11:45:10.320 INFO:teuthology.orchestra.run.smithi146.stdout:(47/133): python3-google-auth-1.1.1-10.el8.noar 4.7 MB/s | 81 kB 00:00 2020-11-20T11:45:10.338 INFO:teuthology.orchestra.run.smithi146.stdout:(48/133): python3-jaraco-6.2-6.el8.noarch.rpm 683 kB/s | 11 kB 00:00 2020-11-20T11:45:10.353 INFO:teuthology.orchestra.run.smithi146.stdout:(49/133): python3-jaraco-functools-2.0-4.el8.no 1.0 MB/s | 18 kB 00:00 2020-11-20T11:45:10.405 INFO:teuthology.orchestra.run.smithi146.stdout:(50/133): python3-kubernetes-11.0.0-2.el8.noarc 23 MB/s | 1.2 MB 00:00 2020-11-20T11:45:10.422 INFO:teuthology.orchestra.run.smithi146.stdout:(51/133): python3-logutils-0.3.5-11.el8.noarch. 2.8 MB/s | 49 kB 00:00 2020-11-20T11:45:10.438 INFO:teuthology.orchestra.run.smithi146.stdout:(52/133): python3-more-itertools-7.2.0-3.el8.no 3.4 MB/s | 59 kB 00:00 2020-11-20T11:45:10.458 INFO:teuthology.orchestra.run.smithi146.stdout:(53/133): python3-pecan-1.3.2-9.el8.noarch.rpm 15 MB/s | 283 kB 00:00 2020-11-20T11:45:10.474 INFO:teuthology.orchestra.run.smithi146.stdout:(54/133): python3-portend-2.6-1.el8.noarch.rpm 951 kB/s | 16 kB 00:00 2020-11-20T11:45:10.490 INFO:teuthology.orchestra.run.smithi146.stdout:(55/133): python3-remoto-1.1.4-4.el8.noarch.rpm 2.8 MB/s | 48 kB 00:00 2020-11-20T11:45:10.507 INFO:teuthology.orchestra.run.smithi146.stdout:(56/133): python3-repoze-lru-0.7-6.el8.noarch.r 2.0 MB/s | 34 kB 00:00 2020-11-20T11:45:10.525 INFO:teuthology.orchestra.run.smithi146.stdout:(57/133): python3-routes-2.4.1-12.el8.noarch.rp 11 MB/s | 196 kB 00:00 2020-11-20T11:45:10.542 INFO:teuthology.orchestra.run.smithi146.stdout:(58/133): python3-rsa-3.4.2-15.el8.noarch.rpm 4.3 MB/s | 73 kB 00:00 2020-11-20T11:45:10.559 INFO:teuthology.orchestra.run.smithi146.stdout:(59/133): python3-simplegeneric-0.8.1-17.el8.no 1.1 MB/s | 19 kB 00:00 2020-11-20T11:45:10.575 INFO:teuthology.orchestra.run.smithi146.stdout:(60/133): python3-singledispatch-3.4.0.3-18.el8 1.4 MB/s | 24 kB 00:00 2020-11-20T11:45:10.592 INFO:teuthology.orchestra.run.smithi146.stdout:(61/133): python3-tempora-1.14.1-5.el8.noarch.r 1.7 MB/s | 29 kB 00:00 2020-11-20T11:45:10.609 INFO:teuthology.orchestra.run.smithi146.stdout:(62/133): python3-trustme-0.6.0-4.el8.noarch.rp 1.6 MB/s | 27 kB 00:00 2020-11-20T11:45:10.627 INFO:teuthology.orchestra.run.smithi146.stdout:(63/133): python3-waitress-1.2.1-2.el8.1.noarch 13 MB/s | 241 kB 00:00 2020-11-20T11:45:10.646 INFO:teuthology.orchestra.run.smithi146.stdout:(64/133): python3-webob-1.8.5-1.el8.1.noarch.rp 14 MB/s | 251 kB 00:00 2020-11-20T11:45:10.662 INFO:teuthology.orchestra.run.smithi146.stdout:(65/133): python3-websocket-client-0.56.0-5.el8 3.6 MB/s | 61 kB 00:00 2020-11-20T11:45:10.680 INFO:teuthology.orchestra.run.smithi146.stdout:(66/133): python3-webtest-2.0.33-1.el8.noarch.r 5.0 MB/s | 85 kB 00:00 2020-11-20T11:45:10.696 INFO:teuthology.orchestra.run.smithi146.stdout:(67/133): python3-zc-lockfile-2.0-2.el8.noarch. 1.4 MB/s | 23 kB 00:00 2020-11-20T11:45:10.713 INFO:teuthology.orchestra.run.smithi146.stdout:(68/133): xmlstarlet-1.6.1-11.el8.x86_64.rpm 4.0 MB/s | 69 kB 00:00 2020-11-20T11:45:10.747 INFO:teuthology.orchestra.run.smithi146.stdout:(69/133): automake-1.16.1-6.el8.noarch.rpm 21 MB/s | 713 kB 00:00 2020-11-20T11:45:10.766 INFO:teuthology.orchestra.run.smithi146.stdout:(70/133): python3-webencodings-0.5.1-6.el8.noar 1.4 MB/s | 27 kB 00:00 2020-11-20T11:45:10.795 INFO:teuthology.orchestra.run.smithi146.stdout:(71/133): python3-lxml-4.2.3-1.el8.x86_64.rpm 53 MB/s | 1.5 MB 00:00 2020-11-20T11:45:10.815 INFO:teuthology.orchestra.run.smithi146.stdout:(72/133): jq-1.5-12.el8.x86_64.rpm 7.9 MB/s | 161 kB 00:00 2020-11-20T11:45:10.834 INFO:teuthology.orchestra.run.smithi146.stdout:(73/133): python3-pyOpenSSL-18.0.0-1.el8.noarch 5.2 MB/s | 103 kB 00:00 2020-11-20T11:45:10.856 INFO:teuthology.orchestra.run.smithi146.stdout:(74/133): python3-werkzeug-0.12.2-4.el8.noarch. 21 MB/s | 457 kB 00:00 2020-11-20T11:45:10.875 INFO:teuthology.orchestra.run.smithi146.stdout:(75/133): python3-mako-1.0.6-13.el8.noarch.rpm 7.9 MB/s | 157 kB 00:00 2020-11-20T11:45:10.893 INFO:teuthology.orchestra.run.smithi192.stdout:(5/133): ceph-mgr-16.0.0-7397.gb86e691b.el8.x86 1.2 MB/s | 1.5 MB 00:01 2020-11-20T11:45:10.894 INFO:teuthology.orchestra.run.smithi146.stdout:(76/133): python3-jsonpatch-1.21-2.el8.noarch.r 1.4 MB/s | 27 kB 00:00 2020-11-20T11:45:10.913 INFO:teuthology.orchestra.run.smithi146.stdout:(77/133): python3-jsonpointer-1.10-11.el8.noarc 1.0 MB/s | 20 kB 00:00 2020-11-20T11:45:10.934 INFO:teuthology.orchestra.run.smithi146.stdout:(78/133): python3-html5lib-0.999999999-6.el8.no 10 MB/s | 214 kB 00:00 2020-11-20T11:45:10.954 INFO:teuthology.orchestra.run.smithi146.stdout:(79/133): python3-pyasn1-0.3.7-6.el8.noarch.rpm 5.9 MB/s | 126 kB 00:00 2020-11-20T11:45:10.974 INFO:teuthology.orchestra.run.smithi146.stdout:(80/133): python3-pytz-2017.2-9.el8.noarch.rpm 2.6 MB/s | 54 kB 00:00 2020-11-20T11:45:10.995 INFO:teuthology.orchestra.run.smithi146.stdout:(81/133): python3-pyasn1-modules-0.3.7-6.el8.no 5.3 MB/s | 110 kB 00:00 2020-11-20T11:45:11.015 INFO:teuthology.orchestra.run.smithi146.stdout:(82/133): python3-prettytable-0.7.2-14.el8.noar 2.2 MB/s | 44 kB 00:00 2020-11-20T11:45:11.035 INFO:teuthology.orchestra.run.smithi146.stdout:(83/133): python3-markupsafe-0.23-19.el8.x86_64 1.9 MB/s | 39 kB 00:00 2020-11-20T11:45:11.058 INFO:teuthology.orchestra.run.smithi146.stdout:(84/133): flex-2.6.1-9.el8.x86_64.rpm 14 MB/s | 320 kB 00:00 2020-11-20T11:45:11.081 INFO:teuthology.orchestra.run.smithi146.stdout:(85/133): librdkafka-0.11.4-1.el8.x86_64.rpm 16 MB/s | 353 kB 00:00 2020-11-20T11:45:11.103 INFO:teuthology.orchestra.run.smithi146.stdout:(86/133): bison-3.0.4-10.el8.x86_64.rpm 29 MB/s | 688 kB 00:00 2020-11-20T11:45:11.127 INFO:teuthology.orchestra.run.smithi146.stdout:(87/133): libtool-2.4.6-25.el8.x86_64.rpm 29 MB/s | 709 kB 00:00 2020-11-20T11:45:11.150 INFO:teuthology.orchestra.run.smithi146.stdout:(88/133): python3-jinja2-2.10.1-2.el8_0.noarch. 23 MB/s | 538 kB 00:00 2020-11-20T11:45:11.244 INFO:teuthology.orchestra.run.smithi146.stdout:(89/133): ceph-mgr-diskprediction-local-16.0.0- 5.2 MB/s | 8.6 MB 00:01 2020-11-20T11:45:11.748 INFO:teuthology.orchestra.run.smithi192.stdout:(6/133): ceph-base-16.0.0-7397.gb86e691b.el8.x8 943 kB/s | 6.0 MB 00:06 2020-11-20T11:45:11.749 INFO:teuthology.orchestra.run.smithi146.stdout:(90/133): python3-scipy-1.0.0-20.module+el8.1.0 66 MB/s | 15 MB 00:00 2020-11-20T11:45:11.749 INFO:teuthology.orchestra.run.smithi146.stdout:(91/133): python3-numpy-f2py-1.14.3-9.el8.x86_6 1.3 MB/s | 225 kB 00:00 2020-11-20T11:45:11.749 INFO:teuthology.orchestra.run.smithi146.stdout:(92/133): python3-babel-2.5.1-5.el8.noarch.rpm 76 MB/s | 4.8 MB 00:00 2020-11-20T11:45:11.750 INFO:teuthology.orchestra.run.smithi146.stdout:(93/133): lttng-ust-2.8.1-11.el8.x86_64.rpm 8.1 MB/s | 259 kB 00:00 2020-11-20T11:45:11.750 INFO:teuthology.orchestra.run.smithi146.stdout:(94/133): python3-numpy-1.14.3-9.el8.x86_64.rpm 74 MB/s | 3.7 MB 00:00 2020-11-20T11:45:11.750 INFO:teuthology.orchestra.run.smithi146.stdout:(95/133): openblas-threads-0.3.3-5.el8.x86_64.r 55 MB/s | 4.4 MB 00:00 2020-11-20T11:45:11.750 INFO:teuthology.orchestra.run.smithi146.stdout:(96/133): openblas-0.3.3-5.el8.x86_64.rpm 65 MB/s | 4.3 MB 00:00 2020-11-20T11:45:11.750 INFO:teuthology.orchestra.run.smithi146.stdout:(97/133): socat-1.7.3.3-2.el8.x86_64.rpm 8.1 MB/s | 302 kB 00:00 2020-11-20T11:45:11.751 INFO:teuthology.orchestra.run.smithi146.stdout:(98/133): oniguruma-6.8.2-2.el8.x86_64.rpm 6.7 MB/s | 187 kB 00:00 2020-11-20T11:45:11.751 INFO:teuthology.orchestra.run.smithi146.stdout:(99/133): python3-cffi-1.11.5-5.el8.x86_64.rpm 8.1 MB/s | 238 kB 00:00 2020-11-20T11:45:11.753 INFO:teuthology.orchestra.run.smithi146.stdout:(100/133): libverto-devel-0.3.0-5.el8.x86_64.rp 752 kB/s | 18 kB 00:00 2020-11-20T11:45:11.753 INFO:teuthology.orchestra.run.smithi146.stdout:(101/133): python3-asn1crypto-0.24.0-3.el8.noar 7.1 MB/s | 181 kB 00:00 2020-11-20T11:45:11.754 INFO:teuthology.orchestra.run.smithi146.stdout:(102/133): python3-requests-oauthlib-1.0.0-1.el 1.7 MB/s | 43 kB 00:00 2020-11-20T11:45:11.754 INFO:teuthology.orchestra.run.smithi146.stdout:(103/133): fuse-2.9.7-12.el8.x86_64.rpm 3.4 MB/s | 83 kB 00:00 2020-11-20T11:45:11.754 INFO:teuthology.orchestra.run.smithi146.stdout:(104/133): python3-pycparser-2.14-14.el8.noarch 3.8 MB/s | 109 kB 00:00 2020-11-20T11:45:11.754 INFO:teuthology.orchestra.run.smithi146.stdout:(105/133): keyutils-libs-devel-1.5.10-6.el8.x86 2.1 MB/s | 48 kB 00:00 2020-11-20T11:45:11.754 INFO:teuthology.orchestra.run.smithi146.stdout:(106/133): python3-jwt-1.6.1-2.el8.noarch.rpm 1.8 MB/s | 43 kB 00:00 2020-11-20T11:45:11.755 INFO:teuthology.orchestra.run.smithi146.stdout:(107/133): python3-oauthlib-2.1.0-1.el8.noarch. 4.4 MB/s | 155 kB 00:00 2020-11-20T11:45:11.755 INFO:teuthology.orchestra.run.smithi146.stdout:(108/133): fuse-common-3.2.1-12.el8.x86_64.rpm 786 kB/s | 21 kB 00:00 2020-11-20T11:45:11.755 INFO:teuthology.orchestra.run.smithi146.stdout:(109/133): libsepol-devel-2.9-1.el8.x86_64.rpm 4.1 MB/s | 86 kB 00:00 2020-11-20T11:45:11.755 INFO:teuthology.orchestra.run.smithi146.stdout:(110/133): libaio-devel-0.3.112-1.el8.x86_64.rp 754 kB/s | 19 kB 00:00 2020-11-20T11:45:11.756 INFO:teuthology.orchestra.run.smithi146.stdout:(111/133): libselinux-devel-2.9-3.el8.x86_64.rp 7.5 MB/s | 199 kB 00:00 2020-11-20T11:45:11.760 INFO:teuthology.orchestra.run.smithi146.stdout:(112/133): python3-cryptography-2.3-3.el8.x86_6 20 MB/s | 511 kB 00:00 2020-11-20T11:45:11.771 INFO:teuthology.orchestra.run.smithi146.stdout:(113/133): zlib-devel-1.2.11-16.el8_2.x86_64.rp 2.1 MB/s | 57 kB 00:00 2020-11-20T11:45:11.784 INFO:teuthology.orchestra.run.smithi146.stdout:(114/133): libuuid-devel-2.32.1-24.el8.x86_64.r 4.8 MB/s | 96 kB 00:00 2020-11-20T11:45:11.797 INFO:teuthology.orchestra.run.smithi146.stdout:(115/133): libxslt-1.1.32-5.el8.x86_64.rpm 9.6 MB/s | 250 kB 00:00 2020-11-20T11:45:11.809 INFO:teuthology.orchestra.run.smithi146.stdout:(116/133): libcom_err-devel-1.45.6-1.el8.x86_64 1.5 MB/s | 38 kB 00:00 2020-11-20T11:45:11.822 INFO:teuthology.orchestra.run.smithi146.stdout:(117/133): libquadmath-8.3.1-5.1.el8.x86_64.rpm 6.7 MB/s | 169 kB 00:00 2020-11-20T11:45:11.838 INFO:teuthology.orchestra.run.smithi146.stdout:(118/133): pcre2-devel-10.32-2.el8.x86_64.rpm 21 MB/s | 605 kB 00:00 2020-11-20T11:45:11.857 INFO:teuthology.orchestra.run.smithi146.stdout:(119/133): libgfortran-8.3.1-5.1.el8.x86_64.rpm 20 MB/s | 639 kB 00:00 2020-11-20T11:45:11.865 INFO:teuthology.orchestra.run.smithi146.stdout:(120/133): elfutils-libelf-devel-0.180-1.el8.x8 2.1 MB/s | 58 kB 00:00 2020-11-20T11:45:11.879 INFO:teuthology.orchestra.run.smithi146.stdout:(121/133): pcre2-utf32-10.32-2.el8.x86_64.rpm 9.8 MB/s | 220 kB 00:00 2020-11-20T11:45:11.892 INFO:teuthology.orchestra.run.smithi146.stdout:(122/133): pcre2-utf16-10.32-2.el8.x86_64.rpm 8.1 MB/s | 229 kB 00:00 2020-11-20T11:45:11.911 INFO:teuthology.orchestra.run.smithi146.stdout:(123/133): krb5-devel-1.18.2-5.el8.x86_64.rpm 17 MB/s | 558 kB 00:00 2020-11-20T11:45:11.918 INFO:teuthology.orchestra.run.smithi146.stdout:(124/133): xfsprogs-devel-5.0.0-4.el8.x86_64.rp 3.2 MB/s | 69 kB 00:00 2020-11-20T11:45:11.936 INFO:teuthology.orchestra.run.smithi146.stdout:(125/133): librabbitmq-0.9.0-2.el8.x86_64.rpm 1.8 MB/s | 47 kB 00:00 2020-11-20T11:45:11.955 INFO:teuthology.orchestra.run.smithi146.stdout:(126/133): openssl-devel-1.1.1g-11.el8.x86_64.r 64 MB/s | 2.3 MB 00:00 2020-11-20T11:45:12.672 INFO:teuthology.orchestra.run.smithi146.stdout:(127/133): librbd1-16.0.0-7397.gb86e691b.el8.x8 3.4 MB/s | 2.4 MB 00:00 2020-11-20T11:45:13.003 INFO:teuthology.orchestra.run.smithi146.stdout:(128/133): ceph-test-16.0.0-7397.gb86e691b.el8. 9.3 MB/s | 48 MB 00:05 2020-11-20T11:45:13.084 INFO:teuthology.orchestra.run.smithi146.stdout:(129/133): librados2-16.0.0-7397.gb86e691b.el8. 3.2 MB/s | 3.7 MB 00:01 2020-11-20T11:45:13.114 INFO:teuthology.orchestra.run.smithi146.stdout:(130/133): NetworkManager-tui-1.26.0-9.el8_3.x8 2.8 MB/s | 320 kB 00:00 2020-11-20T11:45:13.121 INFO:teuthology.orchestra.run.smithi146.stdout:(131/133): NetworkManager-libnm-1.26.0-9.el8_3. 3.9 MB/s | 1.7 MB 00:00 2020-11-20T11:45:13.129 INFO:teuthology.orchestra.run.smithi146.stdout:(132/133): NetworkManager-team-1.26.0-9.el8_3.x 3.7 MB/s | 141 kB 00:00 2020-11-20T11:45:13.152 INFO:teuthology.orchestra.run.smithi146.stdout:(133/133): NetworkManager-1.26.0-9.el8_3.x86_64 65 MB/s | 2.4 MB 00:00 2020-11-20T11:45:13.155 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2020-11-20T11:45:13.155 INFO:teuthology.orchestra.run.smithi146.stdout:Total 25 MB/s | 199 MB 00:08 2020-11-20T11:45:13.215 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2020-11-20T11:45:13.346 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2020-11-20T11:45:13.347 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2020-11-20T11:45:13.943 INFO:teuthology.orchestra.run.smithi087.stdout:(8/133): ceph-radosgw-16.0.0-7397.gb86e691b.el8 3.0 MB/s | 12 MB 00:03 2020-11-20T11:45:14.019 INFO:teuthology.orchestra.run.smithi087.stdout:(9/133): ceph-selinux-16.0.0-7397.gb86e691b.el8 326 kB/s | 25 kB 00:00 2020-11-20T11:45:14.353 INFO:teuthology.orchestra.run.smithi192.stdout:(7/133): ceph-mon-16.0.0-7397.gb86e691b.el8.x86 1.4 MB/s | 5.0 MB 00:03 2020-11-20T11:45:15.048 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2020-11-20T11:45:15.051 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2020-11-20T11:45:16.571 INFO:teuthology.orchestra.run.smithi087.stdout:(10/133): ceph-osd-16.0.0-7397.gb86e691b.el8.x8 2.2 MB/s | 18 MB 00:08 2020-11-20T11:45:16.638 INFO:teuthology.orchestra.run.smithi087.stdout:(11/133): libcephfs-devel-16.0.0-7397.gb86e691b 357 kB/s | 24 kB 00:00 2020-11-20T11:45:16.819 INFO:teuthology.orchestra.run.smithi087.stdout:(12/133): libcephfs2-16.0.0-7397.gb86e691b.el8. 3.0 MB/s | 562 kB 00:00 2020-11-20T11:45:16.883 INFO:teuthology.orchestra.run.smithi087.stdout:(13/133): librados-devel-16.0.0-7397.gb86e691b. 2.1 MB/s | 131 kB 00:00 2020-11-20T11:45:17.061 INFO:teuthology.orchestra.run.smithi087.stdout:(14/133): libradosstriper1-16.0.0-7397.gb86e691 2.6 MB/s | 486 kB 00:00 2020-11-20T11:45:18.006 INFO:teuthology.orchestra.run.smithi192.stdout:(8/133): ceph-common-16.0.0-7397.gb86e691b.el8. 1.8 MB/s | 23 MB 00:12 2020-11-20T11:45:18.150 INFO:teuthology.orchestra.run.smithi192.stdout:(9/133): ceph-radosgw-16.0.0-7397.gb86e691b.el8 3.1 MB/s | 12 MB 00:03 2020-11-20T11:45:18.150 INFO:teuthology.orchestra.run.smithi192.stdout:(10/133): ceph-selinux-16.0.0-7397.gb86e691b.el 228 kB/s | 25 kB 00:00 2020-11-20T11:45:18.164 INFO:teuthology.orchestra.run.smithi087.stdout:(15/133): ceph-common-16.0.0-7397.gb86e691b.el8 1.8 MB/s | 23 MB 00:12 2020-11-20T11:45:18.180 INFO:teuthology.orchestra.run.smithi192.stdout:(11/133): libcephfs-devel-16.0.0-7397.gb86e691b 361 kB/s | 24 kB 00:00 2020-11-20T11:45:18.245 INFO:teuthology.orchestra.run.smithi087.stdout:(16/133): librgw2-16.0.0-7397.gb86e691b.el8.x86 3.1 MB/s | 3.7 MB 00:01 2020-11-20T11:45:18.245 INFO:teuthology.orchestra.run.smithi087.stdout:(17/133): python3-ceph-argparse-16.0.0-7397.gb8 481 kB/s | 40 kB 00:00 2020-11-20T11:45:18.311 INFO:teuthology.orchestra.run.smithi192.stdout:(12/133): libcephfs2-16.0.0-7397.gb86e691b.el8. 4.2 MB/s | 562 kB 00:00 2020-11-20T11:45:18.313 INFO:teuthology.orchestra.run.smithi087.stdout:(18/133): python3-ceph-common-16.0.0-7397.gb86e 1.0 MB/s | 73 kB 00:00 2020-11-20T11:45:18.320 INFO:teuthology.orchestra.run.smithi087.stdout:(19/133): python3-cephfs-16.0.0-7397.gb86e691b. 2.7 MB/s | 204 kB 00:00 2020-11-20T11:45:18.376 INFO:teuthology.orchestra.run.smithi192.stdout:(13/133): librados-devel-16.0.0-7397.gb86e691b. 2.0 MB/s | 131 kB 00:00 2020-11-20T11:45:18.459 INFO:teuthology.orchestra.run.smithi087.stdout:(20/133): python3-rados-16.0.0-7397.gb86e691b.e 2.5 MB/s | 375 kB 00:00 2020-11-20T11:45:18.465 INFO:teuthology.orchestra.run.smithi087.stdout:(21/133): python3-rbd-16.0.0-7397.gb86e691b.el8 2.4 MB/s | 353 kB 00:00 2020-11-20T11:45:18.502 INFO:teuthology.orchestra.run.smithi192.stdout:(14/133): libradosstriper1-16.0.0-7397.gb86e691 3.7 MB/s | 486 kB 00:00 2020-11-20T11:45:18.511 INFO:teuthology.orchestra.run.smithi087.stdout:(22/133): python3-rgw-16.0.0-7397.gb86e691b.el8 2.1 MB/s | 113 kB 00:00 2020-11-20T11:45:18.528 INFO:teuthology.orchestra.run.smithi087.stdout:(23/133): rbd-fuse-16.0.0-7397.gb86e691b.el8.x8 1.4 MB/s | 88 kB 00:00 2020-11-20T11:45:18.612 INFO:teuthology.orchestra.run.smithi087.stdout:(24/133): rbd-nbd-16.0.0-7397.gb86e691b.el8.x86 2.0 MB/s | 171 kB 00:00 2020-11-20T11:45:18.677 INFO:teuthology.orchestra.run.smithi087.stdout:(25/133): ceph-grafana-dashboards-16.0.0-7397.g 374 kB/s | 24 kB 00:00 2020-11-20T11:45:18.744 INFO:teuthology.orchestra.run.smithi087.stdout:(26/133): ceph-mgr-cephadm-16.0.0-7397.gb86e691 987 kB/s | 66 kB 00:00 2020-11-20T11:45:19.088 INFO:teuthology.orchestra.run.smithi192.stdout:(15/133): librgw2-16.0.0-7397.gb86e691b.el8.x86 6.3 MB/s | 3.7 MB 00:00 2020-11-20T11:45:19.151 INFO:teuthology.orchestra.run.smithi192.stdout:(16/133): python3-ceph-argparse-16.0.0-7397.gb8 627 kB/s | 40 kB 00:00 2020-11-20T11:45:19.165 INFO:teuthology.orchestra.run.smithi087.stdout:(27/133): rbd-mirror-16.0.0-7397.gb86e691b.el8. 4.9 MB/s | 3.2 MB 00:00 2020-11-20T11:45:19.207 INFO:teuthology.orchestra.run.smithi192.stdout:(17/133): python3-ceph-common-16.0.0-7397.gb86e 1.3 MB/s | 73 kB 00:00 2020-11-20T11:45:19.283 INFO:teuthology.orchestra.run.smithi192.stdout:(18/133): python3-cephfs-16.0.0-7397.gb86e691b. 2.7 MB/s | 204 kB 00:00 2020-11-20T11:45:19.374 INFO:teuthology.orchestra.run.smithi192.stdout:(19/133): python3-rados-16.0.0-7397.gb86e691b.e 4.0 MB/s | 375 kB 00:00 2020-11-20T11:45:19.453 INFO:teuthology.orchestra.run.smithi192.stdout:(20/133): python3-rbd-16.0.0-7397.gb86e691b.el8 4.4 MB/s | 353 kB 00:00 2020-11-20T11:45:19.524 INFO:teuthology.orchestra.run.smithi192.stdout:(21/133): python3-rgw-16.0.0-7397.gb86e691b.el8 1.6 MB/s | 113 kB 00:00 2020-11-20T11:45:19.543 INFO:teuthology.orchestra.run.smithi087.stdout:(28/133): ceph-mgr-dashboard-16.0.0-7397.gb86e6 4.0 MB/s | 3.2 MB 00:00 2020-11-20T11:45:19.589 INFO:teuthology.orchestra.run.smithi192.stdout:(22/133): rbd-fuse-16.0.0-7397.gb86e691b.el8.x8 1.3 MB/s | 88 kB 00:00 2020-11-20T11:45:19.617 INFO:teuthology.orchestra.run.smithi087.stdout:(29/133): ceph-mgr-modules-core-16.0.0-7397.gb8 2.6 MB/s | 198 kB 00:00 2020-11-20T11:45:19.671 INFO:teuthology.orchestra.run.smithi087.stdout:(30/133): ceph-mgr-rook-16.0.0-7397.gb86e691b.e 503 kB/s | 27 kB 00:00 2020-11-20T11:45:19.702 INFO:teuthology.orchestra.run.smithi192.stdout:(23/133): ceph-osd-16.0.0-7397.gb86e691b.el8.x8 2.2 MB/s | 18 MB 00:07 2020-11-20T11:45:19.732 INFO:teuthology.orchestra.run.smithi087.stdout:(31/133): ceph-prometheus-alerts-16.0.0-7397.gb 145 kB/s | 8.8 kB 00:00 2020-11-20T11:45:19.812 INFO:teuthology.orchestra.run.smithi192.stdout:(24/133): rbd-nbd-16.0.0-7397.gb86e691b.el8.x86 1.5 MB/s | 171 kB 00:00 2020-11-20T11:45:19.814 INFO:teuthology.orchestra.run.smithi087.stdout:(32/133): cephadm-16.0.0-7397.gb86e691b.el8.noa 699 kB/s | 57 kB 00:00 2020-11-20T11:45:19.882 INFO:teuthology.orchestra.run.smithi192.stdout:(25/133): ceph-grafana-dashboards-16.0.0-7397.g 341 kB/s | 24 kB 00:00 2020-11-20T11:45:19.913 INFO:teuthology.orchestra.run.smithi087.stdout:(33/133): fmt-6.2.1-1.el8.x86_64.rpm 1.2 MB/s | 116 kB 00:00 2020-11-20T11:45:19.953 INFO:teuthology.orchestra.run.smithi192.stdout:(26/133): ceph-mgr-cephadm-16.0.0-7397.gb86e691 940 kB/s | 66 kB 00:00 2020-11-20T11:45:19.954 INFO:teuthology.orchestra.run.smithi087.stdout:(34/133): gperftools-libs-2.7-6.el8.x86_64.rpm 7.5 MB/s | 315 kB 00:00 2020-11-20T11:45:19.976 INFO:teuthology.orchestra.run.smithi087.stdout:(35/133): leveldb-1.22-1.el8.x86_64.rpm 8.5 MB/s | 181 kB 00:00 2020-11-20T11:45:19.996 INFO:teuthology.orchestra.run.smithi087.stdout:(36/133): liboath-2.6.2-3.el8.x86_64.rpm 2.9 MB/s | 59 kB 00:00 2020-11-20T11:45:20.016 INFO:teuthology.orchestra.run.smithi087.stdout:(37/133): libunwind-1.3.1-3.el8.x86_64.rpm 3.7 MB/s | 75 kB 00:00 2020-11-20T11:45:20.036 INFO:teuthology.orchestra.run.smithi087.stdout:(38/133): python3-apipkg-1.5-6.el8.noarch.rpm 1.1 MB/s | 21 kB 00:00 2020-11-20T11:45:20.057 INFO:teuthology.orchestra.run.smithi087.stdout:(39/133): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 2.0 MB/s | 44 kB 00:00 2020-11-20T11:45:20.064 INFO:teuthology.orchestra.run.smithi192.stdout:(27/133): rbd-mirror-16.0.0-7397.gb86e691b.el8. 6.7 MB/s | 3.2 MB 00:00 2020-11-20T11:45:20.079 INFO:teuthology.orchestra.run.smithi087.stdout:(40/133): python3-beautifulsoup4-4.6.3-2.el8.1. 8.7 MB/s | 185 kB 00:00 2020-11-20T11:45:20.096 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2020-11-20T11:45:20.097 INFO:teuthology.orchestra.run.smithi087.stdout:(41/133): python3-cachetools-3.1.1-4.el8.noarch 1.6 MB/s | 33 kB 00:00 2020-11-20T11:45:20.118 INFO:teuthology.orchestra.run.smithi087.stdout:(42/133): python3-certifi-2018.10.15-7.el8.noar 820 kB/s | 16 kB 00:00 2020-11-20T11:45:20.141 INFO:teuthology.orchestra.run.smithi087.stdout:(43/133): python3-cheroot-8.2.1-1.el8.noarch.rp 6.7 MB/s | 145 kB 00:00 2020-11-20T11:45:20.142 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: fmt-6.2.1-1.el8.x86_64 1/1 2020-11-20T11:45:20.179 INFO:teuthology.orchestra.run.smithi087.stdout:(44/133): python3-cherrypy-18.4.0-1.el8.noarch. 9.5 MB/s | 384 kB 00:00 2020-11-20T11:45:20.199 INFO:teuthology.orchestra.run.smithi087.stdout:(45/133): python3-cssselect-0.9.2-10.el8.noarch 2.0 MB/s | 40 kB 00:00 2020-11-20T11:45:20.221 INFO:teuthology.orchestra.run.smithi087.stdout:(46/133): python3-execnet-1.7.1-1.el8.noarch.rp 16 MB/s | 355 kB 00:00 2020-11-20T11:45:20.241 INFO:teuthology.orchestra.run.smithi087.stdout:(47/133): python3-google-auth-1.1.1-10.el8.noar 3.9 MB/s | 81 kB 00:00 2020-11-20T11:45:20.261 INFO:teuthology.orchestra.run.smithi087.stdout:(48/133): python3-jaraco-6.2-6.el8.noarch.rpm 570 kB/s | 11 kB 00:00 2020-11-20T11:45:20.281 INFO:teuthology.orchestra.run.smithi087.stdout:(49/133): python3-jaraco-functools-2.0-4.el8.no 886 kB/s | 18 kB 00:00 2020-11-20T11:45:20.334 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/139 2020-11-20T11:45:20.343 INFO:teuthology.orchestra.run.smithi087.stdout:(50/133): python3-kubernetes-11.0.0-2.el8.noarc 19 MB/s | 1.2 MB 00:00 2020-11-20T11:45:20.363 INFO:teuthology.orchestra.run.smithi087.stdout:(51/133): python3-logutils-0.3.5-11.el8.noarch. 2.4 MB/s | 49 kB 00:00 2020-11-20T11:45:20.383 INFO:teuthology.orchestra.run.smithi087.stdout:(52/133): python3-more-itertools-7.2.0-3.el8.no 2.9 MB/s | 59 kB 00:00 2020-11-20T11:45:20.405 INFO:teuthology.orchestra.run.smithi087.stdout:(53/133): python3-pecan-1.3.2-9.el8.noarch.rpm 13 MB/s | 283 kB 00:00 2020-11-20T11:45:20.424 INFO:teuthology.orchestra.run.smithi087.stdout:(54/133): python3-portend-2.6-1.el8.noarch.rpm 795 kB/s | 16 kB 00:00 2020-11-20T11:45:20.445 INFO:teuthology.orchestra.run.smithi087.stdout:(55/133): python3-remoto-1.1.4-4.el8.noarch.rpm 2.3 MB/s | 48 kB 00:00 2020-11-20T11:45:20.463 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/139 2020-11-20T11:45:20.464 INFO:teuthology.orchestra.run.smithi087.stdout:(56/133): python3-repoze-lru-0.7-6.el8.noarch.r 1.7 MB/s | 34 kB 00:00 2020-11-20T11:45:20.486 INFO:teuthology.orchestra.run.smithi087.stdout:(57/133): python3-routes-2.4.1-12.el8.noarch.rp 9.1 MB/s | 196 kB 00:00 2020-11-20T11:45:20.507 INFO:teuthology.orchestra.run.smithi087.stdout:(58/133): python3-rsa-3.4.2-15.el8.noarch.rpm 3.6 MB/s | 73 kB 00:00 2020-11-20T11:45:20.530 INFO:teuthology.orchestra.run.smithi087.stdout:(59/133): python3-simplegeneric-0.8.1-17.el8.no 940 kB/s | 19 kB 00:00 2020-11-20T11:45:20.547 INFO:teuthology.orchestra.run.smithi087.stdout:(60/133): python3-singledispatch-3.4.0.3-18.el8 1.2 MB/s | 24 kB 00:00 2020-11-20T11:45:20.566 INFO:teuthology.orchestra.run.smithi087.stdout:(61/133): python3-tempora-1.14.1-5.el8.noarch.r 1.4 MB/s | 29 kB 00:00 2020-11-20T11:45:20.607 INFO:teuthology.orchestra.run.smithi087.stdout:(62/133): ceph-mgr-diskprediction-local-16.0.0- 6.0 MB/s | 8.6 MB 00:01 2020-11-20T11:45:20.608 INFO:teuthology.orchestra.run.smithi087.stdout:(63/133): python3-trustme-0.6.0-4.el8.noarch.rp 661 kB/s | 27 kB 00:00 2020-11-20T11:45:20.626 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : leveldb-1.22-1.el8.x86_64 3/139 2020-11-20T11:45:20.629 INFO:teuthology.orchestra.run.smithi087.stdout:(64/133): python3-webob-1.8.5-1.el8.1.noarch.rp 12 MB/s | 251 kB 00:00 2020-11-20T11:45:20.649 INFO:teuthology.orchestra.run.smithi087.stdout:(65/133): python3-websocket-client-0.56.0-5.el8 3.0 MB/s | 61 kB 00:00 2020-11-20T11:45:20.670 INFO:teuthology.orchestra.run.smithi087.stdout:(66/133): python3-webtest-2.0.33-1.el8.noarch.r 4.1 MB/s | 85 kB 00:00 2020-11-20T11:45:20.690 INFO:teuthology.orchestra.run.smithi087.stdout:(67/133): python3-zc-lockfile-2.0-2.el8.noarch. 1.1 MB/s | 23 kB 00:00 2020-11-20T11:45:20.710 INFO:teuthology.orchestra.run.smithi087.stdout:(68/133): xmlstarlet-1.6.1-11.el8.x86_64.rpm 3.3 MB/s | 69 kB 00:00 2020-11-20T11:45:20.727 INFO:teuthology.orchestra.run.smithi087.stdout:(69/133): python3-waitress-1.2.1-2.el8.1.noarch 2.0 MB/s | 241 kB 00:00 2020-11-20T11:45:20.741 INFO:teuthology.orchestra.run.smithi087.stdout:(70/133): python3-cffi-1.11.5-5.el8.x86_64.rpm 7.6 MB/s | 238 kB 00:00 2020-11-20T11:45:20.761 INFO:teuthology.orchestra.run.smithi087.stdout:(71/133): libverto-devel-0.3.0-5.el8.x86_64.rpm 528 kB/s | 18 kB 00:00 2020-11-20T11:45:20.767 INFO:teuthology.orchestra.run.smithi087.stdout:(72/133): python3-asn1crypto-0.24.0-3.el8.noarc 6.8 MB/s | 181 kB 00:00 2020-11-20T11:45:20.788 INFO:teuthology.orchestra.run.smithi087.stdout:(73/133): python3-requests-oauthlib-1.0.0-1.el8 1.5 MB/s | 43 kB 00:00 2020-11-20T11:45:20.796 INFO:teuthology.orchestra.run.smithi087.stdout:(74/133): fuse-2.9.7-12.el8.x86_64.rpm 3.3 MB/s | 83 kB 00:00 2020-11-20T11:45:20.806 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librabbitmq-0.9.0-2.el8.x86_64 4/139 2020-11-20T11:45:20.808 INFO:teuthology.orchestra.run.smithi087.stdout:(75/133): python3-pycparser-2.14-14.el8.noarch. 5.5 MB/s | 109 kB 00:00 2020-11-20T11:45:20.818 INFO:teuthology.orchestra.run.smithi087.stdout:(76/133): keyutils-libs-devel-1.5.10-6.el8.x86_ 2.0 MB/s | 48 kB 00:00 2020-11-20T11:45:20.835 INFO:teuthology.orchestra.run.smithi087.stdout:(77/133): python3-jwt-1.6.1-2.el8.noarch.rpm 1.8 MB/s | 43 kB 00:00 2020-11-20T11:45:20.843 INFO:teuthology.orchestra.run.smithi087.stdout:(78/133): python3-oauthlib-2.1.0-1.el8.noarch.r 6.2 MB/s | 155 kB 00:00 2020-11-20T11:45:20.855 INFO:teuthology.orchestra.run.smithi087.stdout:(79/133): fuse-common-3.2.1-12.el8.x86_64.rpm 1.0 MB/s | 21 kB 00:00 2020-11-20T11:45:20.867 INFO:teuthology.orchestra.run.smithi087.stdout:(80/133): libsepol-devel-2.9-1.el8.x86_64.rpm 3.6 MB/s | 86 kB 00:00 2020-11-20T11:45:20.878 INFO:teuthology.orchestra.run.smithi087.stdout:(81/133): libaio-devel-0.3.112-1.el8.x86_64.rpm 965 kB/s | 19 kB 00:00 2020-11-20T11:45:20.890 INFO:teuthology.orchestra.run.smithi087.stdout:(82/133): libselinux-devel-2.9-3.el8.x86_64.rpm 8.1 MB/s | 199 kB 00:00 2020-11-20T11:45:20.910 INFO:teuthology.orchestra.run.smithi087.stdout:(83/133): python3-cryptography-2.3-3.el8.x86_64 19 MB/s | 511 kB 00:00 2020-11-20T11:45:20.917 INFO:teuthology.orchestra.run.smithi087.stdout:(84/133): zlib-devel-1.2.11-16.el8_2.x86_64.rpm 2.2 MB/s | 57 kB 00:00 2020-11-20T11:45:20.929 INFO:teuthology.orchestra.run.smithi087.stdout:(85/133): libuuid-devel-2.32.1-24.el8.x86_64.rp 4.8 MB/s | 96 kB 00:00 2020-11-20T11:45:20.942 INFO:teuthology.orchestra.run.smithi087.stdout:(86/133): libxslt-1.1.32-5.el8.x86_64.rpm 9.8 MB/s | 250 kB 00:00 2020-11-20T11:45:20.958 INFO:teuthology.orchestra.run.smithi087.stdout:(87/133): libcom_err-devel-1.45.6-1.el8.x86_64. 1.5 MB/s | 38 kB 00:00 2020-11-20T11:45:20.966 INFO:teuthology.orchestra.run.smithi087.stdout:(88/133): libquadmath-8.3.1-5.1.el8.x86_64.rpm 6.8 MB/s | 169 kB 00:00 2020-11-20T11:45:20.979 INFO:teuthology.orchestra.run.smithi192.stdout:(28/133): ceph-mgr-dashboard-16.0.0-7397.gb86e6 3.1 MB/s | 3.2 MB 00:01 2020-11-20T11:45:20.980 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/139 2020-11-20T11:45:20.986 INFO:teuthology.orchestra.run.smithi087.stdout:(89/133): pcre2-devel-10.32-2.el8.x86_64.rpm 21 MB/s | 605 kB 00:00 2020-11-20T11:45:21.003 INFO:teuthology.orchestra.run.smithi087.stdout:(90/133): libgfortran-8.3.1-5.1.el8.x86_64.rpm 18 MB/s | 639 kB 00:00 2020-11-20T11:45:21.008 INFO:teuthology.orchestra.run.smithi087.stdout:(91/133): elfutils-libelf-devel-0.180-1.el8.x86 2.5 MB/s | 58 kB 00:00 2020-11-20T11:45:21.026 INFO:teuthology.orchestra.run.smithi087.stdout:(92/133): pcre2-utf32-10.32-2.el8.x86_64.rpm 8.6 MB/s | 220 kB 00:00 2020-11-20T11:45:21.034 INFO:teuthology.orchestra.run.smithi087.stdout:(93/133): pcre2-utf16-10.32-2.el8.x86_64.rpm 8.8 MB/s | 229 kB 00:00 2020-11-20T11:45:21.049 INFO:teuthology.orchestra.run.smithi192.stdout:(29/133): ceph-mgr-modules-core-16.0.0-7397.gb8 2.8 MB/s | 198 kB 00:00 2020-11-20T11:45:21.054 INFO:teuthology.orchestra.run.smithi087.stdout:(94/133): krb5-devel-1.18.2-5.el8.x86_64.rpm 20 MB/s | 558 kB 00:00 2020-11-20T11:45:21.061 INFO:teuthology.orchestra.run.smithi087.stdout:(95/133): xfsprogs-devel-5.0.0-4.el8.x86_64.rpm 2.5 MB/s | 69 kB 00:00 2020-11-20T11:45:21.078 INFO:teuthology.orchestra.run.smithi087.stdout:(96/133): librabbitmq-0.9.0-2.el8.x86_64.rpm 1.9 MB/s | 47 kB 00:00 2020-11-20T11:45:21.103 INFO:teuthology.orchestra.run.smithi087.stdout:(97/133): openssl-devel-1.1.1g-11.el8.x86_64.rp 56 MB/s | 2.3 MB 00:00 2020-11-20T11:45:21.111 INFO:teuthology.orchestra.run.smithi087.stdout:(98/133): automake-1.16.1-6.el8.noarch.rpm 21 MB/s | 713 kB 00:00 2020-11-20T11:45:21.118 INFO:teuthology.orchestra.run.smithi192.stdout:(30/133): ceph-mgr-rook-16.0.0-7397.gb86e691b.e 392 kB/s | 27 kB 00:00 2020-11-20T11:45:21.129 INFO:teuthology.orchestra.run.smithi087.stdout:(99/133): python3-webencodings-0.5.1-6.el8.noar 1.0 MB/s | 27 kB 00:00 2020-11-20T11:45:21.151 INFO:teuthology.orchestra.run.smithi087.stdout:(100/133): python3-lxml-4.2.3-1.el8.x86_64.rpm 38 MB/s | 1.5 MB 00:00 2020-11-20T11:45:21.152 INFO:teuthology.orchestra.run.smithi087.stdout:(101/133): jq-1.5-12.el8.x86_64.rpm 6.9 MB/s | 161 kB 00:00 2020-11-20T11:45:21.175 INFO:teuthology.orchestra.run.smithi087.stdout:(102/133): python3-pyOpenSSL-18.0.0-1.el8.noarc 4.2 MB/s | 103 kB 00:00 2020-11-20T11:45:21.185 INFO:teuthology.orchestra.run.smithi087.stdout:(103/133): python3-werkzeug-0.12.2-4.el8.noarch 14 MB/s | 457 kB 00:00 2020-11-20T11:45:21.186 INFO:teuthology.orchestra.run.smithi192.stdout:(31/133): ceph-prometheus-alerts-16.0.0-7397.gb 131 kB/s | 8.8 kB 00:00 2020-11-20T11:45:21.197 INFO:teuthology.orchestra.run.smithi087.stdout:(104/133): python3-mako-1.0.6-13.el8.noarch.rpm 7.1 MB/s | 157 kB 00:00 2020-11-20T11:45:21.209 INFO:teuthology.orchestra.run.smithi087.stdout:(105/133): python3-jsonpatch-1.21-2.el8.noarch. 1.3 MB/s | 27 kB 00:00 2020-11-20T11:45:21.224 INFO:teuthology.orchestra.run.smithi087.stdout:(106/133): python3-jsonpointer-1.10-11.el8.noar 908 kB/s | 20 kB 00:00 2020-11-20T11:45:21.237 INFO:teuthology.orchestra.run.smithi087.stdout:(107/133): python3-html5lib-0.999999999-6.el8.n 8.7 MB/s | 214 kB 00:00 2020-11-20T11:45:21.244 INFO:teuthology.orchestra.run.smithi087.stdout:(108/133): python3-pyasn1-0.3.7-6.el8.noarch.rp 5.0 MB/s | 126 kB 00:00 2020-11-20T11:45:21.256 INFO:teuthology.orchestra.run.smithi192.stdout:(32/133): cephadm-16.0.0-7397.gb86e691b.el8.noa 826 kB/s | 57 kB 00:00 2020-11-20T11:45:21.257 INFO:teuthology.orchestra.run.smithi087.stdout:(109/133): python3-pytz-2017.2-9.el8.noarch.rpm 2.7 MB/s | 54 kB 00:00 2020-11-20T11:45:21.268 INFO:teuthology.orchestra.run.smithi087.stdout:(110/133): python3-pyasn1-modules-0.3.7-6.el8.n 4.5 MB/s | 110 kB 00:00 2020-11-20T11:45:21.281 INFO:teuthology.orchestra.run.smithi087.stdout:(111/133): python3-prettytable-0.7.2-14.el8.noa 2.1 MB/s | 44 kB 00:00 2020-11-20T11:45:21.292 INFO:teuthology.orchestra.run.smithi087.stdout:(112/133): python3-markupsafe-0.23-19.el8.x86_6 1.6 MB/s | 39 kB 00:00 2020-11-20T11:45:21.310 INFO:teuthology.orchestra.run.smithi087.stdout:(113/133): flex-2.6.1-9.el8.x86_64.rpm 13 MB/s | 320 kB 00:00 2020-11-20T11:45:21.319 INFO:teuthology.orchestra.run.smithi087.stdout:(114/133): librdkafka-0.11.4-1.el8.x86_64.rpm 13 MB/s | 353 kB 00:00 2020-11-20T11:45:21.339 INFO:teuthology.orchestra.run.smithi087.stdout:(115/133): bison-3.0.4-10.el8.x86_64.rpm 24 MB/s | 688 kB 00:00 2020-11-20T11:45:21.354 INFO:teuthology.orchestra.run.smithi192.stdout:(33/133): fmt-6.2.1-1.el8.x86_64.rpm 1.2 MB/s | 116 kB 00:00 2020-11-20T11:45:21.354 INFO:teuthology.orchestra.run.smithi087.stdout:(116/133): libtool-2.4.6-25.el8.x86_64.rpm 23 MB/s | 709 kB 00:00 2020-11-20T11:45:21.368 INFO:teuthology.orchestra.run.smithi087.stdout:(117/133): python3-jinja2-2.10.1-2.el8_0.noarch 18 MB/s | 538 kB 00:00 2020-11-20T11:45:21.382 INFO:teuthology.orchestra.run.smithi192.stdout:(34/133): ceph-mgr-diskprediction-local-16.0.0- 6.5 MB/s | 8.6 MB 00:01 2020-11-20T11:45:21.383 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/139 2020-11-20T11:45:21.390 INFO:teuthology.orchestra.run.smithi087.stdout:(118/133): python3-numpy-f2py-1.14.3-9.el8.x86_ 10 MB/s | 225 kB 00:00 2020-11-20T11:45:21.422 INFO:teuthology.orchestra.run.smithi192.stdout:(35/133): gperftools-libs-2.7-6.el8.x86_64.rpm 4.5 MB/s | 315 kB 00:00 2020-11-20T11:45:21.442 INFO:teuthology.orchestra.run.smithi192.stdout:(36/133): liboath-2.6.2-3.el8.x86_64.rpm 2.9 MB/s | 59 kB 00:00 2020-11-20T11:45:21.448 INFO:teuthology.orchestra.run.smithi087.stdout:(119/133): python3-babel-2.5.1-5.el8.noarch.rpm 83 MB/s | 4.8 MB 00:00 2020-11-20T11:45:21.462 INFO:teuthology.orchestra.run.smithi192.stdout:(37/133): libunwind-1.3.1-3.el8.x86_64.rpm 3.7 MB/s | 75 kB 00:00 2020-11-20T11:45:21.463 INFO:teuthology.orchestra.run.smithi192.stdout:(38/133): leveldb-1.22-1.el8.x86_64.rpm 2.2 MB/s | 181 kB 00:00 2020-11-20T11:45:21.471 INFO:teuthology.orchestra.run.smithi087.stdout:(120/133): lttng-ust-2.8.1-11.el8.x86_64.rpm 11 MB/s | 259 kB 00:00 2020-11-20T11:45:21.480 INFO:teuthology.orchestra.run.smithi192.stdout:(39/133): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 2.6 MB/s | 44 kB 00:00 2020-11-20T11:45:21.482 INFO:teuthology.orchestra.run.smithi192.stdout:(40/133): python3-apipkg-1.5-6.el8.noarch.rpm 1.0 MB/s | 21 kB 00:00 2020-11-20T11:45:21.502 INFO:teuthology.orchestra.run.smithi192.stdout:(41/133): python3-cachetools-3.1.1-4.el8.noarch 1.6 MB/s | 33 kB 00:00 2020-11-20T11:45:21.513 INFO:teuthology.orchestra.run.smithi192.stdout:(42/133): python3-beautifulsoup4-4.6.3-2.el8.1. 5.6 MB/s | 185 kB 00:00 2020-11-20T11:45:21.522 INFO:teuthology.orchestra.run.smithi192.stdout:(43/133): python3-certifi-2018.10.15-7.el8.noar 819 kB/s | 16 kB 00:00 2020-11-20T11:45:21.531 INFO:teuthology.orchestra.run.smithi192.stdout:(44/133): python3-cheroot-8.2.1-1.el8.noarch.rp 7.9 MB/s | 145 kB 00:00 2020-11-20T11:45:21.549 INFO:teuthology.orchestra.run.smithi192.stdout:(45/133): python3-cssselect-0.9.2-10.el8.noarch 2.4 MB/s | 40 kB 00:00 2020-11-20T11:45:21.563 INFO:teuthology.orchestra.run.smithi192.stdout:(46/133): python3-cherrypy-18.4.0-1.el8.noarch. 9.4 MB/s | 384 kB 00:00 2020-11-20T11:45:21.571 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 6/139 2020-11-20T11:45:21.582 INFO:teuthology.orchestra.run.smithi192.stdout:(47/133): python3-execnet-1.7.1-1.el8.noarch.rp 11 MB/s | 355 kB 00:00 2020-11-20T11:45:21.583 INFO:teuthology.orchestra.run.smithi087.stdout:(121/133): python3-scipy-1.0.0-20.module+el8.1. 63 MB/s | 15 MB 00:00 2020-11-20T11:45:21.584 INFO:teuthology.orchestra.run.smithi192.stdout:(48/133): python3-google-auth-1.1.1-10.el8.noar 3.9 MB/s | 81 kB 00:00 2020-11-20T11:45:21.597 INFO:teuthology.orchestra.run.smithi192.stdout:(49/133): python3-jaraco-6.2-6.el8.noarch.rpm 687 kB/s | 11 kB 00:00 2020-11-20T11:45:21.603 INFO:teuthology.orchestra.run.smithi192.stdout:(50/133): python3-jaraco-functools-2.0-4.el8.no 902 kB/s | 18 kB 00:00 2020-11-20T11:45:21.625 INFO:teuthology.orchestra.run.smithi192.stdout:(51/133): python3-logutils-0.3.5-11.el8.noarch. 2.4 MB/s | 49 kB 00:00 2020-11-20T11:45:21.653 INFO:teuthology.orchestra.run.smithi087.stdout:(122/133): python3-numpy-1.14.3-9.el8.x86_64.rp 24 MB/s | 3.7 MB 00:00 2020-11-20T11:45:21.654 INFO:teuthology.orchestra.run.smithi192.stdout:(52/133): python3-more-itertools-7.2.0-3.el8.no 2.9 MB/s | 59 kB 00:00 2020-11-20T11:45:21.654 INFO:teuthology.orchestra.run.smithi192.stdout:(53/133): python3-kubernetes-11.0.0-2.el8.noarc 22 MB/s | 1.2 MB 00:00 2020-11-20T11:45:21.655 INFO:teuthology.orchestra.run.smithi087.stdout:(123/133): openblas-threads-0.3.3-5.el8.x86_64. 65 MB/s | 4.4 MB 00:00 2020-11-20T11:45:21.665 INFO:teuthology.orchestra.run.smithi192.stdout:(54/133): python3-pecan-1.3.2-9.el8.noarch.rpm 13 MB/s | 283 kB 00:00 2020-11-20T11:45:21.666 INFO:teuthology.orchestra.run.smithi192.stdout:(55/133): python3-portend-2.6-1.el8.noarch.rpm 959 kB/s | 16 kB 00:00 2020-11-20T11:45:21.678 INFO:teuthology.orchestra.run.smithi087.stdout:(124/133): socat-1.7.3.3-2.el8.x86_64.rpm 13 MB/s | 302 kB 00:00 2020-11-20T11:45:21.683 INFO:teuthology.orchestra.run.smithi192.stdout:(56/133): python3-repoze-lru-0.7-6.el8.noarch.r 2.0 MB/s | 34 kB 00:00 2020-11-20T11:45:21.684 INFO:teuthology.orchestra.run.smithi192.stdout:(57/133): python3-remoto-1.1.4-4.el8.noarch.rpm 2.4 MB/s | 48 kB 00:00 2020-11-20T11:45:21.691 INFO:teuthology.orchestra.run.smithi087.stdout:(125/133): openblas-0.3.3-5.el8.x86_64.rpm 65 MB/s | 4.3 MB 00:00 2020-11-20T11:45:21.701 INFO:teuthology.orchestra.run.smithi192.stdout:(58/133): python3-routes-2.4.1-12.el8.noarch.rp 11 MB/s | 196 kB 00:00 2020-11-20T11:45:21.706 INFO:teuthology.orchestra.run.smithi192.stdout:(59/133): python3-rsa-3.4.2-15.el8.noarch.rpm 3.5 MB/s | 73 kB 00:00 2020-11-20T11:45:21.710 INFO:teuthology.orchestra.run.smithi087.stdout:(126/133): oniguruma-6.8.2-2.el8.x86_64.rpm 5.7 MB/s | 187 kB 00:00 2020-11-20T11:45:21.717 INFO:teuthology.orchestra.run.smithi192.stdout:(60/133): python3-simplegeneric-0.8.1-17.el8.no 1.1 MB/s | 19 kB 00:00 2020-11-20T11:45:21.725 INFO:teuthology.orchestra.run.smithi192.stdout:(61/133): python3-singledispatch-3.4.0.3-18.el8 1.2 MB/s | 24 kB 00:00 2020-11-20T11:45:21.734 INFO:teuthology.orchestra.run.smithi192.stdout:(62/133): python3-tempora-1.14.1-5.el8.noarch.r 1.7 MB/s | 29 kB 00:00 2020-11-20T11:45:21.745 INFO:teuthology.orchestra.run.smithi192.stdout:(63/133): python3-trustme-0.6.0-4.el8.noarch.rp 1.3 MB/s | 27 kB 00:00 2020-11-20T11:45:21.752 INFO:teuthology.orchestra.run.smithi192.stdout:(64/133): python3-waitress-1.2.1-2.el8.1.noarch 13 MB/s | 241 kB 00:00 2020-11-20T11:45:21.767 INFO:teuthology.orchestra.run.smithi192.stdout:(65/133): python3-webob-1.8.5-1.el8.1.noarch.rp 11 MB/s | 251 kB 00:00 2020-11-20T11:45:21.769 INFO:teuthology.orchestra.run.smithi192.stdout:(66/133): python3-websocket-client-0.56.0-5.el8 3.6 MB/s | 61 kB 00:00 2020-11-20T11:45:21.786 INFO:teuthology.orchestra.run.smithi192.stdout:(67/133): python3-zc-lockfile-2.0-2.el8.noarch. 1.4 MB/s | 23 kB 00:00 2020-11-20T11:45:21.787 INFO:teuthology.orchestra.run.smithi192.stdout:(68/133): python3-webtest-2.0.33-1.el8.noarch.r 4.1 MB/s | 85 kB 00:00 2020-11-20T11:45:21.804 INFO:teuthology.orchestra.run.smithi192.stdout:(69/133): xmlstarlet-1.6.1-11.el8.x86_64.rpm 3.6 MB/s | 69 kB 00:00 2020-11-20T11:45:21.823 INFO:teuthology.orchestra.run.smithi192.stdout:(70/133): python3-cffi-1.11.5-5.el8.x86_64.rpm 6.4 MB/s | 238 kB 00:00 2020-11-20T11:45:21.840 INFO:teuthology.orchestra.run.smithi192.stdout:(71/133): libverto-devel-0.3.0-5.el8.x86_64.rpm 502 kB/s | 18 kB 00:00 2020-11-20T11:45:21.842 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 6/139 2020-11-20T11:45:21.847 INFO:teuthology.orchestra.run.smithi192.stdout:(72/133): python3-asn1crypto-0.24.0-3.el8.noarc 7.5 MB/s | 181 kB 00:00 2020-11-20T11:45:21.864 INFO:teuthology.orchestra.run.smithi192.stdout:(73/133): python3-requests-oauthlib-1.0.0-1.el8 1.7 MB/s | 43 kB 00:00 2020-11-20T11:45:21.872 INFO:teuthology.orchestra.run.smithi192.stdout:(74/133): fuse-2.9.7-12.el8.x86_64.rpm 3.2 MB/s | 83 kB 00:00 2020-11-20T11:45:21.890 INFO:teuthology.orchestra.run.smithi192.stdout:(75/133): python3-pycparser-2.14-14.el8.noarch. 4.2 MB/s | 109 kB 00:00 2020-11-20T11:45:21.897 INFO:teuthology.orchestra.run.smithi192.stdout:(76/133): keyutils-libs-devel-1.5.10-6.el8.x86_ 1.9 MB/s | 48 kB 00:00 2020-11-20T11:45:21.915 INFO:teuthology.orchestra.run.smithi192.stdout:(77/133): python3-jwt-1.6.1-2.el8.noarch.rpm 1.7 MB/s | 43 kB 00:00 2020-11-20T11:45:21.923 INFO:teuthology.orchestra.run.smithi192.stdout:(78/133): python3-oauthlib-2.1.0-1.el8.noarch.r 6.1 MB/s | 155 kB 00:00 2020-11-20T11:45:21.934 INFO:teuthology.orchestra.run.smithi192.stdout:(79/133): fuse-common-3.2.1-12.el8.x86_64.rpm 1.1 MB/s | 21 kB 00:00 2020-11-20T11:45:21.945 INFO:teuthology.orchestra.run.smithi192.stdout:(80/133): libsepol-devel-2.9-1.el8.x86_64.rpm 3.6 MB/s | 86 kB 00:00 2020-11-20T11:45:21.957 INFO:teuthology.orchestra.run.smithi192.stdout:(81/133): libaio-devel-0.3.112-1.el8.x86_64.rpm 809 kB/s | 19 kB 00:00 2020-11-20T11:45:21.970 INFO:teuthology.orchestra.run.smithi192.stdout:(82/133): libselinux-devel-2.9-3.el8.x86_64.rpm 8.0 MB/s | 199 kB 00:00 2020-11-20T11:45:21.984 INFO:teuthology.orchestra.run.smithi192.stdout:(83/133): python3-cryptography-2.3-3.el8.x86_64 19 MB/s | 511 kB 00:00 2020-11-20T11:45:21.995 INFO:teuthology.orchestra.run.smithi192.stdout:(84/133): zlib-devel-1.2.11-16.el8_2.x86_64.rpm 2.7 MB/s | 57 kB 00:00 2020-11-20T11:45:22.008 INFO:teuthology.orchestra.run.smithi192.stdout:(85/133): libuuid-devel-2.32.1-24.el8.x86_64.rp 4.8 MB/s | 96 kB 00:00 2020-11-20T11:45:22.032 INFO:teuthology.orchestra.run.smithi192.stdout:(86/133): libcom_err-devel-1.45.6-1.el8.x86_64. 1.6 MB/s | 38 kB 00:00 2020-11-20T11:45:22.040 INFO:teuthology.orchestra.run.smithi192.stdout:(87/133): libxslt-1.1.32-5.el8.x86_64.rpm 5.5 MB/s | 250 kB 00:00 2020-11-20T11:45:22.052 INFO:teuthology.orchestra.run.smithi192.stdout:(88/133): libquadmath-8.3.1-5.1.el8.x86_64.rpm 8.1 MB/s | 169 kB 00:00 2020-11-20T11:45:22.054 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 7/139 2020-11-20T11:45:22.074 INFO:teuthology.orchestra.run.smithi192.stdout:(89/133): pcre2-devel-10.32-2.el8.x86_64.rpm 17 MB/s | 605 kB 00:00 2020-11-20T11:45:22.084 INFO:teuthology.orchestra.run.smithi192.stdout:(90/133): libgfortran-8.3.1-5.1.el8.x86_64.rpm 19 MB/s | 639 kB 00:00 2020-11-20T11:45:22.096 INFO:teuthology.orchestra.run.smithi192.stdout:(91/133): elfutils-libelf-devel-0.180-1.el8.x86 2.6 MB/s | 58 kB 00:00 2020-11-20T11:45:22.113 INFO:teuthology.orchestra.run.smithi192.stdout:(92/133): pcre2-utf32-10.32-2.el8.x86_64.rpm 8.8 MB/s | 220 kB 00:00 2020-11-20T11:45:22.121 INFO:teuthology.orchestra.run.smithi192.stdout:(93/133): pcre2-utf16-10.32-2.el8.x86_64.rpm 8.8 MB/s | 229 kB 00:00 2020-11-20T11:45:22.141 INFO:teuthology.orchestra.run.smithi192.stdout:(94/133): krb5-devel-1.18.2-5.el8.x86_64.rpm 20 MB/s | 558 kB 00:00 2020-11-20T11:45:22.148 INFO:teuthology.orchestra.run.smithi192.stdout:(95/133): xfsprogs-devel-5.0.0-4.el8.x86_64.rpm 2.6 MB/s | 69 kB 00:00 2020-11-20T11:45:22.151 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 7/139 2020-11-20T11:45:22.165 INFO:teuthology.orchestra.run.smithi192.stdout:(96/133): librabbitmq-0.9.0-2.el8.x86_64.rpm 1.9 MB/s | 47 kB 00:00 2020-11-20T11:45:22.190 INFO:teuthology.orchestra.run.smithi192.stdout:(97/133): openssl-devel-1.1.1g-11.el8.x86_64.rp 55 MB/s | 2.3 MB 00:00 2020-11-20T11:45:22.199 INFO:teuthology.orchestra.run.smithi192.stdout:(98/133): automake-1.16.1-6.el8.noarch.rpm 21 MB/s | 713 kB 00:00 2020-11-20T11:45:22.217 INFO:teuthology.orchestra.run.smithi192.stdout:(99/133): python3-webencodings-0.5.1-6.el8.noar 1.0 MB/s | 27 kB 00:00 2020-11-20T11:45:22.239 INFO:teuthology.orchestra.run.smithi192.stdout:(100/133): python3-lxml-4.2.3-1.el8.x86_64.rpm 38 MB/s | 1.5 MB 00:00 2020-11-20T11:45:22.241 INFO:teuthology.orchestra.run.smithi192.stdout:(101/133): jq-1.5-12.el8.x86_64.rpm 6.7 MB/s | 161 kB 00:00 2020-11-20T11:45:22.263 INFO:teuthology.orchestra.run.smithi192.stdout:(102/133): python3-pyOpenSSL-18.0.0-1.el8.noarc 4.2 MB/s | 103 kB 00:00 2020-11-20T11:45:22.273 INFO:teuthology.orchestra.run.smithi192.stdout:(103/133): python3-werkzeug-0.12.2-4.el8.noarch 14 MB/s | 457 kB 00:00 2020-11-20T11:45:22.288 INFO:teuthology.orchestra.run.smithi192.stdout:(104/133): python3-mako-1.0.6-13.el8.noarch.rpm 6.3 MB/s | 157 kB 00:00 2020-11-20T11:45:22.304 INFO:teuthology.orchestra.run.smithi192.stdout:(105/133): python3-jsonpatch-1.21-2.el8.noarch. 952 kB/s | 27 kB 00:00 2020-11-20T11:45:22.312 INFO:teuthology.orchestra.run.smithi192.stdout:(106/133): python3-jsonpointer-1.10-11.el8.noar 827 kB/s | 20 kB 00:00 2020-11-20T11:45:22.331 INFO:teuthology.orchestra.run.smithi192.stdout:(107/133): python3-html5lib-0.999999999-6.el8.n 8.1 MB/s | 214 kB 00:00 2020-11-20T11:45:22.338 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 8/139 2020-11-20T11:45:22.340 INFO:teuthology.orchestra.run.smithi192.stdout:(108/133): python3-pyasn1-0.3.7-6.el8.noarch.rp 4.5 MB/s | 126 kB 00:00 2020-11-20T11:45:22.366 INFO:teuthology.orchestra.run.smithi192.stdout:(109/133): python3-pyasn1-modules-0.3.7-6.el8.n 4.4 MB/s | 110 kB 00:00 2020-11-20T11:45:22.385 INFO:teuthology.orchestra.run.smithi192.stdout:(110/133): python3-prettytable-0.7.2-14.el8.noa 2.1 MB/s | 44 kB 00:00 2020-11-20T11:45:22.387 INFO:teuthology.orchestra.run.smithi192.stdout:(111/133): python3-pytz-2017.2-9.el8.noarch.rpm 953 kB/s | 54 kB 00:00 2020-11-20T11:45:22.409 INFO:teuthology.orchestra.run.smithi192.stdout:(112/133): python3-markupsafe-0.23-19.el8.x86_6 1.6 MB/s | 39 kB 00:00 2020-11-20T11:45:22.421 INFO:teuthology.orchestra.run.smithi192.stdout:(113/133): flex-2.6.1-9.el8.x86_64.rpm 12 MB/s | 320 kB 00:00 2020-11-20T11:45:22.423 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 8/139 2020-11-20T11:45:22.437 INFO:teuthology.orchestra.run.smithi192.stdout:(114/133): librdkafka-0.11.4-1.el8.x86_64.rpm 13 MB/s | 353 kB 00:00 2020-11-20T11:45:22.447 INFO:teuthology.orchestra.run.smithi192.stdout:(115/133): bison-3.0.4-10.el8.x86_64.rpm 24 MB/s | 688 kB 00:00 2020-11-20T11:45:22.448 INFO:teuthology.orchestra.run.smithi087.stdout:(127/133): librbd1-16.0.0-7397.gb86e691b.el8.x8 3.3 MB/s | 2.4 MB 00:00 2020-11-20T11:45:22.467 INFO:teuthology.orchestra.run.smithi192.stdout:(116/133): libtool-2.4.6-25.el8.x86_64.rpm 23 MB/s | 709 kB 00:00 2020-11-20T11:45:22.477 INFO:teuthology.orchestra.run.smithi192.stdout:(117/133): python3-jinja2-2.10.1-2.el8_0.noarch 20 MB/s | 538 kB 00:00 2020-11-20T11:45:22.478 INFO:teuthology.orchestra.run.smithi087.stdout:(128/133): NetworkManager-libnm-1.26.0-9.el8_3. 59 MB/s | 1.7 MB 00:00 2020-11-20T11:45:22.499 INFO:teuthology.orchestra.run.smithi087.stdout:(129/133): NetworkManager-tui-1.26.0-9.el8_3.x8 15 MB/s | 320 kB 00:00 2020-11-20T11:45:22.503 INFO:teuthology.orchestra.run.smithi192.stdout:(118/133): python3-numpy-f2py-1.14.3-9.el8.x86_ 10 MB/s | 225 kB 00:00 2020-11-20T11:45:22.521 INFO:teuthology.orchestra.run.smithi087.stdout:(130/133): NetworkManager-team-1.26.0-9.el8_3.x 6.6 MB/s | 141 kB 00:00 2020-11-20T11:45:22.555 INFO:teuthology.orchestra.run.smithi087.stdout:(131/133): NetworkManager-1.26.0-9.el8_3.x86_64 69 MB/s | 2.4 MB 00:00 2020-11-20T11:45:22.562 INFO:teuthology.orchestra.run.smithi192.stdout:(119/133): python3-babel-2.5.1-5.el8.noarch.rpm 81 MB/s | 4.8 MB 00:00 2020-11-20T11:45:22.583 INFO:teuthology.orchestra.run.smithi192.stdout:(120/133): lttng-ust-2.8.1-11.el8.x86_64.rpm 12 MB/s | 259 kB 00:00 2020-11-20T11:45:22.628 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 9/139 2020-11-20T11:45:22.701 INFO:teuthology.orchestra.run.smithi192.stdout:(121/133): python3-scipy-1.0.0-20.module+el8.1. 62 MB/s | 15 MB 00:00 2020-11-20T11:45:22.748 INFO:teuthology.orchestra.run.smithi087.stdout:(132/133): librados2-16.0.0-7397.gb86e691b.el8. 3.5 MB/s | 3.7 MB 00:01 2020-11-20T11:45:22.787 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 10/139 2020-11-20T11:45:23.090 INFO:teuthology.orchestra.run.smithi192.stdout:(122/133): ceph-test-16.0.0-7397.gb86e691b.el8. 9.6 MB/s | 48 MB 00:04 2020-11-20T11:45:23.103 INFO:teuthology.orchestra.run.smithi192.stdout:(123/133): python3-numpy-1.14.3-9.el8.x86_64.rp 7.2 MB/s | 3.7 MB 00:00 2020-11-20T11:45:23.135 INFO:teuthology.orchestra.run.smithi192.stdout:(124/133): socat-1.7.3.3-2.el8.x86_64.rpm 11 MB/s | 302 kB 00:00 2020-11-20T11:45:23.164 INFO:teuthology.orchestra.run.smithi192.stdout:(125/133): openblas-threads-0.3.3-5.el8.x86_64. 9.4 MB/s | 4.4 MB 00:00 2020-11-20T11:45:23.165 INFO:teuthology.orchestra.run.smithi192.stdout:(126/133): oniguruma-6.8.2-2.el8.x86_64.rpm 6.1 MB/s | 187 kB 00:00 2020-11-20T11:45:23.188 INFO:teuthology.orchestra.run.smithi192.stdout:(127/133): openblas-0.3.3-5.el8.x86_64.rpm 44 MB/s | 4.3 MB 00:00 2020-11-20T11:45:23.195 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 10/139 2020-11-20T11:45:23.220 INFO:teuthology.orchestra.run.smithi192.stdout:(128/133): NetworkManager-libnm-1.26.0-9.el8_3. 55 MB/s | 1.7 MB 00:00 2020-11-20T11:45:23.244 INFO:teuthology.orchestra.run.smithi192.stdout:(129/133): NetworkManager-tui-1.26.0-9.el8_3.x8 13 MB/s | 320 kB 00:00 2020-11-20T11:45:23.267 INFO:teuthology.orchestra.run.smithi192.stdout:(130/133): NetworkManager-team-1.26.0-9.el8_3.x 6.2 MB/s | 141 kB 00:00 2020-11-20T11:45:23.308 INFO:teuthology.orchestra.run.smithi192.stdout:(131/133): NetworkManager-1.26.0-9.el8_3.x86_64 59 MB/s | 2.4 MB 00:00 2020-11-20T11:45:23.337 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 11/139 2020-11-20T11:45:23.361 INFO:teuthology.orchestra.run.smithi192.stdout:(132/133): librados2-16.0.0-7397.gb86e691b.el8. 19 MB/s | 3.7 MB 00:00 2020-11-20T11:45:23.456 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 11/139 2020-11-20T11:45:23.596 INFO:teuthology.orchestra.run.smithi192.stdout:(133/133): librbd1-16.0.0-7397.gb86e691b.el8.x8 5.6 MB/s | 2.4 MB 00:00 2020-11-20T11:45:23.599 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2020-11-20T11:45:23.599 INFO:teuthology.orchestra.run.smithi192.stdout:Total 11 MB/s | 199 MB 00:18 2020-11-20T11:45:23.633 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/139 2020-11-20T11:45:23.657 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2020-11-20T11:45:23.759 INFO:teuthology.orchestra.run.smithi087.stdout:(133/133): ceph-test-16.0.0-7397.gb86e691b.el8. 4.9 MB/s | 48 MB 00:09 2020-11-20T11:45:23.892 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/139 2020-11-20T11:45:23.893 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2020-11-20T11:45:23.893 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2020-11-20T11:45:23.893 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2020-11-20T11:45:23.893 INFO:teuthology.orchestra.run.smithi087.stdout:Total 11 MB/s | 199 MB 00:18 2020-11-20T11:45:23.894 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2020-11-20T11:45:23.946 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 14/139 2020-11-20T11:45:23.961 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2020-11-20T11:45:23.962 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2020-11-20T11:45:24.320 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 14/139 2020-11-20T11:45:24.629 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 15/139 2020-11-20T11:45:24.683 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 15/139 2020-11-20T11:45:24.974 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-1:1.26.0-9.el8_3.x86_64 16/139 2020-11-20T11:45:25.254 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : NetworkManager-1:1.26.0-9.el8_3.x86_64 16/139 2020-11-20T11:45:25.400 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2020-11-20T11:45:25.404 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2020-11-20T11:45:25.594 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-1:1.26.0-9.el8_3.x86_64 16/139 2020-11-20T11:45:25.613 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2020-11-20T11:45:25.618 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2020-11-20T11:45:25.762 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libquadmath-8.3.1-5.1.el8.x86_64 17/139 2020-11-20T11:45:25.887 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libquadmath-8.3.1-5.1.el8.x86_64 17/139 2020-11-20T11:45:26.062 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libgfortran-8.3.1-5.1.el8.x86_64 18/139 2020-11-20T11:45:26.559 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libgfortran-8.3.1-5.1.el8.x86_64 18/139 2020-11-20T11:45:26.718 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openblas-threads-0.3.3-5.el8.x86_64 19/139 2020-11-20T11:45:27.213 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: openblas-threads-0.3.3-5.el8.x86_64 19/139 2020-11-20T11:45:27.395 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openblas-0.3.3-5.el8.x86_64 20/139 2020-11-20T11:45:28.108 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: openblas-0.3.3-5.el8.x86_64 20/139 2020-11-20T11:45:28.396 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 21/139 2020-11-20T11:45:28.627 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libxslt-1.1.32-5.el8.x86_64 22/139 2020-11-20T11:45:28.766 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : zlib-devel-1.2.11-16.el8_2.x86_64 23/139 2020-11-20T11:45:28.977 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/139 2020-11-20T11:45:29.577 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 25/139 2020-11-20T11:45:29.848 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/139 2020-11-20T11:45:30.061 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 27/139 2020-11-20T11:45:30.241 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ceph-common-2:16.0.0-7397.gb86e691b.el8. 28/139 2020-11-20T11:45:30.383 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el 29/139 2020-11-20T11:45:30.907 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2020-11-20T11:45:30.956 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: fmt-6.2.1-1.el8.x86_64 1/1 2020-11-20T11:45:31.033 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2020-11-20T11:45:31.106 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: fmt-6.2.1-1.el8.x86_64 1/1 2020-11-20T11:45:31.160 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/139 2020-11-20T11:45:31.298 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_6 30/139 2020-11-20T11:45:31.303 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/139 2020-11-20T11:45:31.319 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/139 2020-11-20T11:45:31.449 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/139 2020-11-20T11:45:31.584 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : leveldb-1.22-1.el8.x86_64 3/139 2020-11-20T11:45:31.633 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 31/139 2020-11-20T11:45:31.669 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : leveldb-1.22-1.el8.x86_64 3/139 2020-11-20T11:45:31.807 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/139 2020-11-20T11:45:31.876 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 32/139 2020-11-20T11:45:31.943 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/139 2020-11-20T11:45:32.128 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/139 2020-11-20T11:45:32.230 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/139 2020-11-20T11:45:32.370 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 34/139 2020-11-20T11:45:32.400 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 5/139 2020-11-20T11:45:32.552 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 35/139 2020-11-20T11:45:32.708 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 5/139 2020-11-20T11:45:32.773 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/139 2020-11-20T11:45:32.915 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 6/139 2020-11-20T11:45:32.984 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 5/139 2020-11-20T11:45:33.035 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 6/139 2020-11-20T11:45:33.215 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 7/139 2020-11-20T11:45:33.257 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 5/139 2020-11-20T11:45:33.315 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 7/139 2020-11-20T11:45:33.460 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 6/139 2020-11-20T11:45:33.538 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 8/139 2020-11-20T11:45:33.559 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 6/139 2020-11-20T11:45:33.673 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 9/139 2020-11-20T11:45:33.752 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 7/139 2020-11-20T11:45:33.755 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 9/139 2020-11-20T11:45:33.832 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 7/139 2020-11-20T11:45:34.027 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 8/139 2020-11-20T11:45:34.226 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 9/139 2020-11-20T11:45:34.259 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librabbitmq-0.9.0-2.el8.x86_64 10/139 2020-11-20T11:45:34.279 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 9/139 2020-11-20T11:45:34.431 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 11/139 2020-11-20T11:45:34.549 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 11/139 2020-11-20T11:45:34.550 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 35/139 2020-11-20T11:45:34.777 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/139 2020-11-20T11:45:34.803 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librabbitmq-0.9.0-2.el8.x86_64 10/139 2020-11-20T11:45:34.950 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/139 2020-11-20T11:45:34.976 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 11/139 2020-11-20T11:45:35.073 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 11/139 2020-11-20T11:45:35.125 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 14/139 2020-11-20T11:45:36.256 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 36/139 2020-11-20T11:45:36.257 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rsa-3.4.2-15.el8.noarch 37/139 2020-11-20T11:45:36.257 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/139 2020-11-20T11:45:36.257 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 39/139 2020-11-20T11:45:36.258 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 40/139 2020-11-20T11:45:36.258 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/139 2020-11-20T11:45:36.258 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/139 2020-11-20T11:45:36.259 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 14/139 2020-11-20T11:45:36.259 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 14/139 2020-11-20T11:45:36.259 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 14/139 2020-11-20T11:45:36.260 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 15/139 2020-11-20T11:45:36.260 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 15/139 2020-11-20T11:45:36.269 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-1:1.26.0-9.el8_3.x86_64 16/139 2020-11-20T11:45:36.292 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 15/139 2020-11-20T11:45:36.314 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_6 41/139 2020-11-20T11:45:36.341 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 15/139 2020-11-20T11:45:36.515 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/139 2020-11-20T11:45:36.517 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : NetworkManager-1:1.26.0-9.el8_3.x86_64 16/139 2020-11-20T11:45:36.611 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-1:1.26.0-9.el8_3.x86_64 16/139 2020-11-20T11:45:36.841 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 43/139 2020-11-20T11:45:36.859 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : NetworkManager-1:1.26.0-9.el8_3.x86_64 16/139 2020-11-20T11:45:36.876 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-1:1.26.0-9.el8_3.x86_64 16/139 2020-11-20T11:45:37.007 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 44/139 2020-11-20T11:45:37.074 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/139 2020-11-20T11:45:37.159 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 45/139 2020-11-20T11:45:37.229 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-1:1.26.0-9.el8_3.x86_64 16/139 2020-11-20T11:45:37.301 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libuuid-devel-2.32.1-24.el8.x86_64 46/139 2020-11-20T11:45:37.325 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/139 2020-11-20T11:45:37.457 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/139 2020-11-20T11:45:37.529 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/139 2020-11-20T11:45:37.559 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 47/139 2020-11-20T11:45:37.689 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libquadmath-8.3.1-5.1.el8.x86_64 20/139 2020-11-20T11:45:37.697 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/139 2020-11-20T11:45:37.737 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libselinux-devel-2.9-3.el8.x86_64 48/139 2020-11-20T11:45:37.738 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 49/139 2020-11-20T11:45:37.738 INFO:teuthology.orchestra.run.smithi146.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-11-20T11:45:37.738 INFO:teuthology.orchestra.run.smithi146.stdout: 2020-11-20T11:45:37.829 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libquadmath-8.3.1-5.1.el8.x86_64 20/139 2020-11-20T11:45:37.923 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/139 2020-11-20T11:45:38.006 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libgfortran-8.3.1-5.1.el8.x86_64 21/139 2020-11-20T11:45:38.059 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libquadmath-8.3.1-5.1.el8.x86_64 20/139 2020-11-20T11:45:38.140 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : fuse-2.9.7-12.el8.x86_64 50/139 2020-11-20T11:45:38.200 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libquadmath-8.3.1-5.1.el8.x86_64 20/139 2020-11-20T11:45:38.309 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 51/139 2020-11-20T11:45:38.351 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libgfortran-8.3.1-5.1.el8.x86_64 21/139 2020-11-20T11:45:38.505 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libgfortran-8.3.1-5.1.el8.x86_64 21/139 2020-11-20T11:45:38.606 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 52/139 2020-11-20T11:45:38.656 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openblas-threads-0.3.3-5.el8.x86_64 22/139 2020-11-20T11:45:38.854 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 53/139 2020-11-20T11:45:38.859 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libgfortran-8.3.1-5.1.el8.x86_64 21/139 2020-11-20T11:45:39.033 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openblas-threads-0.3.3-5.el8.x86_64 22/139 2020-11-20T11:45:39.132 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 54/139 2020-11-20T11:45:39.163 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: openblas-threads-0.3.3-5.el8.x86_64 22/139 2020-11-20T11:45:39.340 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openblas-0.3.3-5.el8.x86_64 23/139 2020-11-20T11:45:39.484 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-asn1crypto-0.24.0-3.el8.noarch 55/139 2020-11-20T11:45:39.537 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: openblas-threads-0.3.3-5.el8.x86_64 22/139 2020-11-20T11:45:39.692 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openblas-0.3.3-5.el8.x86_64 23/139 2020-11-20T11:45:39.730 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cryptography-2.3-3.el8.x86_64 56/139 2020-11-20T11:45:39.904 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyOpenSSL-18.0.0-1.el8.noarch 57/139 2020-11-20T11:45:40.055 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: openblas-0.3.3-5.el8.x86_64 23/139 2020-11-20T11:45:40.184 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 58/139 2020-11-20T11:45:40.353 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 24/139 2020-11-20T11:45:40.401 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: openblas-0.3.3-5.el8.x86_64 23/139 2020-11-20T11:45:40.416 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 59/139 2020-11-20T11:45:40.579 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libxslt-1.1.32-5.el8.x86_64 25/139 2020-11-20T11:45:40.602 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 60/139 2020-11-20T11:45:40.693 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 24/139 2020-11-20T11:45:40.782 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : zlib-devel-1.2.11-16.el8_2.x86_64 26/139 2020-11-20T11:45:40.795 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 61/139 2020-11-20T11:45:40.937 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libxslt-1.1.32-5.el8.x86_64 25/139 2020-11-20T11:45:41.005 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 27/139 2020-11-20T11:45:41.064 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 62/139 2020-11-20T11:45:41.160 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : zlib-devel-1.2.11-16.el8_2.x86_64 26/139 2020-11-20T11:45:41.210 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ceph-common-2:16.0.0-7397.gb86e691b.el8. 28/139 2020-11-20T11:45:41.305 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : krb5-devel-1.18.2-5.el8.x86_64 63/139 2020-11-20T11:45:41.361 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el 29/139 2020-11-20T11:45:41.400 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 27/139 2020-11-20T11:45:41.460 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/139 2020-11-20T11:45:41.561 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_6 30/139 2020-11-20T11:45:41.562 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/139 2020-11-20T11:45:41.579 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ceph-common-2:16.0.0-7397.gb86e691b.el8. 28/139 2020-11-20T11:45:41.732 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el 29/139 2020-11-20T11:45:41.767 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : jq-1.5-12.el8.x86_64 65/139 2020-11-20T11:45:41.824 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 31/139 2020-11-20T11:45:41.930 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_6 30/139 2020-11-20T11:45:41.985 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 66/139 2020-11-20T11:45:41.989 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 32/139 2020-11-20T11:45:42.165 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 31/139 2020-11-20T11:45:42.192 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 67/139 2020-11-20T11:45:42.360 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 68/139 2020-11-20T11:45:42.400 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 32/139 2020-11-20T11:45:42.624 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 69/139 2020-11-20T11:45:42.893 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 70/139 2020-11-20T11:45:43.172 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 71/139 2020-11-20T11:45:43.351 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : automake-1.16.1-6.el8.noarch 72/139 2020-11-20T11:45:43.564 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 73/139 2020-11-20T11:45:43.836 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 74/139 2020-11-20T11:45:44.001 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 32/139 2020-11-20T11:45:44.016 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 75/139 2020-11-20T11:45:44.188 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 76/139 2020-11-20T11:45:44.328 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 77/139 2020-11-20T11:45:44.409 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 32/139 2020-11-20T11:45:44.543 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 78/139 2020-11-20T11:45:44.754 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 79/139 2020-11-20T11:45:44.929 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 80/139 2020-11-20T11:45:45.038 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 33/139 2020-11-20T11:45:45.117 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 81/139 2020-11-20T11:45:45.382 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/139 2020-11-20T11:45:45.404 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 82/139 2020-11-20T11:45:45.444 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 33/139 2020-11-20T11:45:45.606 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 83/139 2020-11-20T11:45:45.646 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/139 2020-11-20T11:45:45.744 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/139 2020-11-20T11:45:45.832 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 84/139 2020-11-20T11:45:45.938 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 36/139 2020-11-20T11:45:46.006 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/139 2020-11-20T11:45:46.099 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-portend-2.6-1.el8.noarch 85/139 2020-11-20T11:45:46.185 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rsa-3.4.2-15.el8.noarch 37/139 2020-11-20T11:45:46.220 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 36/139 2020-11-20T11:45:46.354 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 86/139 2020-11-20T11:45:46.358 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/139 2020-11-20T11:45:46.420 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rsa-3.4.2-15.el8.noarch 37/139 2020-11-20T11:45:46.569 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/139 2020-11-20T11:45:46.597 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 39/139 2020-11-20T11:45:46.689 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 87/139 2020-11-20T11:45:46.840 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 40/139 2020-11-20T11:45:46.842 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 39/139 2020-11-20T11:45:46.930 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 88/139 2020-11-20T11:45:46.937 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 40/139 2020-11-20T11:45:46.965 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_6 41/139 2020-11-20T11:45:47.113 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 42/139 2020-11-20T11:45:47.136 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 89/139 2020-11-20T11:45:47.144 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_6 41/139 2020-11-20T11:45:47.195 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 42/139 2020-11-20T11:45:47.283 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 42/139 2020-11-20T11:45:47.350 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 42/139 2020-11-20T11:45:47.397 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : jq-1.5-12.el8.x86_64 43/139 2020-11-20T11:45:47.458 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 90/139 2020-11-20T11:45:47.555 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/139 2020-11-20T11:45:47.597 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : jq-1.5-12.el8.x86_64 43/139 2020-11-20T11:45:47.725 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 91/139 2020-11-20T11:45:47.737 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 45/139 2020-11-20T11:45:47.757 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/139 2020-11-20T11:45:47.896 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 46/139 2020-11-20T11:45:47.925 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 92/139 2020-11-20T11:45:47.931 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 45/139 2020-11-20T11:45:48.083 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 46/139 2020-11-20T11:45:48.100 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 47/139 2020-11-20T11:45:48.135 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 93/139 2020-11-20T11:45:48.296 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 47/139 2020-11-20T11:45:48.335 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 48/139 2020-11-20T11:45:48.538 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 48/139 2020-11-20T11:45:48.583 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 49/139 2020-11-20T11:45:48.817 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : automake-1.16.1-6.el8.noarch 50/139 2020-11-20T11:45:48.847 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 49/139 2020-11-20T11:45:49.057 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 51/139 2020-11-20T11:45:49.094 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : automake-1.16.1-6.el8.noarch 50/139 2020-11-20T11:45:49.260 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 94/139 2020-11-20T11:45:49.301 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 51/139 2020-11-20T11:45:49.371 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 52/139 2020-11-20T11:45:49.490 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-kubernetes-11.0.0-2.el8.noarch 95/139 2020-11-20T11:45:49.559 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 53/139 2020-11-20T11:45:49.636 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 52/139 2020-11-20T11:45:49.731 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 96/139 2020-11-20T11:45:49.745 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 54/139 2020-11-20T11:45:49.829 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 53/139 2020-11-20T11:45:49.946 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 97/139 2020-11-20T11:45:49.953 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libuuid-devel-2.32.1-24.el8.x86_64 55/139 2020-11-20T11:45:50.006 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 54/139 2020-11-20T11:45:50.172 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libuuid-devel-2.32.1-24.el8.x86_64 55/139 2020-11-20T11:45:50.198 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 98/139 2020-11-20T11:45:50.209 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 56/139 2020-11-20T11:45:50.411 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 99/139 2020-11-20T11:45:50.435 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libselinux-devel-2.9-3.el8.x86_64 57/139 2020-11-20T11:45:50.435 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 58/139 2020-11-20T11:45:50.436 INFO:teuthology.orchestra.run.smithi087.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-11-20T11:45:50.436 INFO:teuthology.orchestra.run.smithi087.stdout: 2020-11-20T11:45:50.471 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 56/139 2020-11-20T11:45:50.601 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 100/139 2020-11-20T11:45:50.684 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libselinux-devel-2.9-3.el8.x86_64 57/139 2020-11-20T11:45:50.684 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 58/139 2020-11-20T11:45:50.685 INFO:teuthology.orchestra.run.smithi192.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-11-20T11:45:50.685 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:45:50.817 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : fuse-2.9.7-12.el8.x86_64 59/139 2020-11-20T11:45:51.012 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 60/139 2020-11-20T11:45:51.053 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : fuse-2.9.7-12.el8.x86_64 59/139 2020-11-20T11:45:51.232 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 60/139 2020-11-20T11:45:51.326 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 61/139 2020-11-20T11:45:51.498 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 61/139 2020-11-20T11:45:51.557 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 62/139 2020-11-20T11:45:51.693 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 62/139 2020-11-20T11:45:51.807 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 63/139 2020-11-20T11:45:51.964 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 63/139 2020-11-20T11:45:52.148 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-asn1crypto-0.24.0-3.el8.noarch 64/139 2020-11-20T11:45:52.291 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-asn1crypto-0.24.0-3.el8.noarch 64/139 2020-11-20T11:45:52.416 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cryptography-2.3-3.el8.x86_64 65/139 2020-11-20T11:45:52.559 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cryptography-2.3-3.el8.x86_64 65/139 2020-11-20T11:45:52.650 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 66/139 2020-11-20T11:45:52.794 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 66/139 2020-11-20T11:45:52.880 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyOpenSSL-18.0.0-1.el8.noarch 67/139 2020-11-20T11:45:53.024 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyOpenSSL-18.0.0-1.el8.noarch 67/139 2020-11-20T11:45:53.127 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 68/139 2020-11-20T11:45:53.238 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 68/139 2020-11-20T11:45:53.311 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 69/139 2020-11-20T11:45:53.449 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 69/139 2020-11-20T11:45:53.498 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 70/139 2020-11-20T11:45:53.651 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 70/139 2020-11-20T11:45:53.687 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 71/139 2020-11-20T11:45:53.842 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 71/139 2020-11-20T11:45:53.923 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : krb5-devel-1.18.2-5.el8.x86_64 72/139 2020-11-20T11:45:54.117 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : krb5-devel-1.18.2-5.el8.x86_64 72/139 2020-11-20T11:45:54.134 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 73/139 2020-11-20T11:45:54.299 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 73/139 2020-11-20T11:45:54.425 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 74/139 2020-11-20T11:45:54.575 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 74/139 2020-11-20T11:45:54.612 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 75/139 2020-11-20T11:45:54.759 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 101/139 2020-11-20T11:45:54.804 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 75/139 2020-11-20T11:45:54.817 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 76/139 2020-11-20T11:45:54.965 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 76/139 2020-11-20T11:45:54.966 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 101/139 2020-11-20T11:45:55.033 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 77/139 2020-11-20T11:45:55.170 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 77/139 2020-11-20T11:45:55.250 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 78/139 2020-11-20T11:45:55.362 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 78/139 2020-11-20T11:45:55.477 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 79/139 2020-11-20T11:45:55.589 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 79/139 2020-11-20T11:45:55.658 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 80/139 2020-11-20T11:45:55.681 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 101/139 2020-11-20T11:45:55.752 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 80/139 2020-11-20T11:45:55.835 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 81/139 2020-11-20T11:45:56.132 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 81/139 2020-11-20T11:45:56.132 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 82/139 2020-11-20T11:45:56.143 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 82/139 2020-11-20T11:45:56.327 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 83/139 2020-11-20T11:45:56.362 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 83/139 2020-11-20T11:45:56.561 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 84/139 2020-11-20T11:45:56.563 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 84/139 2020-11-20T11:45:56.614 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 102/139 2020-11-20T11:45:56.727 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 102/139 2020-11-20T11:45:56.796 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-portend-2.6-1.el8.noarch 85/139 2020-11-20T11:45:56.812 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-portend-2.6-1.el8.noarch 85/139 2020-11-20T11:45:56.865 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 103/139 2020-11-20T11:45:57.034 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 86/139 2020-11-20T11:45:57.066 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 86/139 2020-11-20T11:45:57.405 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 87/139 2020-11-20T11:45:57.425 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 87/139 2020-11-20T11:45:57.683 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 88/139 2020-11-20T11:45:57.691 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 88/139 2020-11-20T11:45:57.874 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 89/139 2020-11-20T11:45:57.914 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 89/139 2020-11-20T11:45:58.189 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 90/139 2020-11-20T11:45:58.652 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 90/139 2020-11-20T11:45:58.653 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 91/139 2020-11-20T11:45:58.653 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 91/139 2020-11-20T11:45:58.653 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 92/139 2020-11-20T11:45:58.654 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 92/139 2020-11-20T11:45:58.869 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 93/139 2020-11-20T11:45:58.870 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 93/139 2020-11-20T11:45:59.995 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 94/139 2020-11-20T11:46:00.012 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 94/139 2020-11-20T11:46:00.196 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-kubernetes-11.0.0-2.el8.noarch 95/139 2020-11-20T11:46:00.211 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-kubernetes-11.0.0-2.el8.noarch 95/139 2020-11-20T11:46:00.446 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 96/139 2020-11-20T11:46:00.460 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 96/139 2020-11-20T11:46:00.660 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 97/139 2020-11-20T11:46:00.726 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 97/139 2020-11-20T11:46:00.899 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 98/139 2020-11-20T11:46:00.934 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 98/139 2020-11-20T11:46:01.109 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 99/139 2020-11-20T11:46:01.140 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 99/139 2020-11-20T11:46:01.297 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 100/139 2020-11-20T11:46:01.345 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 100/139 2020-11-20T11:46:05.345 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 101/139 2020-11-20T11:46:05.371 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 101/139 2020-11-20T11:46:05.548 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 101/139 2020-11-20T11:46:05.561 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 101/139 2020-11-20T11:46:06.277 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 101/139 2020-11-20T11:46:06.281 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 101/139 2020-11-20T11:46:06.592 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 102/139 2020-11-20T11:46:06.689 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 102/139 2020-11-20T11:46:06.838 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 103/139 2020-11-20T11:46:07.144 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 102/139 2020-11-20T11:46:07.227 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 102/139 2020-11-20T11:46:07.410 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 103/139 2020-11-20T11:46:14.543 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 103/139 2020-11-20T11:46:14.544 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /sys 2020-11-20T11:46:14.544 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /proc 2020-11-20T11:46:14.544 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /dev 2020-11-20T11:46:14.544 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /run 2020-11-20T11:46:14.544 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /mnt 2020-11-20T11:46:14.545 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /var/tmp 2020-11-20T11:46:14.545 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /home 2020-11-20T11:46:14.545 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /tmp 2020-11-20T11:46:14.545 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /dev 2020-11-20T11:46:14.546 INFO:teuthology.orchestra.run.smithi146.stdout: 2020-11-20T11:46:14.896 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 104/139 2020-11-20T11:46:15.331 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 104/139 2020-11-20T11:46:15.486 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 105/139 2020-11-20T11:46:17.002 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 105/139 2020-11-20T11:46:17.649 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 106/139 2020-11-20T11:46:17.649 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 106/139 2020-11-20T11:46:19.703 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 107/139 2020-11-20T11:46:19.929 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 107/139 2020-11-20T11:46:20.086 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.e 108/139 2020-11-20T11:46:20.240 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b. 109/139 2020-11-20T11:46:20.412 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 110/139 2020-11-20T11:46:21.313 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 110/139 2020-11-20T11:46:21.560 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 111/139 2020-11-20T11:46:22.603 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 111/139 2020-11-20T11:46:22.771 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 112/139 2020-11-20T11:46:22.857 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 112/139 2020-11-20T11:46:23.220 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el 113/139 2020-11-20T11:46:23.360 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 114/139 2020-11-20T11:46:24.126 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 103/139 2020-11-20T11:46:24.126 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /sys 2020-11-20T11:46:24.126 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /proc 2020-11-20T11:46:24.126 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /dev 2020-11-20T11:46:24.127 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /run 2020-11-20T11:46:24.127 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /mnt 2020-11-20T11:46:24.127 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /var/tmp 2020-11-20T11:46:24.127 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /home 2020-11-20T11:46:24.127 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /tmp 2020-11-20T11:46:24.128 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /dev 2020-11-20T11:46:24.128 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:46:24.128 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 114/139 2020-11-20T11:46:24.129 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 115/139 2020-11-20T11:46:24.129 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 115/139 2020-11-20T11:46:24.286 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 104/139 2020-11-20T11:46:24.376 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 103/139 2020-11-20T11:46:24.377 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /sys 2020-11-20T11:46:24.377 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /proc 2020-11-20T11:46:24.378 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /dev 2020-11-20T11:46:24.378 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /run 2020-11-20T11:46:24.378 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /mnt 2020-11-20T11:46:24.379 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /var/tmp 2020-11-20T11:46:24.379 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /home 2020-11-20T11:46:24.380 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /tmp 2020-11-20T11:46:24.380 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /dev 2020-11-20T11:46:24.381 INFO:teuthology.orchestra.run.smithi087.stdout: 2020-11-20T11:46:24.720 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 104/139 2020-11-20T11:46:24.734 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 104/139 2020-11-20T11:46:24.735 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 116/139 2020-11-20T11:46:24.898 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 105/139 2020-11-20T11:46:25.167 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 104/139 2020-11-20T11:46:25.349 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 105/139 2020-11-20T11:46:25.486 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 117/139 2020-11-20T11:46:25.852 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 117/139 2020-11-20T11:46:26.011 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 118/139 2020-11-20T11:46:26.396 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 105/139 2020-11-20T11:46:26.639 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 106/139 2020-11-20T11:46:26.665 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 106/139 2020-11-20T11:46:26.872 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 105/139 2020-11-20T11:46:27.116 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 106/139 2020-11-20T11:46:27.142 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 106/139 2020-11-20T11:46:28.661 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 107/139 2020-11-20T11:46:28.826 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 107/139 2020-11-20T11:46:28.942 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.e 108/139 2020-11-20T11:46:29.125 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 107/139 2020-11-20T11:46:29.137 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b. 109/139 2020-11-20T11:46:29.276 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 110/139 2020-11-20T11:46:29.475 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 107/139 2020-11-20T11:46:29.640 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.e 108/139 2020-11-20T11:46:29.803 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b. 109/139 2020-11-20T11:46:29.983 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 110/139 2020-11-20T11:46:30.161 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 110/139 2020-11-20T11:46:30.380 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 118/139 2020-11-20T11:46:30.389 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 111/139 2020-11-20T11:46:30.904 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 110/139 2020-11-20T11:46:31.067 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 119/139 2020-11-20T11:46:31.198 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 111/139 2020-11-20T11:46:31.260 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libtool-2.4.6-25.el8.x86_64 120/139 2020-11-20T11:46:31.432 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 111/139 2020-11-20T11:46:31.617 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 112/139 2020-11-20T11:46:31.704 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 112/139 2020-11-20T11:46:31.980 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 120/139 2020-11-20T11:46:32.089 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el 113/139 2020-11-20T11:46:32.239 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 114/139 2020-11-20T11:46:32.242 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 111/139 2020-11-20T11:46:32.269 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 114/139 2020-11-20T11:46:32.288 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openssl-devel-1:1.1.1g-11.el8.x86_64 121/139 2020-11-20T11:46:32.434 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 115/139 2020-11-20T11:46:32.450 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 115/139 2020-11-20T11:46:32.465 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 112/139 2020-11-20T11:46:32.478 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 122/139 2020-11-20T11:46:32.556 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 112/139 2020-11-20T11:46:32.697 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : xfsprogs-devel-5.0.0-4.el8.x86_64 123/139 2020-11-20T11:46:32.831 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_ 124/139 2020-11-20T11:46:32.949 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el 113/139 2020-11-20T11:46:33.031 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : elfutils-libelf-devel-0.180-1.el8.x86_64 125/139 2020-11-20T11:46:33.132 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 114/139 2020-11-20T11:46:33.259 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : NetworkManager-tui-1:1.26.0-9.el8_3.x86_64 126/139 2020-11-20T11:46:33.260 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 114/139 2020-11-20T11:46:33.307 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 115/139 2020-11-20T11:46:33.324 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 115/139 2020-11-20T11:46:33.360 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : NetworkManager-team-1:1.26.0-9.el8_3.x86_64 127/139 2020-11-20T11:46:33.543 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 128/139 2020-11-20T11:46:33.588 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 116/139 2020-11-20T11:46:33.763 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 129/139 2020-11-20T11:46:33.826 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 117/139 2020-11-20T11:46:33.985 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 130/139 2020-11-20T11:46:34.015 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 130/139 2020-11-20T11:46:34.226 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 117/139 2020-11-20T11:46:34.239 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/139 2020-11-20T11:46:34.426 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 118/139 2020-11-20T11:46:34.427 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : bison-3.0.4-10.el8.x86_64 132/139 2020-11-20T11:46:34.489 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 132/139 2020-11-20T11:46:34.509 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 116/139 2020-11-20T11:46:34.685 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flex-2.6.1-9.el8.x86_64 133/139 2020-11-20T11:46:34.710 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 133/139 2020-11-20T11:46:34.811 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : NetworkManager-tui-1:1.26.0-8.el8.x86_64 134/139 2020-11-20T11:46:34.811 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 135/139 2020-11-20T11:46:35.019 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 135/139 2020-11-20T11:46:35.136 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : NetworkManager-team-1:1.26.0-8.el8.x86_64 136/139 2020-11-20T11:46:35.150 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T11:46:35.151 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : NetworkManager-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T11:46:35.433 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 117/139 2020-11-20T11:46:35.613 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T11:46:35.614 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : NetworkManager-libnm-1:1.26.0-8.el8.x86_64 138/139 2020-11-20T11:46:35.804 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: NetworkManager-libnm-1:1.26.0-8.el8.x86_64 138/139 2020-11-20T11:46:35.804 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 139/139 2020-11-20T11:46:35.835 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 117/139 2020-11-20T11:46:35.999 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 118/139 2020-11-20T11:46:36.626 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 139/139 2020-11-20T11:46:36.626 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 1/139 2020-11-20T11:46:36.626 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 2/139 2020-11-20T11:46:36.627 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 3/139 2020-11-20T11:46:36.627 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 4/139 2020-11-20T11:46:36.627 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 5/139 2020-11-20T11:46:36.627 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 6/139 2020-11-20T11:46:36.627 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 7/139 2020-11-20T11:46:36.628 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 8/139 2020-11-20T11:46:36.628 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 9/139 2020-11-20T11:46:36.628 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 10/139 2020-11-20T11:46:36.628 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 11/139 2020-11-20T11:46:36.629 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 12/139 2020-11-20T11:46:36.629 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_ 13/139 2020-11-20T11:46:36.629 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 14/139 2020-11-20T11:46:36.629 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_6 15/139 2020-11-20T11:46:36.629 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 16/139 2020-11-20T11:46:36.630 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 17/139 2020-11-20T11:46:36.630 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el 18/139 2020-11-20T11:46:36.630 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ceph-common-2:16.0.0-7397.gb86e691b.el8. 19/139 2020-11-20T11:46:36.630 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_6 20/139 2020-11-20T11:46:36.630 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 21/139 2020-11-20T11:46:36.630 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 22/139 2020-11-20T11:46:36.631 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 23/139 2020-11-20T11:46:36.631 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 24/139 2020-11-20T11:46:36.631 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 25/139 2020-11-20T11:46:36.631 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 26/139 2020-11-20T11:46:36.631 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b. 27/139 2020-11-20T11:46:36.632 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 28/139 2020-11-20T11:46:36.632 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 29/139 2020-11-20T11:46:36.632 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 30/139 2020-11-20T11:46:36.632 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el 31/139 2020-11-20T11:46:36.632 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 32/139 2020-11-20T11:46:36.633 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.e 33/139 2020-11-20T11:46:36.633 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 34/139 2020-11-20T11:46:36.633 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 35/139 2020-11-20T11:46:36.633 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 36/139 2020-11-20T11:46:36.633 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : leveldb-1.22-1.el8.x86_64 37/139 2020-11-20T11:46:36.634 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/139 2020-11-20T11:46:36.634 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/139 2020-11-20T11:46:36.634 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 40/139 2020-11-20T11:46:36.634 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/139 2020-11-20T11:46:36.634 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/139 2020-11-20T11:46:36.635 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/139 2020-11-20T11:46:36.635 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/139 2020-11-20T11:46:36.635 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 45/139 2020-11-20T11:46:36.635 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/139 2020-11-20T11:46:36.635 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 47/139 2020-11-20T11:46:36.636 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 48/139 2020-11-20T11:46:36.636 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/139 2020-11-20T11:46:36.636 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/139 2020-11-20T11:46:36.636 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/139 2020-11-20T11:46:36.636 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-kubernetes-11.0.0-2.el8.noarch 52/139 2020-11-20T11:46:36.637 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/139 2020-11-20T11:46:36.637 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/139 2020-11-20T11:46:36.637 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 55/139 2020-11-20T11:46:36.637 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-portend-2.6-1.el8.noarch 56/139 2020-11-20T11:46:36.637 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 57/139 2020-11-20T11:46:36.638 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/139 2020-11-20T11:46:36.638 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/139 2020-11-20T11:46:36.638 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rsa-3.4.2-15.el8.noarch 60/139 2020-11-20T11:46:36.638 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/139 2020-11-20T11:46:36.638 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/139 2020-11-20T11:46:36.639 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/139 2020-11-20T11:46:36.639 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/139 2020-11-20T11:46:36.639 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/139 2020-11-20T11:46:36.639 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/139 2020-11-20T11:46:36.639 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/139 2020-11-20T11:46:36.640 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/139 2020-11-20T11:46:36.640 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/139 2020-11-20T11:46:36.640 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 70/139 2020-11-20T11:46:36.640 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : automake-1.16.1-6.el8.noarch 71/139 2020-11-20T11:46:36.640 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 72/139 2020-11-20T11:46:36.641 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 73/139 2020-11-20T11:46:36.641 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : jq-1.5-12.el8.x86_64 74/139 2020-11-20T11:46:36.641 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyOpenSSL-18.0.0-1.el8.noarch 75/139 2020-11-20T11:46:36.641 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 76/139 2020-11-20T11:46:36.641 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 77/139 2020-11-20T11:46:36.642 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 78/139 2020-11-20T11:46:36.642 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 79/139 2020-11-20T11:46:36.642 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 80/139 2020-11-20T11:46:36.642 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 81/139 2020-11-20T11:46:36.642 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 82/139 2020-11-20T11:46:36.643 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 83/139 2020-11-20T11:46:36.643 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 84/139 2020-11-20T11:46:36.643 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 85/139 2020-11-20T11:46:36.643 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flex-2.6.1-9.el8.x86_64 86/139 2020-11-20T11:46:36.643 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 87/139 2020-11-20T11:46:36.643 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : bison-3.0.4-10.el8.x86_64 88/139 2020-11-20T11:46:36.644 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 89/139 2020-11-20T11:46:36.644 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 90/139 2020-11-20T11:46:36.644 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 91/139 2020-11-20T11:46:36.644 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 92/139 2020-11-20T11:46:36.644 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 93/139 2020-11-20T11:46:36.645 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 94/139 2020-11-20T11:46:36.645 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 95/139 2020-11-20T11:46:36.645 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openblas-threads-0.3.3-5.el8.x86_64 96/139 2020-11-20T11:46:36.645 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openblas-0.3.3-5.el8.x86_64 97/139 2020-11-20T11:46:36.645 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 98/139 2020-11-20T11:46:36.646 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 99/139 2020-11-20T11:46:36.646 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 100/139 2020-11-20T11:46:36.646 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 101/139 2020-11-20T11:46:36.646 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-asn1crypto-0.24.0-3.el8.noarch 102/139 2020-11-20T11:46:36.646 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/139 2020-11-20T11:46:36.647 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 104/139 2020-11-20T11:46:36.647 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 105/139 2020-11-20T11:46:36.647 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 106/139 2020-11-20T11:46:36.647 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 107/139 2020-11-20T11:46:36.647 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 108/139 2020-11-20T11:46:36.648 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 109/139 2020-11-20T11:46:36.648 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 110/139 2020-11-20T11:46:36.648 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 111/139 2020-11-20T11:46:36.648 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libselinux-devel-2.9-3.el8.x86_64 112/139 2020-11-20T11:46:36.648 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cryptography-2.3-3.el8.x86_64 113/139 2020-11-20T11:46:36.649 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : zlib-devel-1.2.11-16.el8_2.x86_64 114/139 2020-11-20T11:46:36.649 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libuuid-devel-2.32.1-24.el8.x86_64 115/139 2020-11-20T11:46:36.649 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libxslt-1.1.32-5.el8.x86_64 116/139 2020-11-20T11:46:36.649 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 117/139 2020-11-20T11:46:36.649 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libquadmath-8.3.1-5.1.el8.x86_64 118/139 2020-11-20T11:46:36.650 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 119/139 2020-11-20T11:46:36.650 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libgfortran-8.3.1-5.1.el8.x86_64 120/139 2020-11-20T11:46:36.650 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-libelf-devel-0.180-1.el8.x86_64 121/139 2020-11-20T11:46:36.650 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 122/139 2020-11-20T11:46:36.650 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 123/139 2020-11-20T11:46:36.651 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : krb5-devel-1.18.2-5.el8.x86_64 124/139 2020-11-20T11:46:36.651 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xfsprogs-devel-5.0.0-4.el8.x86_64 125/139 2020-11-20T11:46:36.651 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librabbitmq-0.9.0-2.el8.x86_64 126/139 2020-11-20T11:46:36.651 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-devel-1:1.1.1g-11.el8.x86_64 127/139 2020-11-20T11:46:36.651 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 128/139 2020-11-20T11:46:36.651 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 129/139 2020-11-20T11:46:36.652 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 130/139 2020-11-20T11:46:36.652 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 131/139 2020-11-20T11:46:36.652 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 132/139 2020-11-20T11:46:36.652 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-libnm-1:1.26.0-8.el8.x86_64 133/139 2020-11-20T11:46:36.652 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-tui-1:1.26.0-9.el8_3.x86_64 134/139 2020-11-20T11:46:36.653 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-tui-1:1.26.0-8.el8.x86_64 135/139 2020-11-20T11:46:36.653 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-team-1:1.26.0-9.el8_3.x86_64 136/139 2020-11-20T11:46:36.653 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-team-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T11:46:36.653 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-1:1.26.0-9.el8_3.x86_64 138/139 2020-11-20T11:46:38.676 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : NetworkManager-1:1.26.0-8.el8.x86_64 139/139 2020-11-20T11:46:38.677 INFO:teuthology.orchestra.run.smithi146.stdout:Installed products updated. 2020-11-20T11:46:38.810 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 118/139 2020-11-20T11:46:39.769 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 119/139 2020-11-20T11:46:40.078 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openssl-devel-1:1.1.1g-11.el8.x86_64 120/139 2020-11-20T11:46:40.257 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 121/139 2020-11-20T11:46:40.532 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 118/139 2020-11-20T11:46:40.540 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : xfsprogs-devel-5.0.0-4.el8.x86_64 122/139 2020-11-20T11:46:40.720 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libtool-2.4.6-25.el8.x86_64 123/139 2020-11-20T11:46:40.737 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 123/139 2020-11-20T11:46:40.912 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_ 124/139 2020-11-20T11:46:41.041 INFO:teuthology.orchestra.run.smithi146.stdout: 2020-11-20T11:46:41.042 INFO:teuthology.orchestra.run.smithi146.stdout:Upgraded: 2020-11-20T11:46:41.042 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-1:1.26.0-9.el8_3.x86_64 2020-11-20T11:46:41.042 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 2020-11-20T11:46:41.042 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-team-1:1.26.0-9.el8_3.x86_64 2020-11-20T11:46:41.042 INFO:teuthology.orchestra.run.smithi146.stdout: NetworkManager-tui-1:1.26.0-9.el8_3.x86_64 2020-11-20T11:46:41.043 INFO:teuthology.orchestra.run.smithi146.stdout: librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:41.043 INFO:teuthology.orchestra.run.smithi146.stdout: librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:41.043 INFO:teuthology.orchestra.run.smithi146.stdout: 2020-11-20T11:46:41.043 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2020-11-20T11:46:41.043 INFO:teuthology.orchestra.run.smithi146.stdout: automake-1.16.1-6.el8.noarch 2020-11-20T11:46:41.044 INFO:teuthology.orchestra.run.smithi146.stdout: bison-3.0.4-10.el8.x86_64 2020-11-20T11:46:41.044 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:41.044 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:41.044 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:41.044 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:41.045 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:46:41.045 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-immutable-object-cache-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:41.045 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:41.045 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:41.045 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:46:41.046 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:46:41.046 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:46:41.046 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:46:41.046 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:46:41.046 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:41.047 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:41.047 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:46:41.047 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:41.047 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:41.047 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:41.048 INFO:teuthology.orchestra.run.smithi146.stdout: cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:46:41.048 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libelf-devel-0.180-1.el8.x86_64 2020-11-20T11:46:41.048 INFO:teuthology.orchestra.run.smithi146.stdout: flex-2.6.1-9.el8.x86_64 2020-11-20T11:46:41.048 INFO:teuthology.orchestra.run.smithi146.stdout: fmt-6.2.1-1.el8.x86_64 2020-11-20T11:46:41.048 INFO:teuthology.orchestra.run.smithi146.stdout: fuse-2.9.7-12.el8.x86_64 2020-11-20T11:46:41.049 INFO:teuthology.orchestra.run.smithi146.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-11-20T11:46:41.049 INFO:teuthology.orchestra.run.smithi146.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-11-20T11:46:41.049 INFO:teuthology.orchestra.run.smithi146.stdout: jq-1.5-12.el8.x86_64 2020-11-20T11:46:41.049 INFO:teuthology.orchestra.run.smithi146.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-11-20T11:46:41.049 INFO:teuthology.orchestra.run.smithi146.stdout: krb5-devel-1.18.2-5.el8.x86_64 2020-11-20T11:46:41.050 INFO:teuthology.orchestra.run.smithi146.stdout: leveldb-1.22-1.el8.x86_64 2020-11-20T11:46:41.050 INFO:teuthology.orchestra.run.smithi146.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-11-20T11:46:41.050 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:41.050 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:41.050 INFO:teuthology.orchestra.run.smithi146.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2020-11-20T11:46:41.051 INFO:teuthology.orchestra.run.smithi146.stdout: libgfortran-8.3.1-5.1.el8.x86_64 2020-11-20T11:46:41.051 INFO:teuthology.orchestra.run.smithi146.stdout: liboath-2.6.2-3.el8.x86_64 2020-11-20T11:46:41.051 INFO:teuthology.orchestra.run.smithi146.stdout: libquadmath-8.3.1-5.1.el8.x86_64 2020-11-20T11:46:41.051 INFO:teuthology.orchestra.run.smithi146.stdout: librabbitmq-0.9.0-2.el8.x86_64 2020-11-20T11:46:41.051 INFO:teuthology.orchestra.run.smithi146.stdout: librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:41.052 INFO:teuthology.orchestra.run.smithi146.stdout: libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:41.052 INFO:teuthology.orchestra.run.smithi146.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-11-20T11:46:41.052 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:41.052 INFO:teuthology.orchestra.run.smithi146.stdout: libselinux-devel-2.9-3.el8.x86_64 2020-11-20T11:46:41.052 INFO:teuthology.orchestra.run.smithi146.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-11-20T11:46:41.053 INFO:teuthology.orchestra.run.smithi146.stdout: libtool-2.4.6-25.el8.x86_64 2020-11-20T11:46:41.053 INFO:teuthology.orchestra.run.smithi146.stdout: libunwind-1.3.1-3.el8.x86_64 2020-11-20T11:46:41.053 INFO:teuthology.orchestra.run.smithi146.stdout: libuuid-devel-2.32.1-24.el8.x86_64 2020-11-20T11:46:41.053 INFO:teuthology.orchestra.run.smithi146.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-11-20T11:46:41.053 INFO:teuthology.orchestra.run.smithi146.stdout: libxslt-1.1.32-5.el8.x86_64 2020-11-20T11:46:41.054 INFO:teuthology.orchestra.run.smithi146.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-11-20T11:46:41.054 INFO:teuthology.orchestra.run.smithi146.stdout: oniguruma-6.8.2-2.el8.x86_64 2020-11-20T11:46:41.054 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-0.3.3-5.el8.x86_64 2020-11-20T11:46:41.054 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-threads-0.3.3-5.el8.x86_64 2020-11-20T11:46:41.054 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-devel-1:1.1.1g-11.el8.x86_64 2020-11-20T11:46:41.055 INFO:teuthology.orchestra.run.smithi146.stdout: pcre2-devel-10.32-2.el8.x86_64 2020-11-20T11:46:41.055 INFO:teuthology.orchestra.run.smithi146.stdout: pcre2-utf16-10.32-2.el8.x86_64 2020-11-20T11:46:41.055 INFO:teuthology.orchestra.run.smithi146.stdout: pcre2-utf32-10.32-2.el8.x86_64 2020-11-20T11:46:41.055 INFO:teuthology.orchestra.run.smithi146.stdout: python3-apipkg-1.5-6.el8.noarch 2020-11-20T11:46:41.055 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asn1crypto-0.24.0-3.el8.noarch 2020-11-20T11:46:41.056 INFO:teuthology.orchestra.run.smithi146.stdout: python3-babel-2.5.1-5.el8.noarch 2020-11-20T11:46:41.056 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-11-20T11:46:41.056 INFO:teuthology.orchestra.run.smithi146.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-11-20T11:46:41.056 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-11-20T11:46:41.056 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:41.057 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:41.057 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:41.057 INFO:teuthology.orchestra.run.smithi146.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-11-20T11:46:41.057 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cffi-1.11.5-5.el8.x86_64 2020-11-20T11:46:41.057 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-11-20T11:46:41.058 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-11-20T11:46:41.058 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cryptography-2.3-3.el8.x86_64 2020-11-20T11:46:41.058 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-11-20T11:46:41.058 INFO:teuthology.orchestra.run.smithi146.stdout: python3-execnet-1.7.1-1.el8.noarch 2020-11-20T11:46:41.058 INFO:teuthology.orchestra.run.smithi146.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-11-20T11:46:41.059 INFO:teuthology.orchestra.run.smithi146.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-11-20T11:46:41.059 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-6.2-6.el8.noarch 2020-11-20T11:46:41.059 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-11-20T11:46:41.059 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2020-11-20T11:46:41.059 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-11-20T11:46:41.060 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-11-20T11:46:41.060 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-11-20T11:46:41.060 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes-11.0.0-2.el8.noarch 2020-11-20T11:46:41.060 INFO:teuthology.orchestra.run.smithi146.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-11-20T11:46:41.060 INFO:teuthology.orchestra.run.smithi146.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-11-20T11:46:41.061 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako-1.0.6-13.el8.noarch 2020-11-20T11:46:41.061 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-11-20T11:46:41.061 INFO:teuthology.orchestra.run.smithi146.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-11-20T11:46:41.061 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-11-20T11:46:41.062 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-11-20T11:46:41.062 INFO:teuthology.orchestra.run.smithi146.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-11-20T11:46:41.062 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-11-20T11:46:41.062 INFO:teuthology.orchestra.run.smithi146.stdout: python3-portend-2.6-1.el8.noarch 2020-11-20T11:46:41.063 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-11-20T11:46:41.063 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyOpenSSL-18.0.0-1.el8.noarch 2020-11-20T11:46:41.063 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-11-20T11:46:41.063 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-11-20T11:46:41.063 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pycparser-2.14-14.el8.noarch 2020-11-20T11:46:41.064 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pytz-2017.2-9.el8.noarch 2020-11-20T11:46:41.064 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:41.064 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:41.064 INFO:teuthology.orchestra.run.smithi146.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-11-20T11:46:41.064 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-11-20T11:46:41.065 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-11-20T11:46:41.065 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:41.065 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes-2.4.1-12.el8.noarch 2020-11-20T11:46:41.065 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rsa-3.4.2-15.el8.noarch 2020-11-20T11:46:41.065 INFO:teuthology.orchestra.run.smithi146.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2020-11-20T11:46:41.066 INFO:teuthology.orchestra.run.smithi146.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-11-20T11:46:41.066 INFO:teuthology.orchestra.run.smithi146.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-11-20T11:46:41.066 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-11-20T11:46:41.066 INFO:teuthology.orchestra.run.smithi146.stdout: python3-trustme-0.6.0-4.el8.noarch 2020-11-20T11:46:41.066 INFO:teuthology.orchestra.run.smithi146.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-11-20T11:46:41.067 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-11-20T11:46:41.067 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-11-20T11:46:41.067 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-11-20T11:46:41.067 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-11-20T11:46:41.067 INFO:teuthology.orchestra.run.smithi146.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-11-20T11:46:41.068 INFO:teuthology.orchestra.run.smithi146.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-11-20T11:46:41.068 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:41.068 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:41.068 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:41.068 INFO:teuthology.orchestra.run.smithi146.stdout: socat-1.7.3.3-2.el8.x86_64 2020-11-20T11:46:41.069 INFO:teuthology.orchestra.run.smithi146.stdout: xfsprogs-devel-5.0.0-4.el8.x86_64 2020-11-20T11:46:41.069 INFO:teuthology.orchestra.run.smithi146.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-11-20T11:46:41.069 INFO:teuthology.orchestra.run.smithi146.stdout: zlib-devel-1.2.11-16.el8_2.x86_64 2020-11-20T11:46:41.069 INFO:teuthology.orchestra.run.smithi146.stdout: 2020-11-20T11:46:41.070 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2020-11-20T11:46:41.088 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : elfutils-libelf-devel-0.180-1.el8.x86_64 125/139 2020-11-20T11:46:41.284 DEBUG:teuthology.parallel:result is None 2020-11-20T11:46:41.295 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : NetworkManager-tui-1:1.26.0-9.el8_3.x86_64 126/139 2020-11-20T11:46:41.458 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : NetworkManager-team-1:1.26.0-9.el8_3.x86_64 127/139 2020-11-20T11:46:41.708 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 128/139 2020-11-20T11:46:41.901 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 129/139 2020-11-20T11:46:42.062 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 119/139 2020-11-20T11:46:42.175 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 130/139 2020-11-20T11:46:42.298 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 130/139 2020-11-20T11:46:42.368 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : openssl-devel-1:1.1.1g-11.el8.x86_64 120/139 2020-11-20T11:46:42.499 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/139 2020-11-20T11:46:42.558 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 121/139 2020-11-20T11:46:42.564 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/139 2020-11-20T11:46:42.765 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flex-2.6.1-9.el8.x86_64 132/139 2020-11-20T11:46:42.780 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 132/139 2020-11-20T11:46:42.822 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : xfsprogs-devel-5.0.0-4.el8.x86_64 122/139 2020-11-20T11:46:42.948 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 133/139 2020-11-20T11:46:43.015 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libtool-2.4.6-25.el8.x86_64 123/139 2020-11-20T11:46:43.032 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 123/139 2020-11-20T11:46:43.092 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : NetworkManager-tui-1:1.26.0-8.el8.x86_64 134/139 2020-11-20T11:46:43.093 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 135/139 2020-11-20T11:46:43.194 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_ 124/139 2020-11-20T11:46:43.343 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 135/139 2020-11-20T11:46:43.392 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : elfutils-libelf-devel-0.180-1.el8.x86_64 125/139 2020-11-20T11:46:43.484 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : NetworkManager-team-1:1.26.0-8.el8.x86_64 136/139 2020-11-20T11:46:43.502 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T11:46:43.503 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : NetworkManager-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T11:46:43.550 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : NetworkManager-tui-1:1.26.0-9.el8_3.x86_64 126/139 2020-11-20T11:46:43.748 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : NetworkManager-team-1:1.26.0-9.el8_3.x86_64 127/139 2020-11-20T11:46:43.922 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 128/139 2020-11-20T11:46:43.945 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T11:46:43.945 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : NetworkManager-libnm-1:1.26.0-8.el8.x86_64 138/139 2020-11-20T11:46:44.149 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 129/139 2020-11-20T11:46:44.168 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-libnm-1:1.26.0-8.el8.x86_64 138/139 2020-11-20T11:46:44.169 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 139/139 2020-11-20T11:46:44.398 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 130/139 2020-11-20T11:46:44.517 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 130/139 2020-11-20T11:46:44.714 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/139 2020-11-20T11:46:44.773 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/139 2020-11-20T11:46:44.989 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : flex-2.6.1-9.el8.x86_64 132/139 2020-11-20T11:46:45.018 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 139/139 2020-11-20T11:46:45.019 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 1/139 2020-11-20T11:46:45.019 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 2/139 2020-11-20T11:46:45.019 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 3/139 2020-11-20T11:46:45.020 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 4/139 2020-11-20T11:46:45.020 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 5/139 2020-11-20T11:46:45.020 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 6/139 2020-11-20T11:46:45.020 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 7/139 2020-11-20T11:46:45.021 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 8/139 2020-11-20T11:46:45.021 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 9/139 2020-11-20T11:46:45.021 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 10/139 2020-11-20T11:46:45.022 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 11/139 2020-11-20T11:46:45.022 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 12/139 2020-11-20T11:46:45.022 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_ 13/139 2020-11-20T11:46:45.023 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 14/139 2020-11-20T11:46:45.023 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_6 15/139 2020-11-20T11:46:45.023 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 16/139 2020-11-20T11:46:45.023 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 17/139 2020-11-20T11:46:45.024 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el 18/139 2020-11-20T11:46:45.024 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ceph-common-2:16.0.0-7397.gb86e691b.el8. 19/139 2020-11-20T11:46:45.024 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_6 20/139 2020-11-20T11:46:45.024 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 21/139 2020-11-20T11:46:45.024 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 22/139 2020-11-20T11:46:45.025 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 23/139 2020-11-20T11:46:45.025 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 24/139 2020-11-20T11:46:45.025 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 25/139 2020-11-20T11:46:45.025 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 26/139 2020-11-20T11:46:45.025 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b. 27/139 2020-11-20T11:46:45.026 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 28/139 2020-11-20T11:46:45.026 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 29/139 2020-11-20T11:46:45.026 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 30/139 2020-11-20T11:46:45.026 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el 31/139 2020-11-20T11:46:45.026 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 32/139 2020-11-20T11:46:45.027 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.e 33/139 2020-11-20T11:46:45.027 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 34/139 2020-11-20T11:46:45.027 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 35/139 2020-11-20T11:46:45.027 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 36/139 2020-11-20T11:46:45.027 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : leveldb-1.22-1.el8.x86_64 37/139 2020-11-20T11:46:45.028 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/139 2020-11-20T11:46:45.028 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/139 2020-11-20T11:46:45.028 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 40/139 2020-11-20T11:46:45.028 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/139 2020-11-20T11:46:45.028 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/139 2020-11-20T11:46:45.028 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/139 2020-11-20T11:46:45.029 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/139 2020-11-20T11:46:45.029 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 45/139 2020-11-20T11:46:45.029 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/139 2020-11-20T11:46:45.029 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 47/139 2020-11-20T11:46:45.030 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 48/139 2020-11-20T11:46:45.030 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/139 2020-11-20T11:46:45.030 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/139 2020-11-20T11:46:45.030 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/139 2020-11-20T11:46:45.030 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-kubernetes-11.0.0-2.el8.noarch 52/139 2020-11-20T11:46:45.031 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/139 2020-11-20T11:46:45.031 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/139 2020-11-20T11:46:45.031 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 55/139 2020-11-20T11:46:45.031 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-portend-2.6-1.el8.noarch 56/139 2020-11-20T11:46:45.032 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 57/139 2020-11-20T11:46:45.032 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/139 2020-11-20T11:46:45.032 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/139 2020-11-20T11:46:45.032 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rsa-3.4.2-15.el8.noarch 60/139 2020-11-20T11:46:45.032 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/139 2020-11-20T11:46:45.033 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/139 2020-11-20T11:46:45.033 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/139 2020-11-20T11:46:45.033 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/139 2020-11-20T11:46:45.033 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/139 2020-11-20T11:46:45.033 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/139 2020-11-20T11:46:45.034 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/139 2020-11-20T11:46:45.034 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/139 2020-11-20T11:46:45.034 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/139 2020-11-20T11:46:45.034 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 70/139 2020-11-20T11:46:45.034 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 71/139 2020-11-20T11:46:45.035 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 72/139 2020-11-20T11:46:45.035 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-asn1crypto-0.24.0-3.el8.noarch 73/139 2020-11-20T11:46:45.035 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 74/139 2020-11-20T11:46:45.035 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 75/139 2020-11-20T11:46:45.035 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/139 2020-11-20T11:46:45.036 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 77/139 2020-11-20T11:46:45.036 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 78/139 2020-11-20T11:46:45.036 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 79/139 2020-11-20T11:46:45.036 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 80/139 2020-11-20T11:46:45.036 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 81/139 2020-11-20T11:46:45.037 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/139 2020-11-20T11:46:45.037 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libselinux-devel-2.9-3.el8.x86_64 83/139 2020-11-20T11:46:45.037 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cryptography-2.3-3.el8.x86_64 84/139 2020-11-20T11:46:45.037 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : zlib-devel-1.2.11-16.el8_2.x86_64 85/139 2020-11-20T11:46:45.037 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libuuid-devel-2.32.1-24.el8.x86_64 86/139 2020-11-20T11:46:45.038 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libxslt-1.1.32-5.el8.x86_64 87/139 2020-11-20T11:46:45.038 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 88/139 2020-11-20T11:46:45.038 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libquadmath-8.3.1-5.1.el8.x86_64 89/139 2020-11-20T11:46:45.038 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 90/139 2020-11-20T11:46:45.038 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libgfortran-8.3.1-5.1.el8.x86_64 91/139 2020-11-20T11:46:45.039 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : elfutils-libelf-devel-0.180-1.el8.x86_64 92/139 2020-11-20T11:46:45.039 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 93/139 2020-11-20T11:46:45.039 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 94/139 2020-11-20T11:46:45.039 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : krb5-devel-1.18.2-5.el8.x86_64 95/139 2020-11-20T11:46:45.039 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : xfsprogs-devel-5.0.0-4.el8.x86_64 96/139 2020-11-20T11:46:45.039 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librabbitmq-0.9.0-2.el8.x86_64 97/139 2020-11-20T11:46:45.040 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-devel-1:1.1.1g-11.el8.x86_64 98/139 2020-11-20T11:46:45.040 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : automake-1.16.1-6.el8.noarch 99/139 2020-11-20T11:46:45.040 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 100/139 2020-11-20T11:46:45.040 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 101/139 2020-11-20T11:46:45.040 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : jq-1.5-12.el8.x86_64 102/139 2020-11-20T11:46:45.041 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyOpenSSL-18.0.0-1.el8.noarch 103/139 2020-11-20T11:46:45.041 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 104/139 2020-11-20T11:46:45.041 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 105/139 2020-11-20T11:46:45.041 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 106/139 2020-11-20T11:46:45.041 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 107/139 2020-11-20T11:46:45.042 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 108/139 2020-11-20T11:46:45.042 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 109/139 2020-11-20T11:46:45.042 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 110/139 2020-11-20T11:46:45.042 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/139 2020-11-20T11:46:45.042 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/139 2020-11-20T11:46:45.043 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 113/139 2020-11-20T11:46:45.043 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flex-2.6.1-9.el8.x86_64 114/139 2020-11-20T11:46:45.043 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 115/139 2020-11-20T11:46:45.043 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : bison-3.0.4-10.el8.x86_64 116/139 2020-11-20T11:46:45.043 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 117/139 2020-11-20T11:46:45.044 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 118/139 2020-11-20T11:46:45.044 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 119/139 2020-11-20T11:46:45.044 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 120/139 2020-11-20T11:46:45.044 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 121/139 2020-11-20T11:46:45.044 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 122/139 2020-11-20T11:46:45.044 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 123/139 2020-11-20T11:46:45.045 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openblas-threads-0.3.3-5.el8.x86_64 124/139 2020-11-20T11:46:45.045 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openblas-0.3.3-5.el8.x86_64 125/139 2020-11-20T11:46:45.045 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 126/139 2020-11-20T11:46:45.045 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 127/139 2020-11-20T11:46:45.046 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 128/139 2020-11-20T11:46:45.046 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 129/139 2020-11-20T11:46:45.046 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 130/139 2020-11-20T11:46:45.046 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 131/139 2020-11-20T11:46:45.046 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 132/139 2020-11-20T11:46:45.046 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-libnm-1:1.26.0-8.el8.x86_64 133/139 2020-11-20T11:46:45.047 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-tui-1:1.26.0-9.el8_3.x86_64 134/139 2020-11-20T11:46:45.047 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-tui-1:1.26.0-8.el8.x86_64 135/139 2020-11-20T11:46:45.047 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-team-1:1.26.0-9.el8_3.x86_64 136/139 2020-11-20T11:46:45.047 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-team-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T11:46:45.048 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-1:1.26.0-9.el8_3.x86_64 138/139 2020-11-20T11:46:45.049 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 132/139 2020-11-20T11:46:45.149 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 133/139 2020-11-20T11:46:45.290 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : NetworkManager-tui-1:1.26.0-8.el8.x86_64 134/139 2020-11-20T11:46:45.291 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 135/139 2020-11-20T11:46:45.491 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 135/139 2020-11-20T11:46:45.641 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : NetworkManager-team-1:1.26.0-8.el8.x86_64 136/139 2020-11-20T11:46:45.655 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T11:46:45.656 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : NetworkManager-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T11:46:46.113 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T11:46:46.114 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : NetworkManager-libnm-1:1.26.0-8.el8.x86_64 138/139 2020-11-20T11:46:46.333 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: NetworkManager-libnm-1:1.26.0-8.el8.x86_64 138/139 2020-11-20T11:46:46.334 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 139/139 2020-11-20T11:46:47.002 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-1:1.26.0-8.el8.x86_64 139/139 2020-11-20T11:46:47.003 INFO:teuthology.orchestra.run.smithi192.stdout:Installed products updated. 2020-11-20T11:46:47.154 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 139/139 2020-11-20T11:46:47.154 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 1/139 2020-11-20T11:46:47.155 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 2/139 2020-11-20T11:46:47.155 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 3/139 2020-11-20T11:46:47.155 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 4/139 2020-11-20T11:46:47.155 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 5/139 2020-11-20T11:46:47.155 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 6/139 2020-11-20T11:46:47.156 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 7/139 2020-11-20T11:46:47.156 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 8/139 2020-11-20T11:46:47.156 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 9/139 2020-11-20T11:46:47.156 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 10/139 2020-11-20T11:46:47.156 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 11/139 2020-11-20T11:46:47.157 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 12/139 2020-11-20T11:46:47.157 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_ 13/139 2020-11-20T11:46:47.157 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 14/139 2020-11-20T11:46:47.157 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_6 15/139 2020-11-20T11:46:47.157 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 16/139 2020-11-20T11:46:47.158 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 17/139 2020-11-20T11:46:47.158 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el 18/139 2020-11-20T11:46:47.158 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ceph-common-2:16.0.0-7397.gb86e691b.el8. 19/139 2020-11-20T11:46:47.158 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_6 20/139 2020-11-20T11:46:47.158 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 21/139 2020-11-20T11:46:47.159 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 22/139 2020-11-20T11:46:47.159 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 23/139 2020-11-20T11:46:47.159 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 24/139 2020-11-20T11:46:47.159 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 25/139 2020-11-20T11:46:47.159 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 26/139 2020-11-20T11:46:47.160 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b. 27/139 2020-11-20T11:46:47.160 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 28/139 2020-11-20T11:46:47.169 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 29/139 2020-11-20T11:46:47.169 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 30/139 2020-11-20T11:46:47.170 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el 31/139 2020-11-20T11:46:47.170 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 32/139 2020-11-20T11:46:47.170 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.e 33/139 2020-11-20T11:46:47.170 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 34/139 2020-11-20T11:46:47.170 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 35/139 2020-11-20T11:46:47.171 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 36/139 2020-11-20T11:46:47.171 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : leveldb-1.22-1.el8.x86_64 37/139 2020-11-20T11:46:47.171 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/139 2020-11-20T11:46:47.171 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/139 2020-11-20T11:46:47.171 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 40/139 2020-11-20T11:46:47.172 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/139 2020-11-20T11:46:47.172 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/139 2020-11-20T11:46:47.172 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/139 2020-11-20T11:46:47.172 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/139 2020-11-20T11:46:47.173 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 45/139 2020-11-20T11:46:47.173 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/139 2020-11-20T11:46:47.173 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 47/139 2020-11-20T11:46:47.173 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 48/139 2020-11-20T11:46:47.173 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/139 2020-11-20T11:46:47.174 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/139 2020-11-20T11:46:47.174 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/139 2020-11-20T11:46:47.174 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-kubernetes-11.0.0-2.el8.noarch 52/139 2020-11-20T11:46:47.174 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/139 2020-11-20T11:46:47.174 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/139 2020-11-20T11:46:47.175 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 55/139 2020-11-20T11:46:47.175 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-portend-2.6-1.el8.noarch 56/139 2020-11-20T11:46:47.175 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 57/139 2020-11-20T11:46:47.175 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/139 2020-11-20T11:46:47.175 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/139 2020-11-20T11:46:47.176 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rsa-3.4.2-15.el8.noarch 60/139 2020-11-20T11:46:47.176 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/139 2020-11-20T11:46:47.176 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/139 2020-11-20T11:46:47.176 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/139 2020-11-20T11:46:47.176 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/139 2020-11-20T11:46:47.177 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/139 2020-11-20T11:46:47.177 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/139 2020-11-20T11:46:47.177 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/139 2020-11-20T11:46:47.177 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/139 2020-11-20T11:46:47.177 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/139 2020-11-20T11:46:47.178 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 70/139 2020-11-20T11:46:47.178 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 71/139 2020-11-20T11:46:47.178 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 72/139 2020-11-20T11:46:47.178 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-asn1crypto-0.24.0-3.el8.noarch 73/139 2020-11-20T11:46:47.178 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 74/139 2020-11-20T11:46:47.179 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 75/139 2020-11-20T11:46:47.179 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/139 2020-11-20T11:46:47.179 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 77/139 2020-11-20T11:46:47.179 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 78/139 2020-11-20T11:46:47.179 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 79/139 2020-11-20T11:46:47.180 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 80/139 2020-11-20T11:46:47.180 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 81/139 2020-11-20T11:46:47.180 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/139 2020-11-20T11:46:47.180 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libselinux-devel-2.9-3.el8.x86_64 83/139 2020-11-20T11:46:47.180 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cryptography-2.3-3.el8.x86_64 84/139 2020-11-20T11:46:47.181 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : zlib-devel-1.2.11-16.el8_2.x86_64 85/139 2020-11-20T11:46:47.181 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libuuid-devel-2.32.1-24.el8.x86_64 86/139 2020-11-20T11:46:47.181 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libxslt-1.1.32-5.el8.x86_64 87/139 2020-11-20T11:46:47.181 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 88/139 2020-11-20T11:46:47.181 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libquadmath-8.3.1-5.1.el8.x86_64 89/139 2020-11-20T11:46:47.182 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 90/139 2020-11-20T11:46:47.182 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libgfortran-8.3.1-5.1.el8.x86_64 91/139 2020-11-20T11:46:47.182 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : elfutils-libelf-devel-0.180-1.el8.x86_64 92/139 2020-11-20T11:46:47.182 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 93/139 2020-11-20T11:46:47.182 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 94/139 2020-11-20T11:46:47.183 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : krb5-devel-1.18.2-5.el8.x86_64 95/139 2020-11-20T11:46:47.183 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : xfsprogs-devel-5.0.0-4.el8.x86_64 96/139 2020-11-20T11:46:47.183 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librabbitmq-0.9.0-2.el8.x86_64 97/139 2020-11-20T11:46:47.183 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openssl-devel-1:1.1.1g-11.el8.x86_64 98/139 2020-11-20T11:46:47.183 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : automake-1.16.1-6.el8.noarch 99/139 2020-11-20T11:46:47.184 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 100/139 2020-11-20T11:46:47.184 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 101/139 2020-11-20T11:46:47.184 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : jq-1.5-12.el8.x86_64 102/139 2020-11-20T11:46:47.184 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyOpenSSL-18.0.0-1.el8.noarch 103/139 2020-11-20T11:46:47.184 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 104/139 2020-11-20T11:46:47.185 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 105/139 2020-11-20T11:46:47.185 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 106/139 2020-11-20T11:46:47.185 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 107/139 2020-11-20T11:46:47.185 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 108/139 2020-11-20T11:46:47.185 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 109/139 2020-11-20T11:46:47.186 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 110/139 2020-11-20T11:46:47.186 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/139 2020-11-20T11:46:47.186 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/139 2020-11-20T11:46:47.186 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 113/139 2020-11-20T11:46:47.186 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : flex-2.6.1-9.el8.x86_64 114/139 2020-11-20T11:46:47.187 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 115/139 2020-11-20T11:46:47.187 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : bison-3.0.4-10.el8.x86_64 116/139 2020-11-20T11:46:47.187 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 117/139 2020-11-20T11:46:47.187 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 118/139 2020-11-20T11:46:47.187 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 119/139 2020-11-20T11:46:47.188 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 120/139 2020-11-20T11:46:47.188 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 121/139 2020-11-20T11:46:47.188 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 122/139 2020-11-20T11:46:47.188 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 123/139 2020-11-20T11:46:47.189 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openblas-threads-0.3.3-5.el8.x86_64 124/139 2020-11-20T11:46:47.189 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : openblas-0.3.3-5.el8.x86_64 125/139 2020-11-20T11:46:47.189 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 126/139 2020-11-20T11:46:47.189 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 127/139 2020-11-20T11:46:47.190 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 128/139 2020-11-20T11:46:47.190 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 129/139 2020-11-20T11:46:47.190 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 130/139 2020-11-20T11:46:47.190 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 131/139 2020-11-20T11:46:47.190 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 132/139 2020-11-20T11:46:47.191 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-libnm-1:1.26.0-8.el8.x86_64 133/139 2020-11-20T11:46:47.191 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-tui-1:1.26.0-9.el8_3.x86_64 134/139 2020-11-20T11:46:47.191 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-tui-1:1.26.0-8.el8.x86_64 135/139 2020-11-20T11:46:47.191 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-team-1:1.26.0-9.el8_3.x86_64 136/139 2020-11-20T11:46:47.191 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-team-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T11:46:47.192 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-1:1.26.0-9.el8_3.x86_64 138/139 2020-11-20T11:46:49.285 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : NetworkManager-1:1.26.0-8.el8.x86_64 139/139 2020-11-20T11:46:49.286 INFO:teuthology.orchestra.run.smithi087.stdout:Installed products updated. 2020-11-20T11:46:49.444 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:46:49.444 INFO:teuthology.orchestra.run.smithi192.stdout:Upgraded: 2020-11-20T11:46:49.445 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-1:1.26.0-9.el8_3.x86_64 2020-11-20T11:46:49.445 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 2020-11-20T11:46:49.445 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-team-1:1.26.0-9.el8_3.x86_64 2020-11-20T11:46:49.445 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-tui-1:1.26.0-9.el8_3.x86_64 2020-11-20T11:46:49.446 INFO:teuthology.orchestra.run.smithi192.stdout: librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:49.446 INFO:teuthology.orchestra.run.smithi192.stdout: librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:49.446 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:46:49.446 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2020-11-20T11:46:49.446 INFO:teuthology.orchestra.run.smithi192.stdout: automake-1.16.1-6.el8.noarch 2020-11-20T11:46:49.447 INFO:teuthology.orchestra.run.smithi192.stdout: bison-3.0.4-10.el8.x86_64 2020-11-20T11:46:49.447 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:49.447 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:49.447 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:49.448 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:49.448 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:46:49.448 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-immutable-object-cache-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:49.448 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:49.448 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:49.449 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:46:49.449 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:46:49.449 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:46:49.449 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:46:49.449 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:46:49.450 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:49.450 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:49.450 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:46:49.450 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:49.450 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:49.451 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:49.451 INFO:teuthology.orchestra.run.smithi192.stdout: cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:46:49.451 INFO:teuthology.orchestra.run.smithi192.stdout: elfutils-libelf-devel-0.180-1.el8.x86_64 2020-11-20T11:46:49.451 INFO:teuthology.orchestra.run.smithi192.stdout: flex-2.6.1-9.el8.x86_64 2020-11-20T11:46:49.452 INFO:teuthology.orchestra.run.smithi192.stdout: fmt-6.2.1-1.el8.x86_64 2020-11-20T11:46:49.452 INFO:teuthology.orchestra.run.smithi192.stdout: fuse-2.9.7-12.el8.x86_64 2020-11-20T11:46:49.452 INFO:teuthology.orchestra.run.smithi192.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-11-20T11:46:49.452 INFO:teuthology.orchestra.run.smithi192.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-11-20T11:46:49.452 INFO:teuthology.orchestra.run.smithi192.stdout: jq-1.5-12.el8.x86_64 2020-11-20T11:46:49.453 INFO:teuthology.orchestra.run.smithi192.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-11-20T11:46:49.453 INFO:teuthology.orchestra.run.smithi192.stdout: krb5-devel-1.18.2-5.el8.x86_64 2020-11-20T11:46:49.453 INFO:teuthology.orchestra.run.smithi192.stdout: leveldb-1.22-1.el8.x86_64 2020-11-20T11:46:49.453 INFO:teuthology.orchestra.run.smithi192.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-11-20T11:46:49.453 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:49.454 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:49.454 INFO:teuthology.orchestra.run.smithi192.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2020-11-20T11:46:49.454 INFO:teuthology.orchestra.run.smithi192.stdout: libgfortran-8.3.1-5.1.el8.x86_64 2020-11-20T11:46:49.454 INFO:teuthology.orchestra.run.smithi192.stdout: liboath-2.6.2-3.el8.x86_64 2020-11-20T11:46:49.454 INFO:teuthology.orchestra.run.smithi192.stdout: libquadmath-8.3.1-5.1.el8.x86_64 2020-11-20T11:46:49.455 INFO:teuthology.orchestra.run.smithi192.stdout: librabbitmq-0.9.0-2.el8.x86_64 2020-11-20T11:46:49.455 INFO:teuthology.orchestra.run.smithi192.stdout: librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:49.455 INFO:teuthology.orchestra.run.smithi192.stdout: libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:49.455 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-11-20T11:46:49.456 INFO:teuthology.orchestra.run.smithi192.stdout: librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:49.456 INFO:teuthology.orchestra.run.smithi192.stdout: libselinux-devel-2.9-3.el8.x86_64 2020-11-20T11:46:49.456 INFO:teuthology.orchestra.run.smithi192.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-11-20T11:46:49.457 INFO:teuthology.orchestra.run.smithi192.stdout: libtool-2.4.6-25.el8.x86_64 2020-11-20T11:46:49.457 INFO:teuthology.orchestra.run.smithi192.stdout: libunwind-1.3.1-3.el8.x86_64 2020-11-20T11:46:49.457 INFO:teuthology.orchestra.run.smithi192.stdout: libuuid-devel-2.32.1-24.el8.x86_64 2020-11-20T11:46:49.458 INFO:teuthology.orchestra.run.smithi192.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-11-20T11:46:49.458 INFO:teuthology.orchestra.run.smithi192.stdout: libxslt-1.1.32-5.el8.x86_64 2020-11-20T11:46:49.458 INFO:teuthology.orchestra.run.smithi192.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-11-20T11:46:49.458 INFO:teuthology.orchestra.run.smithi192.stdout: oniguruma-6.8.2-2.el8.x86_64 2020-11-20T11:46:49.458 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-0.3.3-5.el8.x86_64 2020-11-20T11:46:49.459 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-threads-0.3.3-5.el8.x86_64 2020-11-20T11:46:49.459 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-devel-1:1.1.1g-11.el8.x86_64 2020-11-20T11:46:49.459 INFO:teuthology.orchestra.run.smithi192.stdout: pcre2-devel-10.32-2.el8.x86_64 2020-11-20T11:46:49.459 INFO:teuthology.orchestra.run.smithi192.stdout: pcre2-utf16-10.32-2.el8.x86_64 2020-11-20T11:46:49.459 INFO:teuthology.orchestra.run.smithi192.stdout: pcre2-utf32-10.32-2.el8.x86_64 2020-11-20T11:46:49.460 INFO:teuthology.orchestra.run.smithi192.stdout: python3-apipkg-1.5-6.el8.noarch 2020-11-20T11:46:49.460 INFO:teuthology.orchestra.run.smithi192.stdout: python3-asn1crypto-0.24.0-3.el8.noarch 2020-11-20T11:46:49.460 INFO:teuthology.orchestra.run.smithi192.stdout: python3-babel-2.5.1-5.el8.noarch 2020-11-20T11:46:49.460 INFO:teuthology.orchestra.run.smithi192.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-11-20T11:46:49.460 INFO:teuthology.orchestra.run.smithi192.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-11-20T11:46:49.461 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-11-20T11:46:49.461 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:49.461 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:49.462 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:49.462 INFO:teuthology.orchestra.run.smithi192.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-11-20T11:46:49.462 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cffi-1.11.5-5.el8.x86_64 2020-11-20T11:46:49.462 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-11-20T11:46:49.462 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-11-20T11:46:49.463 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cryptography-2.3-3.el8.x86_64 2020-11-20T11:46:49.463 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-11-20T11:46:49.463 INFO:teuthology.orchestra.run.smithi192.stdout: python3-execnet-1.7.1-1.el8.noarch 2020-11-20T11:46:49.463 INFO:teuthology.orchestra.run.smithi192.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-11-20T11:46:49.463 INFO:teuthology.orchestra.run.smithi192.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-11-20T11:46:49.464 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-6.2-6.el8.noarch 2020-11-20T11:46:49.464 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-11-20T11:46:49.464 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2020-11-20T11:46:49.464 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-11-20T11:46:49.464 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-11-20T11:46:49.465 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-11-20T11:46:49.465 INFO:teuthology.orchestra.run.smithi192.stdout: python3-kubernetes-11.0.0-2.el8.noarch 2020-11-20T11:46:49.465 INFO:teuthology.orchestra.run.smithi192.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-11-20T11:46:49.465 INFO:teuthology.orchestra.run.smithi192.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-11-20T11:46:49.465 INFO:teuthology.orchestra.run.smithi192.stdout: python3-mako-1.0.6-13.el8.noarch 2020-11-20T11:46:49.466 INFO:teuthology.orchestra.run.smithi192.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-11-20T11:46:49.466 INFO:teuthology.orchestra.run.smithi192.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-11-20T11:46:49.466 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-11-20T11:46:49.466 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-11-20T11:46:49.466 INFO:teuthology.orchestra.run.smithi192.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-11-20T11:46:49.467 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-11-20T11:46:49.467 INFO:teuthology.orchestra.run.smithi192.stdout: python3-portend-2.6-1.el8.noarch 2020-11-20T11:46:49.467 INFO:teuthology.orchestra.run.smithi192.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-11-20T11:46:49.467 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyOpenSSL-18.0.0-1.el8.noarch 2020-11-20T11:46:49.467 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-11-20T11:46:49.468 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-11-20T11:46:49.468 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pycparser-2.14-14.el8.noarch 2020-11-20T11:46:49.468 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytz-2017.2-9.el8.noarch 2020-11-20T11:46:49.468 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:49.468 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:49.469 INFO:teuthology.orchestra.run.smithi192.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-11-20T11:46:49.469 INFO:teuthology.orchestra.run.smithi192.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-11-20T11:46:49.469 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-11-20T11:46:49.469 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:49.469 INFO:teuthology.orchestra.run.smithi192.stdout: python3-routes-2.4.1-12.el8.noarch 2020-11-20T11:46:49.470 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rsa-3.4.2-15.el8.noarch 2020-11-20T11:46:49.470 INFO:teuthology.orchestra.run.smithi192.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2020-11-20T11:46:49.470 INFO:teuthology.orchestra.run.smithi192.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-11-20T11:46:49.470 INFO:teuthology.orchestra.run.smithi192.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-11-20T11:46:49.470 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-11-20T11:46:49.471 INFO:teuthology.orchestra.run.smithi192.stdout: python3-trustme-0.6.0-4.el8.noarch 2020-11-20T11:46:49.471 INFO:teuthology.orchestra.run.smithi192.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-11-20T11:46:49.471 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-11-20T11:46:49.471 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-11-20T11:46:49.471 INFO:teuthology.orchestra.run.smithi192.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-11-20T11:46:49.472 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-11-20T11:46:49.473 INFO:teuthology.orchestra.run.smithi192.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-11-20T11:46:49.473 INFO:teuthology.orchestra.run.smithi192.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-11-20T11:46:49.474 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:49.474 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:49.474 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:49.475 INFO:teuthology.orchestra.run.smithi192.stdout: socat-1.7.3.3-2.el8.x86_64 2020-11-20T11:46:49.475 INFO:teuthology.orchestra.run.smithi192.stdout: xfsprogs-devel-5.0.0-4.el8.x86_64 2020-11-20T11:46:49.475 INFO:teuthology.orchestra.run.smithi192.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-11-20T11:46:49.475 INFO:teuthology.orchestra.run.smithi192.stdout: zlib-devel-1.2.11-16.el8_2.x86_64 2020-11-20T11:46:49.476 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:46:49.478 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2020-11-20T11:46:49.656 DEBUG:teuthology.parallel:result is None 2020-11-20T11:46:51.649 INFO:teuthology.orchestra.run.smithi087.stdout: 2020-11-20T11:46:51.650 INFO:teuthology.orchestra.run.smithi087.stdout:Upgraded: 2020-11-20T11:46:51.650 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-1:1.26.0-9.el8_3.x86_64 2020-11-20T11:46:51.650 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 2020-11-20T11:46:51.650 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-team-1:1.26.0-9.el8_3.x86_64 2020-11-20T11:46:51.650 INFO:teuthology.orchestra.run.smithi087.stdout: NetworkManager-tui-1:1.26.0-9.el8_3.x86_64 2020-11-20T11:46:51.651 INFO:teuthology.orchestra.run.smithi087.stdout: librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:51.651 INFO:teuthology.orchestra.run.smithi087.stdout: librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:51.651 INFO:teuthology.orchestra.run.smithi087.stdout: 2020-11-20T11:46:51.651 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2020-11-20T11:46:51.651 INFO:teuthology.orchestra.run.smithi087.stdout: automake-1.16.1-6.el8.noarch 2020-11-20T11:46:51.652 INFO:teuthology.orchestra.run.smithi087.stdout: bison-3.0.4-10.el8.x86_64 2020-11-20T11:46:51.652 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:51.652 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:51.652 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:51.653 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:51.653 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:46:51.653 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-immutable-object-cache-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:51.653 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:51.653 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:51.654 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:46:51.654 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:46:51.654 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:46:51.654 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:46:51.654 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:46:51.655 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:51.655 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:51.655 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:46:51.655 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:51.655 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:51.656 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:51.656 INFO:teuthology.orchestra.run.smithi087.stdout: cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T11:46:51.656 INFO:teuthology.orchestra.run.smithi087.stdout: elfutils-libelf-devel-0.180-1.el8.x86_64 2020-11-20T11:46:51.656 INFO:teuthology.orchestra.run.smithi087.stdout: flex-2.6.1-9.el8.x86_64 2020-11-20T11:46:51.656 INFO:teuthology.orchestra.run.smithi087.stdout: fmt-6.2.1-1.el8.x86_64 2020-11-20T11:46:51.657 INFO:teuthology.orchestra.run.smithi087.stdout: fuse-2.9.7-12.el8.x86_64 2020-11-20T11:46:51.657 INFO:teuthology.orchestra.run.smithi087.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-11-20T11:46:51.657 INFO:teuthology.orchestra.run.smithi087.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-11-20T11:46:51.657 INFO:teuthology.orchestra.run.smithi087.stdout: jq-1.5-12.el8.x86_64 2020-11-20T11:46:51.657 INFO:teuthology.orchestra.run.smithi087.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-11-20T11:46:51.658 INFO:teuthology.orchestra.run.smithi087.stdout: krb5-devel-1.18.2-5.el8.x86_64 2020-11-20T11:46:51.658 INFO:teuthology.orchestra.run.smithi087.stdout: leveldb-1.22-1.el8.x86_64 2020-11-20T11:46:51.658 INFO:teuthology.orchestra.run.smithi087.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-11-20T11:46:51.658 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:51.659 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:51.659 INFO:teuthology.orchestra.run.smithi087.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2020-11-20T11:46:51.659 INFO:teuthology.orchestra.run.smithi087.stdout: libgfortran-8.3.1-5.1.el8.x86_64 2020-11-20T11:46:51.659 INFO:teuthology.orchestra.run.smithi087.stdout: liboath-2.6.2-3.el8.x86_64 2020-11-20T11:46:51.659 INFO:teuthology.orchestra.run.smithi087.stdout: libquadmath-8.3.1-5.1.el8.x86_64 2020-11-20T11:46:51.660 INFO:teuthology.orchestra.run.smithi087.stdout: librabbitmq-0.9.0-2.el8.x86_64 2020-11-20T11:46:51.660 INFO:teuthology.orchestra.run.smithi087.stdout: librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:51.660 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:51.660 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-11-20T11:46:51.660 INFO:teuthology.orchestra.run.smithi087.stdout: librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:51.661 INFO:teuthology.orchestra.run.smithi087.stdout: libselinux-devel-2.9-3.el8.x86_64 2020-11-20T11:46:51.661 INFO:teuthology.orchestra.run.smithi087.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-11-20T11:46:51.661 INFO:teuthology.orchestra.run.smithi087.stdout: libtool-2.4.6-25.el8.x86_64 2020-11-20T11:46:51.661 INFO:teuthology.orchestra.run.smithi087.stdout: libunwind-1.3.1-3.el8.x86_64 2020-11-20T11:46:51.661 INFO:teuthology.orchestra.run.smithi087.stdout: libuuid-devel-2.32.1-24.el8.x86_64 2020-11-20T11:46:51.662 INFO:teuthology.orchestra.run.smithi087.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-11-20T11:46:51.662 INFO:teuthology.orchestra.run.smithi087.stdout: libxslt-1.1.32-5.el8.x86_64 2020-11-20T11:46:51.662 INFO:teuthology.orchestra.run.smithi087.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-11-20T11:46:51.662 INFO:teuthology.orchestra.run.smithi087.stdout: oniguruma-6.8.2-2.el8.x86_64 2020-11-20T11:46:51.662 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-0.3.3-5.el8.x86_64 2020-11-20T11:46:51.663 INFO:teuthology.orchestra.run.smithi087.stdout: openblas-threads-0.3.3-5.el8.x86_64 2020-11-20T11:46:51.663 INFO:teuthology.orchestra.run.smithi087.stdout: openssl-devel-1:1.1.1g-11.el8.x86_64 2020-11-20T11:46:51.663 INFO:teuthology.orchestra.run.smithi087.stdout: pcre2-devel-10.32-2.el8.x86_64 2020-11-20T11:46:51.663 INFO:teuthology.orchestra.run.smithi087.stdout: pcre2-utf16-10.32-2.el8.x86_64 2020-11-20T11:46:51.663 INFO:teuthology.orchestra.run.smithi087.stdout: pcre2-utf32-10.32-2.el8.x86_64 2020-11-20T11:46:51.664 INFO:teuthology.orchestra.run.smithi087.stdout: python3-apipkg-1.5-6.el8.noarch 2020-11-20T11:46:51.664 INFO:teuthology.orchestra.run.smithi087.stdout: python3-asn1crypto-0.24.0-3.el8.noarch 2020-11-20T11:46:51.664 INFO:teuthology.orchestra.run.smithi087.stdout: python3-babel-2.5.1-5.el8.noarch 2020-11-20T11:46:51.664 INFO:teuthology.orchestra.run.smithi087.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-11-20T11:46:51.664 INFO:teuthology.orchestra.run.smithi087.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-11-20T11:46:51.665 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-11-20T11:46:51.665 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:51.667 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:51.667 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:51.667 INFO:teuthology.orchestra.run.smithi087.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-11-20T11:46:51.667 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cffi-1.11.5-5.el8.x86_64 2020-11-20T11:46:51.668 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-11-20T11:46:51.668 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-11-20T11:46:51.668 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography-2.3-3.el8.x86_64 2020-11-20T11:46:51.668 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-11-20T11:46:51.669 INFO:teuthology.orchestra.run.smithi087.stdout: python3-execnet-1.7.1-1.el8.noarch 2020-11-20T11:46:51.669 INFO:teuthology.orchestra.run.smithi087.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-11-20T11:46:51.669 INFO:teuthology.orchestra.run.smithi087.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-11-20T11:46:51.669 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-6.2-6.el8.noarch 2020-11-20T11:46:51.670 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-11-20T11:46:51.670 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2020-11-20T11:46:51.670 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-11-20T11:46:51.670 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-11-20T11:46:51.671 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-11-20T11:46:51.671 INFO:teuthology.orchestra.run.smithi087.stdout: python3-kubernetes-11.0.0-2.el8.noarch 2020-11-20T11:46:51.671 INFO:teuthology.orchestra.run.smithi087.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-11-20T11:46:51.671 INFO:teuthology.orchestra.run.smithi087.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-11-20T11:46:51.671 INFO:teuthology.orchestra.run.smithi087.stdout: python3-mako-1.0.6-13.el8.noarch 2020-11-20T11:46:51.672 INFO:teuthology.orchestra.run.smithi087.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-11-20T11:46:51.672 INFO:teuthology.orchestra.run.smithi087.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-11-20T11:46:51.672 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-11-20T11:46:51.672 INFO:teuthology.orchestra.run.smithi087.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-11-20T11:46:51.673 INFO:teuthology.orchestra.run.smithi087.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-11-20T11:46:51.673 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-11-20T11:46:51.673 INFO:teuthology.orchestra.run.smithi087.stdout: python3-portend-2.6-1.el8.noarch 2020-11-20T11:46:51.673 INFO:teuthology.orchestra.run.smithi087.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-11-20T11:46:51.673 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyOpenSSL-18.0.0-1.el8.noarch 2020-11-20T11:46:51.674 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-11-20T11:46:51.674 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-11-20T11:46:51.674 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pycparser-2.14-14.el8.noarch 2020-11-20T11:46:51.674 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pytz-2017.2-9.el8.noarch 2020-11-20T11:46:51.675 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:51.675 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:51.675 INFO:teuthology.orchestra.run.smithi087.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-11-20T11:46:51.675 INFO:teuthology.orchestra.run.smithi087.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-11-20T11:46:51.676 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-11-20T11:46:51.676 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:51.676 INFO:teuthology.orchestra.run.smithi087.stdout: python3-routes-2.4.1-12.el8.noarch 2020-11-20T11:46:51.676 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rsa-3.4.2-15.el8.noarch 2020-11-20T11:46:51.677 INFO:teuthology.orchestra.run.smithi087.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2020-11-20T11:46:51.677 INFO:teuthology.orchestra.run.smithi087.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-11-20T11:46:51.677 INFO:teuthology.orchestra.run.smithi087.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-11-20T11:46:51.677 INFO:teuthology.orchestra.run.smithi087.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-11-20T11:46:51.678 INFO:teuthology.orchestra.run.smithi087.stdout: python3-trustme-0.6.0-4.el8.noarch 2020-11-20T11:46:51.678 INFO:teuthology.orchestra.run.smithi087.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-11-20T11:46:51.678 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-11-20T11:46:51.678 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-11-20T11:46:51.678 INFO:teuthology.orchestra.run.smithi087.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-11-20T11:46:51.679 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-11-20T11:46:51.679 INFO:teuthology.orchestra.run.smithi087.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-11-20T11:46:51.679 INFO:teuthology.orchestra.run.smithi087.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-11-20T11:46:51.679 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:51.679 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:51.680 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T11:46:51.680 INFO:teuthology.orchestra.run.smithi087.stdout: socat-1.7.3.3-2.el8.x86_64 2020-11-20T11:46:51.680 INFO:teuthology.orchestra.run.smithi087.stdout: xfsprogs-devel-5.0.0-4.el8.x86_64 2020-11-20T11:46:51.680 INFO:teuthology.orchestra.run.smithi087.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-11-20T11:46:51.681 INFO:teuthology.orchestra.run.smithi087.stdout: zlib-devel-1.2.11-16.el8_2.x86_64 2020-11-20T11:46:51.681 INFO:teuthology.orchestra.run.smithi087.stdout: 2020-11-20T11:46:51.681 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2020-11-20T11:46:51.850 DEBUG:teuthology.parallel:result is None 2020-11-20T11:46:51.850 INFO:teuthology.orchestra.run.smithi192:> sudo lsb_release -is 2020-11-20T11:46:51.903 INFO:teuthology.orchestra.run.smithi192.stdout:RedHatEnterprise 2020-11-20T11:46:51.904 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-20T11:46:51.905 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:46:52.065 INFO:teuthology.orchestra.run.smithi192:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-11-20T11:46:52.087 INFO:teuthology.orchestra.run.smithi192.stdout:16.0.0-7397.gb86e691b.el8 2020-11-20T11:46:52.087 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-7397.gb86e691b.el8 2020-11-20T11:46:52.088 INFO:teuthology.task.install:The correct ceph version 16.0.0-7397.gb86e691b is installed. 2020-11-20T11:46:52.088 INFO:teuthology.orchestra.run.smithi146:> sudo lsb_release -is 2020-11-20T11:46:52.140 INFO:teuthology.orchestra.run.smithi146.stdout:RedHatEnterprise 2020-11-20T11:46:52.141 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-20T11:46:52.142 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:46:52.307 INFO:teuthology.orchestra.run.smithi146:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-11-20T11:46:52.329 INFO:teuthology.orchestra.run.smithi146.stdout:16.0.0-7397.gb86e691b.el8 2020-11-20T11:46:52.330 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-7397.gb86e691b.el8 2020-11-20T11:46:52.330 INFO:teuthology.task.install:The correct ceph version 16.0.0-7397.gb86e691b is installed. 2020-11-20T11:46:52.330 INFO:teuthology.orchestra.run.smithi087:> sudo lsb_release -is 2020-11-20T11:46:52.376 INFO:teuthology.orchestra.run.smithi087.stdout:RedHatEnterprise 2020-11-20T11:46:52.377 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-20T11:46:52.378 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:46:52.546 INFO:teuthology.orchestra.run.smithi087:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-11-20T11:46:52.566 INFO:teuthology.orchestra.run.smithi087.stdout:16.0.0-7397.gb86e691b.el8 2020-11-20T11:46:52.566 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-7397.gb86e691b.el8 2020-11-20T11:46:52.566 INFO:teuthology.task.install:The correct ceph version 16.0.0-7397.gb86e691b is installed. 2020-11-20T11:46:52.567 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-11-20T11:46:52.568 INFO:teuthology.orchestra.run.smithi192:> set -ex 2020-11-20T11:46:52.568 INFO:teuthology.orchestra.run.smithi192:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T11:46:52.587 INFO:teuthology.orchestra.run.smithi192.stderr:+ sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T11:46:52.598 INFO:teuthology.orchestra.run.smithi192.stderr:24+1 records in 2020-11-20T11:46:52.598 INFO:teuthology.orchestra.run.smithi192.stderr:24+1 records out 2020-11-20T11:46:52.599 INFO:teuthology.orchestra.run.smithi192.stderr:12667 bytes (13 kB, 12 KiB) copied, 8.0089e-05 s, 158 MB/s 2020-11-20T11:46:52.600 INFO:teuthology.orchestra.run.smithi146:> set -ex 2020-11-20T11:46:52.600 INFO:teuthology.orchestra.run.smithi146:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T11:46:52.616 INFO:teuthology.orchestra.run.smithi146.stderr:+ sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T11:46:52.628 INFO:teuthology.orchestra.run.smithi146.stderr:24+1 records in 2020-11-20T11:46:52.628 INFO:teuthology.orchestra.run.smithi146.stderr:24+1 records out 2020-11-20T11:46:52.628 INFO:teuthology.orchestra.run.smithi146.stderr:12667 bytes (13 kB, 12 KiB) copied, 8.5739e-05 s, 148 MB/s 2020-11-20T11:46:52.629 INFO:teuthology.orchestra.run.smithi087:> set -ex 2020-11-20T11:46:52.630 INFO:teuthology.orchestra.run.smithi087:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T11:46:52.643 INFO:teuthology.orchestra.run.smithi087.stderr:+ sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T11:46:52.653 INFO:teuthology.orchestra.run.smithi087.stderr:24+1 records in 2020-11-20T11:46:52.653 INFO:teuthology.orchestra.run.smithi087.stderr:24+1 records out 2020-11-20T11:46:52.654 INFO:teuthology.orchestra.run.smithi087.stderr:12667 bytes (13 kB, 12 KiB) copied, 9.1988e-05 s, 138 MB/s 2020-11-20T11:46:52.655 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-11-20T11:46:52.656 INFO:teuthology.orchestra.run.smithi192:> set -ex 2020-11-20T11:46:52.656 INFO:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/daemon-helper 2020-11-20T11:46:52.673 INFO:teuthology.orchestra.run.smithi192.stderr:+ sudo dd of=/usr/bin/daemon-helper 2020-11-20T11:46:52.684 INFO:teuthology.orchestra.run.smithi192.stderr:5+1 records in 2020-11-20T11:46:52.685 INFO:teuthology.orchestra.run.smithi192.stderr:5+1 records out 2020-11-20T11:46:52.685 INFO:teuthology.orchestra.run.smithi192.stderr:3058 bytes (3.1 kB, 3.0 KiB) copied, 3.9797e-05 s, 76.8 MB/s 2020-11-20T11:46:52.687 INFO:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-11-20T11:46:52.754 INFO:teuthology.orchestra.run.smithi146:> set -ex 2020-11-20T11:46:52.755 INFO:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/daemon-helper 2020-11-20T11:46:52.771 INFO:teuthology.orchestra.run.smithi146.stderr:+ sudo dd of=/usr/bin/daemon-helper 2020-11-20T11:46:52.782 INFO:teuthology.orchestra.run.smithi146.stderr:5+1 records in 2020-11-20T11:46:52.783 INFO:teuthology.orchestra.run.smithi146.stderr:5+1 records out 2020-11-20T11:46:52.783 INFO:teuthology.orchestra.run.smithi146.stderr:3058 bytes (3.1 kB, 3.0 KiB) copied, 4.2435e-05 s, 72.1 MB/s 2020-11-20T11:46:52.784 INFO:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-11-20T11:46:52.851 INFO:teuthology.orchestra.run.smithi087:> set -ex 2020-11-20T11:46:52.852 INFO:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/daemon-helper 2020-11-20T11:46:52.865 INFO:teuthology.orchestra.run.smithi087.stderr:+ sudo dd of=/usr/bin/daemon-helper 2020-11-20T11:46:52.874 INFO:teuthology.orchestra.run.smithi087.stderr:5+1 records in 2020-11-20T11:46:52.875 INFO:teuthology.orchestra.run.smithi087.stderr:5+1 records out 2020-11-20T11:46:52.876 INFO:teuthology.orchestra.run.smithi087.stderr:3058 bytes (3.1 kB, 3.0 KiB) copied, 3.6893e-05 s, 82.9 MB/s 2020-11-20T11:46:52.877 INFO:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-11-20T11:46:52.941 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-11-20T11:46:52.941 INFO:teuthology.orchestra.run.smithi192:> set -ex 2020-11-20T11:46:52.942 INFO:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T11:46:52.958 INFO:teuthology.orchestra.run.smithi192.stderr:+ sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T11:46:52.969 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records in 2020-11-20T11:46:52.969 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records out 2020-11-20T11:46:52.969 INFO:teuthology.orchestra.run.smithi192.stderr:299 bytes copied, 3.0294e-05 s, 9.9 MB/s 2020-11-20T11:46:52.970 INFO:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-11-20T11:46:53.038 INFO:teuthology.orchestra.run.smithi146:> set -ex 2020-11-20T11:46:53.038 INFO:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T11:46:53.055 INFO:teuthology.orchestra.run.smithi146.stderr:+ sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T11:46:53.066 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records in 2020-11-20T11:46:53.066 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records out 2020-11-20T11:46:53.067 INFO:teuthology.orchestra.run.smithi146.stderr:299 bytes copied, 3.4377e-05 s, 8.7 MB/s 2020-11-20T11:46:53.068 INFO:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-11-20T11:46:53.142 INFO:teuthology.orchestra.run.smithi087:> set -ex 2020-11-20T11:46:53.142 INFO:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T11:46:53.161 INFO:teuthology.orchestra.run.smithi087.stderr:+ sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T11:46:53.171 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records in 2020-11-20T11:46:53.171 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records out 2020-11-20T11:46:53.171 INFO:teuthology.orchestra.run.smithi087.stderr:299 bytes copied, 2.8923e-05 s, 10.3 MB/s 2020-11-20T11:46:53.172 INFO:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-11-20T11:46:53.249 INFO:teuthology.run_tasks:Running task ceph... 2020-11-20T11:46:53.310 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2020-11-20T11:46:53.311 INFO:teuthology.orchestra.run.smithi087:> sudo chmod 777 /var/log/ceph 2020-11-20T11:46:53.319 INFO:teuthology.orchestra.run.smithi146:> sudo chmod 777 /var/log/ceph 2020-11-20T11:46:53.328 INFO:teuthology.orchestra.run.smithi192:> sudo chmod 777 /var/log/ceph 2020-11-20T11:46:53.364 INFO:tasks.ceph:Disabling ceph logrotate... 2020-11-20T11:46:53.364 INFO:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/logrotate.d/ceph 2020-11-20T11:46:53.394 INFO:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/logrotate.d/ceph 2020-11-20T11:46:53.406 INFO:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/logrotate.d/ceph 2020-11-20T11:46:53.438 INFO:tasks.ceph:Creating extra log directories... 2020-11-20T11:46:53.438 INFO:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-11-20T11:46:53.466 INFO:teuthology.orchestra.run.smithi146:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-11-20T11:46:53.482 INFO:teuthology.orchestra.run.smithi192:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-11-20T11:46:53.554 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2020-11-20T11:46:53.554 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2020-11-20T11:46:53.555 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2020-11-20T11:46:53.555 INFO:teuthology.orchestra.run.smithi192:> set -ex 2020-11-20T11:46:53.555 INFO:teuthology.orchestra.run.smithi192:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T11:46:53.572 INFO:teuthology.orchestra.run.smithi192.stderr:+ dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T11:46:53.573 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records in 2020-11-20T11:46:53.573 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records out 2020-11-20T11:46:53.573 INFO:teuthology.orchestra.run.smithi192.stderr:408 bytes copied, 4.835e-05 s, 8.4 MB/s 2020-11-20T11:46:53.574 INFO:teuthology.orchestra.run.smithi192:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-11-20T11:46:53.679 INFO:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-11-20T11:46:53.705 INFO:teuthology.orchestra.run.smithi146:> set -ex 2020-11-20T11:46:53.705 INFO:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T11:46:53.722 INFO:teuthology.orchestra.run.smithi146.stderr:+ dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T11:46:53.723 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records in 2020-11-20T11:46:53.723 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records out 2020-11-20T11:46:53.723 INFO:teuthology.orchestra.run.smithi146.stderr:408 bytes copied, 3.236e-05 s, 12.6 MB/s 2020-11-20T11:46:53.724 INFO:teuthology.orchestra.run.smithi146:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-11-20T11:46:53.833 INFO:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-11-20T11:46:53.860 INFO:teuthology.orchestra.run.smithi087:> set -ex 2020-11-20T11:46:53.860 INFO:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T11:46:53.874 INFO:teuthology.orchestra.run.smithi087.stderr:+ dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T11:46:53.875 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records in 2020-11-20T11:46:53.875 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records out 2020-11-20T11:46:53.876 INFO:teuthology.orchestra.run.smithi087.stderr:408 bytes copied, 2.9189e-05 s, 14.0 MB/s 2020-11-20T11:46:53.876 INFO:teuthology.orchestra.run.smithi087:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-11-20T11:46:53.980 INFO:teuthology.orchestra.run.smithi087:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-11-20T11:46:54.013 INFO:tasks.ceph:Creating ceph cluster ceph... 2020-11-20T11:46:54.014 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2020-11-20T11:46:54.014 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640275', 'branch': 'wip-pdonnell-testing-20201120.053228', 'description': 'fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/suites/dbench}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '5640275', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.3', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20201120.053228'}, 'ceph': {'cephfs': {'session_timeout': 300}, 'cephfs_ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20201120.053228', 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 95, 'repo': 'git://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'mds.a', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'], ['mon.b', 'mgr.y', 'mds.b', 'osd.1', 'osd.4', 'osd.7', 'osd.10'], ['mon.c', 'mgr.z', 'mds.c', 'osd.2', 'osd.5', 'osd.8', 'osd.11']], 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20201120.053228', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20201120.053228/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb', 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (3, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'}}, {'ceph': None}, {'kclient': None}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'teuthology_branch': 'master', 'timestamp': '2020-11-20_08:39:42', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.21168', 'targets': {'smithi192.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDW+8g4wlw1XKlVbFJrpQ0e5OSZe77fmRFLUwPN6/VdSJ2HDyjj9mUhz7zYUu11a+D/OL4vasXUysu+isMK2zqkwPbi7cAFKuwDZmNHMijzv0Qfwy9zgqVQlkNiQ0hYcWb7ItL95X0erwxxgyUmV3y0SQzjGkajhYYniABHY5IFlAvT7ZzAoGRNyX4cwf7olhqYQWwCX18BrsRO5BP8nVi8UiphS5t3l2XptJq4USjDKmkMAKQ5K7shJliOjFjqW2iO9/FNOWXLgcPPPElw8BdnTG8uvAfXoSeAebJItJIG0a1XbSZGY1F91XY3IksgPGbdav3Ei0P3yB7h5hB3Z4WzPpec9RbVYt2CYSxU2Wfz8cbBFfvEY+0H/a8HU+uO31O4okr2W8K3mcE+IPwUKMbs9ScjXhLeflyQwMnplV2sGcs7mjfirYyPmSF7bCeClyZhFh1lJTBZPkFZ8kD6jYQhJae64K9+pJB5ZrEs5H3WYsF5enwsttqotx1tjkOSgh8=', 'smithi146.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfODP2sZvosIZwhSmzF6qg9vkVOb/1rtNlxDuvjlWfIhBv06CGy3ZidHuk72xvjTm4sRk7ibeQ+XvYHpE8sUTOHdXFLzvtuTjzYaA8FShGTHIcwb6q8GOPkane7bDN4t4qNGrHVHmuw/lYScNF3AksYMdbX4QDnF8bM8Nwsit6hORivbRBOWN6a3ASw1D3BdBJIWDdG/N1NK6eW80rIVpCM9nYuGg1T4nix4jii7/6WgD39DIWzrCZG1WupZ7cmrpGTDaRwjFk6y/CAk+zQ+0Nkmyo1nOF+H5XeqQ7ryYHp2jK/TauacqnGgcBwGJ0JRXK8rqfuEKzeU8Xesz6myGVAjz63HdGnQPvWo1+00brk22SX+XeklXTTtQVxWWykZhSlugjiiXhi83mW+pkRs6Y42OFJtweoPEcS2/ZWISm3jzqp+pxiQ0nbXfQjvt0h5fnWnDMhY21mOpmvbAeV2uEtIYAw2hiij8f8afooFxTIRP8vRsGdkcHqa+OUoDC//s=', 'smithi087.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyQREByNYC5DaKSPsf+8C7u7a8020f9XZfB4vaZeJK7+GWd00IJeDNnQ0idLggJFBikBrnBrJ9cmsYpRoODWI7L+H0FKpf97sVzfgS3XWtWbSB6+U4xcBg1krpfhce3Zo9Qc+iFfcx6kNeyRZCFRVcq80xBGgqPkl1fqznzmAZ26P/Phcz0EtmWIe9MJpm0teufQHljIckV3B5DyfWfQ29w0MyGJD/9rLZmzcQqmbIJ5NWMrd7Xy/vj3RcUZSMii0e3ui7eySL9AfTxz1Z1j4OD0wUoSJZImDxT92pclwhefX2UnypUqAXwkpPVjYR5utZJkFQmhgDJhhlNrd3q79AvK90f8I8kEiX4uqeiHvKK3V56WmpTmCYZiaFU5sbZ0uc1V/01/6Tkf6eRjMlpaKiqooiAiL98lIAU2sTDB8K+Gz7iUbUrgqf+EAsi/32eG5WlCRIYL0iiNFbcqO/pAw56Ja6vCUmB/HTdhf16ZsJM1HA8bdqfxohWMk7Be1g29s='}} 2020-11-20T11:46:54.015 INFO:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-11-20T11:46:54.048 INFO:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-11-20T11:46:54.051 INFO:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-11-20T11:46:54.068 INFO:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/run/ceph 2020-11-20T11:46:54.102 INFO:teuthology.orchestra.run.smithi146:> sudo install -d -m0777 -- /var/run/ceph 2020-11-20T11:46:54.107 INFO:teuthology.orchestra.run.smithi192:> sudo install -d -m0777 -- /var/run/ceph 2020-11-20T11:46:54.134 INFO:teuthology.orchestra.run.smithi192:> set -ex 2020-11-20T11:46:54.134 INFO:teuthology.orchestra.run.smithi192:> dd if=/scratch_devs of=/dev/stdout 2020-11-20T11:46:54.188 INFO:teuthology.orchestra.run.smithi192.stderr:+ dd if=/scratch_devs of=/dev/stdout 2020-11-20T11:46:54.189 INFO:teuthology.orchestra.run.smithi192.stdout:/dev/vg_nvme/lv_1 2020-11-20T11:46:54.190 INFO:teuthology.orchestra.run.smithi192.stdout:/dev/vg_nvme/lv_2 2020-11-20T11:46:54.190 INFO:teuthology.orchestra.run.smithi192.stdout:/dev/vg_nvme/lv_3 2020-11-20T11:46:54.190 INFO:teuthology.orchestra.run.smithi192.stdout:/dev/vg_nvme/lv_4 2020-11-20T11:46:54.190 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records in 2020-11-20T11:46:54.191 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records out 2020-11-20T11:46:54.191 INFO:teuthology.orchestra.run.smithi192.stderr:72 bytes copied, 3.3002e-05 s, 2.2 MB/s 2020-11-20T11:46:54.191 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-11-20T11:46:54.192 INFO:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-11-20T11:46:54.245 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-11-20T11:46:54.245 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:46:54.246 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 6h/6d Inode: 60511 Links: 1 2020-11-20T11:46:54.246 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:46:54.246 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:46:54.246 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2020-11-20 11:46:44.631553994 +0000 2020-11-20T11:46:54.247 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2020-11-20 11:44:34.954120301 +0000 2020-11-20T11:46:54.247 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2020-11-20 11:44:34.954120301 +0000 2020-11-20T11:46:54.247 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: - 2020-11-20T11:46:54.255 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2020-11-20T11:46:54.256 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2020-11-20T11:46:54.256 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000257574 s, 2.0 MB/s 2020-11-20T11:46:54.258 INFO:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-11-20T11:46:54.345 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-11-20T11:46:54.368 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:46:54.369 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 6h/6d Inode: 58234 Links: 1 2020-11-20T11:46:54.371 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:46:54.374 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:46:54.374 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2020-11-20 11:46:44.631553994 +0000 2020-11-20T11:46:54.375 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2020-11-20 11:44:35.305113620 +0000 2020-11-20T11:46:54.376 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2020-11-20 11:44:35.305113620 +0000 2020-11-20T11:46:54.376 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: - 2020-11-20T11:46:54.378 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2020-11-20T11:46:54.379 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2020-11-20T11:46:54.379 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000241686 s, 2.1 MB/s 2020-11-20T11:46:54.380 INFO:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-11-20T11:46:54.467 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-11-20T11:46:54.469 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:46:54.470 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 6h/6d Inode: 56965 Links: 1 2020-11-20T11:46:54.470 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:46:54.470 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:46:54.471 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2020-11-20 11:46:44.631553994 +0000 2020-11-20T11:46:54.471 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2020-11-20 11:44:35.623107568 +0000 2020-11-20T11:46:54.472 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2020-11-20 11:44:35.623107568 +0000 2020-11-20T11:46:54.472 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: - 2020-11-20T11:46:54.477 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2020-11-20T11:46:54.479 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2020-11-20T11:46:54.480 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000221511 s, 2.3 MB/s 2020-11-20T11:46:54.484 INFO:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-11-20T11:46:54.520 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-11-20T11:46:54.522 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:46:54.522 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 6h/6d Inode: 60836 Links: 1 2020-11-20T11:46:54.523 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:46:54.526 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:46:54.526 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2020-11-20 11:46:44.631553994 +0000 2020-11-20T11:46:54.527 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2020-11-20 11:44:35.946101421 +0000 2020-11-20T11:46:54.527 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2020-11-20 11:44:35.946101421 +0000 2020-11-20T11:46:54.528 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: - 2020-11-20T11:46:54.531 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2020-11-20T11:46:54.531 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2020-11-20T11:46:54.532 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000207538 s, 2.5 MB/s 2020-11-20T11:46:54.533 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2020-11-20T11:46:54.533 INFO:teuthology.orchestra.run.smithi146:> set -ex 2020-11-20T11:46:54.534 INFO:teuthology.orchestra.run.smithi146:> dd if=/scratch_devs of=/dev/stdout 2020-11-20T11:46:54.555 INFO:teuthology.orchestra.run.smithi146.stderr:+ dd if=/scratch_devs of=/dev/stdout 2020-11-20T11:46:54.556 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records in 2020-11-20T11:46:54.556 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records out 2020-11-20T11:46:54.557 INFO:teuthology.orchestra.run.smithi146.stderr:72 bytes copied, 3.6828e-05 s, 2.0 MB/s 2020-11-20T11:46:54.557 INFO:teuthology.orchestra.run.smithi146.stdout:/dev/vg_nvme/lv_1 2020-11-20T11:46:54.558 INFO:teuthology.orchestra.run.smithi146.stdout:/dev/vg_nvme/lv_2 2020-11-20T11:46:54.558 INFO:teuthology.orchestra.run.smithi146.stdout:/dev/vg_nvme/lv_3 2020-11-20T11:46:54.558 INFO:teuthology.orchestra.run.smithi146.stdout:/dev/vg_nvme/lv_4 2020-11-20T11:46:54.559 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-11-20T11:46:54.560 INFO:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-11-20T11:46:54.622 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-11-20T11:46:54.623 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:46:54.623 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 6h/6d Inode: 50084 Links: 1 2020-11-20T11:46:54.624 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:46:54.624 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:46:54.624 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2020-11-20 11:46:36.258152579 +0000 2020-11-20T11:46:54.625 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2020-11-20 11:44:37.042450288 +0000 2020-11-20T11:46:54.625 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2020-11-20 11:44:37.042450288 +0000 2020-11-20T11:46:54.626 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: - 2020-11-20T11:46:54.634 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2020-11-20T11:46:54.634 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2020-11-20T11:46:54.635 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000248757 s, 2.1 MB/s 2020-11-20T11:46:54.640 INFO:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-11-20T11:46:54.703 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-11-20T11:46:54.703 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:46:54.703 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 6h/6d Inode: 56234 Links: 1 2020-11-20T11:46:54.703 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:46:54.704 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:46:54.704 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2020-11-20 11:46:36.258152579 +0000 2020-11-20T11:46:54.704 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2020-11-20 11:44:37.379445459 +0000 2020-11-20T11:46:54.704 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2020-11-20 11:44:37.379445459 +0000 2020-11-20T11:46:54.705 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: - 2020-11-20T11:46:54.713 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2020-11-20T11:46:54.714 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2020-11-20T11:46:54.714 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000232917 s, 2.2 MB/s 2020-11-20T11:46:54.716 INFO:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-11-20T11:46:54.777 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-11-20T11:46:54.777 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:46:54.778 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 6h/6d Inode: 58721 Links: 1 2020-11-20T11:46:54.778 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:46:54.778 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:46:54.779 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2020-11-20 11:46:36.258152579 +0000 2020-11-20T11:46:54.779 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2020-11-20 11:44:37.694440944 +0000 2020-11-20T11:46:54.780 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2020-11-20 11:44:37.694440944 +0000 2020-11-20T11:46:54.780 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: - 2020-11-20T11:46:54.787 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2020-11-20T11:46:54.788 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2020-11-20T11:46:54.788 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000199554 s, 2.6 MB/s 2020-11-20T11:46:54.791 INFO:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-11-20T11:46:54.851 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-11-20T11:46:54.852 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:46:54.852 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 6h/6d Inode: 50141 Links: 1 2020-11-20T11:46:54.852 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:46:54.852 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:46:54.853 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2020-11-20 11:46:36.258152579 +0000 2020-11-20T11:46:54.853 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2020-11-20 11:44:38.021436257 +0000 2020-11-20T11:46:54.853 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2020-11-20 11:44:38.021436257 +0000 2020-11-20T11:46:54.853 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: - 2020-11-20T11:46:54.861 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2020-11-20T11:46:54.862 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2020-11-20T11:46:54.862 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000214524 s, 2.4 MB/s 2020-11-20T11:46:54.864 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2020-11-20T11:46:54.864 INFO:teuthology.orchestra.run.smithi087:> set -ex 2020-11-20T11:46:54.865 INFO:teuthology.orchestra.run.smithi087:> dd if=/scratch_devs of=/dev/stdout 2020-11-20T11:46:54.881 INFO:teuthology.orchestra.run.smithi087.stderr:+ dd if=/scratch_devs of=/dev/stdout 2020-11-20T11:46:54.882 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/vg_nvme/lv_1 2020-11-20T11:46:54.883 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/vg_nvme/lv_2 2020-11-20T11:46:54.883 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/vg_nvme/lv_3 2020-11-20T11:46:54.883 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/vg_nvme/lv_4 2020-11-20T11:46:54.883 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records in 2020-11-20T11:46:54.884 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records out 2020-11-20T11:46:54.884 INFO:teuthology.orchestra.run.smithi087.stderr:72 bytes copied, 3.6817e-05 s, 2.0 MB/s 2020-11-20T11:46:54.884 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-11-20T11:46:54.885 INFO:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-11-20T11:46:54.945 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-11-20T11:46:54.945 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:46:54.945 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 6h/6d Inode: 59642 Links: 1 2020-11-20T11:46:54.946 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:46:54.946 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:46:54.946 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2020-11-20 11:46:46.783309290 +0000 2020-11-20T11:46:54.946 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2020-11-20 11:44:33.989889082 +0000 2020-11-20T11:46:54.946 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2020-11-20 11:44:33.989889082 +0000 2020-11-20T11:46:54.947 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2020-11-20T11:46:54.955 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2020-11-20T11:46:54.956 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2020-11-20T11:46:54.956 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000282238 s, 1.8 MB/s 2020-11-20T11:46:54.958 INFO:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-11-20T11:46:55.015 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-11-20T11:46:55.016 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:46:55.017 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 6h/6d Inode: 57685 Links: 1 2020-11-20T11:46:55.017 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:46:55.018 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:46:55.018 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2020-11-20 11:46:46.783309290 +0000 2020-11-20T11:46:55.019 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2020-11-20 11:44:34.299881989 +0000 2020-11-20T11:46:55.019 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2020-11-20 11:44:34.299881989 +0000 2020-11-20T11:46:55.019 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2020-11-20T11:46:55.025 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2020-11-20T11:46:55.025 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2020-11-20T11:46:55.026 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000252223 s, 2.0 MB/s 2020-11-20T11:46:55.028 INFO:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-11-20T11:46:55.087 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-11-20T11:46:55.087 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:46:55.087 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 6h/6d Inode: 59685 Links: 1 2020-11-20T11:46:55.088 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:46:55.088 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:46:55.088 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2020-11-20 11:46:46.784309267 +0000 2020-11-20T11:46:55.088 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2020-11-20 11:44:34.605874988 +0000 2020-11-20T11:46:55.088 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2020-11-20 11:44:34.605874988 +0000 2020-11-20T11:46:55.089 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2020-11-20T11:46:55.097 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2020-11-20T11:46:55.097 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2020-11-20T11:46:55.097 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000218765 s, 2.3 MB/s 2020-11-20T11:46:55.099 INFO:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-11-20T11:46:55.158 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-11-20T11:46:55.159 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:46:55.159 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 6h/6d Inode: 55281 Links: 1 2020-11-20T11:46:55.159 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:46:55.159 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T11:46:55.160 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2020-11-20 11:46:46.784309267 +0000 2020-11-20T11:46:55.160 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2020-11-20 11:44:34.932867507 +0000 2020-11-20T11:46:55.160 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2020-11-20 11:44:34.932867507 +0000 2020-11-20T11:46:55.160 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2020-11-20T11:46:55.169 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2020-11-20T11:46:55.170 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2020-11-20T11:46:55.170 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000277359 s, 1.8 MB/s 2020-11-20T11:46:55.172 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2020-11-20T11:46:55.174 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi192.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi146.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi087.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'}} 2020-11-20T11:46:55.174 INFO:tasks.ceph:Generating config... 2020-11-20T11:46:55.175 INFO:tasks.ceph:[client] client mount timeout = 600 2020-11-20T11:46:55.176 INFO:tasks.ceph:[client] debug client = 20 2020-11-20T11:46:55.176 INFO:tasks.ceph:[client] debug ms = 1 2020-11-20T11:46:55.176 INFO:tasks.ceph:[client] rados mon op timeout = 15m 2020-11-20T11:46:55.177 INFO:tasks.ceph:[client] rados osd op timeout = 15m 2020-11-20T11:46:55.177 INFO:tasks.ceph:[global] ms die on skipped message = False 2020-11-20T11:46:55.177 INFO:tasks.ceph:[mds] debug mds = 20 2020-11-20T11:46:55.177 INFO:tasks.ceph:[mds] debug ms = 1 2020-11-20T11:46:55.178 INFO:tasks.ceph:[mds] mds bal frag = True 2020-11-20T11:46:55.178 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2020-11-20T11:46:55.178 INFO:tasks.ceph:[mds] mds bal merge size = 5 2020-11-20T11:46:55.179 INFO:tasks.ceph:[mds] mds bal split bits = 3 2020-11-20T11:46:55.179 INFO:tasks.ceph:[mds] mds bal split size = 100 2020-11-20T11:46:55.179 INFO:tasks.ceph:[mds] mds debug frag = True 2020-11-20T11:46:55.179 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2020-11-20T11:46:55.180 INFO:tasks.ceph:[mds] mds op complaint time = 180 2020-11-20T11:46:55.180 INFO:tasks.ceph:[mds] mds verify scatter = True 2020-11-20T11:46:55.180 INFO:tasks.ceph:[mds] osd op complaint time = 180 2020-11-20T11:46:55.180 INFO:tasks.ceph:[mds] rados mon op timeout = 15m 2020-11-20T11:46:55.184 INFO:tasks.ceph:[mds] rados osd op timeout = 15m 2020-11-20T11:46:55.185 INFO:tasks.ceph:[mgr] debug mgr = 20 2020-11-20T11:46:55.186 INFO:tasks.ceph:[mgr] debug ms = 1 2020-11-20T11:46:55.188 INFO:tasks.ceph:[mon] debug mon = 20 2020-11-20T11:46:55.188 INFO:tasks.ceph:[mon] debug ms = 1 2020-11-20T11:46:55.188 INFO:tasks.ceph:[mon] debug paxos = 20 2020-11-20T11:46:55.189 INFO:tasks.ceph:[mon] mon op complaint time = 120 2020-11-20T11:46:55.189 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2020-11-20T11:46:55.189 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2020-11-20T11:46:55.189 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2020-11-20T11:46:55.190 INFO:tasks.ceph:[osd] debug bluefs = 20 2020-11-20T11:46:55.190 INFO:tasks.ceph:[osd] debug bluestore = 20 2020-11-20T11:46:55.190 INFO:tasks.ceph:[osd] debug filestore = 20 2020-11-20T11:46:55.191 INFO:tasks.ceph:[osd] debug journal = 20 2020-11-20T11:46:55.191 INFO:tasks.ceph:[osd] debug ms = 20 2020-11-20T11:46:55.191 INFO:tasks.ceph:[osd] debug osd = 25 2020-11-20T11:46:55.191 INFO:tasks.ceph:[osd] debug rocksdb = 10 2020-11-20T11:46:55.192 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2020-11-20T11:46:55.192 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2020-11-20T11:46:55.193 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2020-11-20T11:46:55.193 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2020-11-20T11:46:55.193 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2020-11-20T11:46:55.193 INFO:tasks.ceph:[osd] osd op complaint time = 180 2020-11-20T11:46:55.194 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2020-11-20T11:46:55.194 INFO:tasks.ceph:[osd] osd_max_omap_entries_per_request = 10 2020-11-20T11:46:55.194 INFO:tasks.ceph:Setting up mon.a... 2020-11-20T11:46:55.195 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2020-11-20T11:46:55.249 INFO:teuthology.orchestra.run.smithi192.stdout:creating /etc/ceph/ceph.keyring 2020-11-20T11:46:55.251 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2020-11-20T11:46:55.300 INFO:teuthology.orchestra.run.smithi192:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T11:46:55.372 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.192'), ('mon.b', '172.21.15.146'), ('mon.c', '172.21.15.87')] 2020-11-20T11:46:55.373 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.192,172.21.15.146,172.21.15.87', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds.c': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}} 2020-11-20T11:46:55.374 INFO:teuthology.orchestra.run.smithi192:> set -ex 2020-11-20T11:46:55.375 INFO:teuthology.orchestra.run.smithi192:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2020-11-20T11:46:55.435 INFO:teuthology.orchestra.run.smithi192.stderr:+ dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2020-11-20T11:46:55.438 INFO:teuthology.orchestra.run.smithi192.stderr:6+1 records in 2020-11-20T11:46:55.439 INFO:teuthology.orchestra.run.smithi192.stderr:6+1 records out 2020-11-20T11:46:55.439 INFO:teuthology.orchestra.run.smithi192.stderr:3542 bytes (3.5 kB, 3.5 KiB) copied, 0.000240314 s, 14.7 MB/s 2020-11-20T11:46:55.440 INFO:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.192 --add b 172.21.15.146 --add c 172.21.15.87 --print /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:46:55.528 INFO:teuthology.orchestra.run.smithi192.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:46:55.529 INFO:teuthology.orchestra.run.smithi192.stdout:monmaptool: generated fsid 4871390d-d110-4379-8302-5810d7b54f34 2020-11-20T11:46:55.530 INFO:teuthology.orchestra.run.smithi192.stdout:epoch 0 2020-11-20T11:46:55.531 INFO:teuthology.orchestra.run.smithi192.stdout:fsid 4871390d-d110-4379-8302-5810d7b54f34 2020-11-20T11:46:55.531 INFO:teuthology.orchestra.run.smithi192.stdout:last_changed 2020-11-20T11:46:55.517869+0000 2020-11-20T11:46:55.532 INFO:teuthology.orchestra.run.smithi192.stdout:created 2020-11-20T11:46:55.517869+0000 2020-11-20T11:46:55.534 INFO:teuthology.orchestra.run.smithi192.stdout:min_mon_release 0 (unknown) 2020-11-20T11:46:55.535 INFO:teuthology.orchestra.run.smithi192.stdout:election_strategy: 1 2020-11-20T11:46:55.536 INFO:teuthology.orchestra.run.smithi192.stdout:0: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.a 2020-11-20T11:46:55.547 INFO:teuthology.orchestra.run.smithi192.stdout:1: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.b 2020-11-20T11:46:55.548 INFO:teuthology.orchestra.run.smithi192.stdout:2: [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] mon.c 2020-11-20T11:46:55.548 INFO:teuthology.orchestra.run.smithi192.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2020-11-20T11:46:55.549 INFO:teuthology.orchestra.run.smithi192:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2020-11-20T11:46:55.584 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 4871390d-d110-4379-8302-5810d7b54f34... 2020-11-20T11:46:55.586 INFO:teuthology.orchestra.run.smithi087:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-11-20T11:46:55.592 INFO:teuthology.orchestra.run.smithi146:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-11-20T11:46:55.599 INFO:teuthology.orchestra.run.smithi192:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-11-20T11:46:55.638 INFO:teuthology.orchestra.run.smithi087.stdout:[global] 2020-11-20T11:46:55.639 INFO:teuthology.orchestra.run.smithi087.stdout: chdir = "" 2020-11-20T11:46:55.639 INFO:teuthology.orchestra.run.smithi087.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-11-20T11:46:55.640 INFO:teuthology.orchestra.run.smithi087.stdout: auth supported = cephx 2020-11-20T11:46:55.640 INFO:teuthology.orchestra.run.smithi087.stdout: 2020-11-20T11:46:55.640 INFO:teuthology.orchestra.run.smithi087.stdout: filestore xattr use omap = true 2020-11-20T11:46:55.641 INFO:teuthology.orchestra.run.smithi087.stdout: 2020-11-20T11:46:55.641 INFO:teuthology.orchestra.run.smithi087.stdout: mon clock drift allowed = 1.000 2020-11-20T11:46:55.641 INFO:teuthology.orchestra.run.smithi087.stdout: 2020-11-20T11:46:55.642 INFO:teuthology.orchestra.run.smithi087.stdout: osd crush chooseleaf type = 0 2020-11-20T11:46:55.642 INFO:teuthology.orchestra.run.smithi087.stdout: auth debug = true 2020-11-20T11:46:55.642 INFO:teuthology.orchestra.run.smithi087.stdout: 2020-11-20T11:46:55.643 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on old message = true 2020-11-20T11:46:55.643 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on bug = true 2020-11-20T11:46:55.643 INFO:teuthology.orchestra.run.smithi087.stdout: 2020-11-20T11:46:55.644 INFO:teuthology.orchestra.run.smithi087.stdout: mon max pg per osd = 10000 # >= luminous 2020-11-20T11:46:55.644 INFO:teuthology.orchestra.run.smithi087.stdout: mon pg warn max object skew = 0 2020-11-20T11:46:55.644 INFO:teuthology.orchestra.run.smithi087.stdout: 2020-11-20T11:46:55.645 INFO:teuthology.orchestra.run.smithi087.stdout: # disable pg_autoscaler by default for new pools 2020-11-20T11:46:55.646 INFO:teuthology.orchestra.run.smithi087.stdout: osd_pool_default_pg_autoscale_mode = off 2020-11-20T11:46:55.646 INFO:teuthology.orchestra.run.smithi087.stdout: 2020-11-20T11:46:55.646 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default size = 2 2020-11-20T11:46:55.646 INFO:teuthology.orchestra.run.smithi087.stdout: 2020-11-20T11:46:55.647 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow primary affinity = true 2020-11-20T11:46:55.647 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow pg remap = true 2020-11-20T11:46:55.647 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on legacy crush tunables = false 2020-11-20T11:46:55.647 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on crush straw calc version zero = false 2020-11-20T11:46:55.647 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on no sortbitwise = false 2020-11-20T11:46:55.648 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on osd down out interval zero = false 2020-11-20T11:46:55.648 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on too few osds = false 2020-11-20T11:46:55.648 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-11-20T11:46:55.648 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_no_redundancy = false 2020-11-20T11:46:55.648 INFO:teuthology.orchestra.run.smithi087.stdout: mon_allow_pool_size_one = true 2020-11-20T11:46:55.649 INFO:teuthology.orchestra.run.smithi087.stdout: 2020-11-20T11:46:55.649 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-11-20T11:46:55.649 INFO:teuthology.orchestra.run.smithi087.stdout: 2020-11-20T11:46:55.649 INFO:teuthology.orchestra.run.smithi087.stdout: osd default data pool replay window = 5 2020-11-20T11:46:55.649 INFO:teuthology.orchestra.run.smithi087.stdout: 2020-11-20T11:46:55.650 INFO:teuthology.orchestra.run.smithi087.stdout: mon allow pool delete = true 2020-11-20T11:46:55.650 INFO:teuthology.orchestra.run.smithi087.stdout: 2020-11-20T11:46:55.650 INFO:teuthology.orchestra.run.smithi087.stdout: mon cluster log file level = debug 2020-11-20T11:46:55.650 INFO:teuthology.orchestra.run.smithi087.stdout: debug asserts on shutdown = true 2020-11-20T11:46:55.650 INFO:teuthology.orchestra.run.smithi087.stdout: mon health detail to clog = false 2020-11-20T11:46:55.651 INFO:teuthology.orchestra.run.smithi087.stdout: mon host = "172.21.15.192,172.21.15.146,172.21.15.87" 2020-11-20T11:46:55.651 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on skipped message = False 2020-11-20T11:46:55.651 INFO:teuthology.orchestra.run.smithi087.stdout: fsid = 4871390d-d110-4379-8302-5810d7b54f34 2020-11-20T11:46:55.651 INFO:teuthology.orchestra.run.smithi087.stdout: 2020-11-20T11:46:55.651 INFO:teuthology.orchestra.run.smithi087.stdout:[osd] 2020-11-20T11:46:55.651 INFO:teuthology.orchestra.run.smithi087.stdout: osd journal size = 100 2020-11-20T11:46:55.652 INFO:teuthology.orchestra.run.smithi087.stdout: 2020-11-20T11:46:55.652 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub load threshold = 5.0 2020-11-20T11:46:55.652 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub max interval = 600 2020-11-20T11:46:55.652 INFO:teuthology.orchestra.run.smithi087.stdout: 2020-11-20T11:46:55.652 INFO:teuthology.orchestra.run.smithi087.stdout: osd recover clone overlap = true 2020-11-20T11:46:55.653 INFO:teuthology.orchestra.run.smithi087.stdout: osd recovery max chunk = 1048576 2020-11-20T11:46:55.653 INFO:teuthology.orchestra.run.smithi087.stdout: 2020-11-20T11:46:55.653 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug shutdown = true 2020-11-20T11:46:55.653 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug op order = true 2020-11-20T11:46:55.654 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug verify stray on activate = true 2020-11-20T11:46:55.654 INFO:teuthology.orchestra.run.smithi087.stdout: 2020-11-20T11:46:55.654 INFO:teuthology.orchestra.run.smithi087.stdout: osd open classes on start = true 2020-11-20T11:46:55.654 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug pg log writeout = true 2020-11-20T11:46:55.654 INFO:teuthology.orchestra.run.smithi087.stdout: 2020-11-20T11:46:55.655 INFO:teuthology.orchestra.run.smithi087.stdout: osd deep scrub update digest min age = 30 2020-11-20T11:46:55.655 INFO:teuthology.orchestra.run.smithi087.stdout: 2020-11-20T11:46:55.655 INFO:teuthology.orchestra.run.smithi087.stdout: osd map max advance = 10 2020-11-20T11:46:55.655 INFO:teuthology.orchestra.run.smithi087.stdout: 2020-11-20T11:46:55.655 INFO:teuthology.orchestra.run.smithi087.stdout: journal zero on create = true 2020-11-20T11:46:55.656 INFO:teuthology.orchestra.run.smithi087.stdout: 2020-11-20T11:46:55.656 INFO:teuthology.orchestra.run.smithi087.stdout: filestore ondisk finisher threads = 3 2020-11-20T11:46:55.656 INFO:teuthology.orchestra.run.smithi087.stdout: filestore apply finisher threads = 3 2020-11-20T11:46:55.656 INFO:teuthology.orchestra.run.smithi087.stdout: 2020-11-20T11:46:55.656 INFO:teuthology.orchestra.run.smithi087.stdout: bdev debug aio = true 2020-11-20T11:46:55.657 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug misdirected ops = true 2020-11-20T11:46:55.657 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore block size = 96636764160 2020-11-20T11:46:55.657 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore compression mode = aggressive 2020-11-20T11:46:55.657 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore fsck on mount = True 2020-11-20T11:46:55.657 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluefs = 20 2020-11-20T11:46:55.658 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluestore = 20 2020-11-20T11:46:55.658 INFO:teuthology.orchestra.run.smithi087.stdout: debug filestore = 20 2020-11-20T11:46:55.658 INFO:teuthology.orchestra.run.smithi087.stdout: debug journal = 20 2020-11-20T11:46:55.658 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 20 2020-11-20T11:46:55.659 INFO:teuthology.orchestra.run.smithi087.stdout: debug osd = 25 2020-11-20T11:46:55.659 INFO:teuthology.orchestra.run.smithi087.stdout: debug rocksdb = 10 2020-11-20T11:46:55.659 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd backfillfull_ratio = 0.85 2020-11-20T11:46:55.659 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd full ratio = 0.9 2020-11-20T11:46:55.660 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd nearfull ratio = 0.8 2020-11-20T11:46:55.660 INFO:teuthology.orchestra.run.smithi087.stdout: osd failsafe full ratio = 0.95 2020-11-20T11:46:55.660 INFO:teuthology.orchestra.run.smithi087.stdout: osd objectstore = bluestore 2020-11-20T11:46:55.660 INFO:teuthology.orchestra.run.smithi087.stdout: osd op complaint time = 180 2020-11-20T11:46:55.660 INFO:teuthology.orchestra.run.smithi087.stdout: osd shutdown pgref assert = True 2020-11-20T11:46:55.660 INFO:teuthology.orchestra.run.smithi087.stdout: osd_max_omap_entries_per_request = 10 2020-11-20T11:46:55.661 INFO:teuthology.orchestra.run.smithi087.stdout: 2020-11-20T11:46:55.661 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr] 2020-11-20T11:46:55.661 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2020-11-20T11:46:55.661 INFO:teuthology.orchestra.run.smithi087.stdout: debug mgr = 20 2020-11-20T11:46:55.661 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2020-11-20T11:46:55.662 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2020-11-20T11:46:55.662 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2020-11-20T11:46:55.662 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2020-11-20T11:46:55.662 INFO:teuthology.orchestra.run.smithi087.stdout: mgr/telemetry/nag = false 2020-11-20T11:46:55.662 INFO:teuthology.orchestra.run.smithi087.stdout: 2020-11-20T11:46:55.663 INFO:teuthology.orchestra.run.smithi087.stdout:[mon] 2020-11-20T11:46:55.663 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2020-11-20T11:46:55.663 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2020-11-20T11:46:55.663 INFO:teuthology.orchestra.run.smithi087.stdout: debug paxos = 20 2020-11-20T11:46:55.663 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2020-11-20T11:46:55.664 INFO:teuthology.orchestra.run.smithi087.stdout: mon data avail warn = 5 2020-11-20T11:46:55.664 INFO:teuthology.orchestra.run.smithi087.stdout: mon mgr mkfs grace = 240 2020-11-20T11:46:55.664 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2020-11-20T11:46:55.664 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd reporter subtree level = osd 2020-11-20T11:46:55.664 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd prime pg temp = true 2020-11-20T11:46:55.665 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2020-11-20T11:46:55.665 INFO:teuthology.orchestra.run.smithi087.stdout: mon op complaint time = 120 2020-11-20T11:46:55.665 INFO:teuthology.orchestra.run.smithi087.stdout: 2020-11-20T11:46:55.665 INFO:teuthology.orchestra.run.smithi087.stdout:[client] 2020-11-20T11:46:55.665 INFO:teuthology.orchestra.run.smithi087.stdout: rgw cache enabled = true 2020-11-20T11:46:55.665 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable ops log = true 2020-11-20T11:46:55.666 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable usage log = true 2020-11-20T11:46:55.666 INFO:teuthology.orchestra.run.smithi087.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-11-20T11:46:55.666 INFO:teuthology.orchestra.run.smithi087.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-11-20T11:46:55.666 INFO:teuthology.orchestra.run.smithi087.stdout: client mount timeout = 600 2020-11-20T11:46:55.666 INFO:teuthology.orchestra.run.smithi087.stdout: debug client = 20 2020-11-20T11:46:55.667 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2020-11-20T11:46:55.667 INFO:teuthology.orchestra.run.smithi087.stdout: rados mon op timeout = 15m 2020-11-20T11:46:55.667 INFO:teuthology.orchestra.run.smithi087.stdout: rados osd op timeout = 15m 2020-11-20T11:46:55.667 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.a] 2020-11-20T11:46:55.667 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.b] 2020-11-20T11:46:55.668 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.c] 2020-11-20T11:46:55.668 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.a] 2020-11-20T11:46:55.668 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.b] 2020-11-20T11:46:55.668 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.c] 2020-11-20T11:46:55.668 INFO:teuthology.orchestra.run.smithi087.stdout:[mds] 2020-11-20T11:46:55.669 INFO:teuthology.orchestra.run.smithi087.stdout: debug mds = 20 2020-11-20T11:46:55.669 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2020-11-20T11:46:55.669 INFO:teuthology.orchestra.run.smithi087.stdout: mds bal frag = True 2020-11-20T11:46:55.669 INFO:teuthology.orchestra.run.smithi087.stdout: mds bal fragment size max = 10000 2020-11-20T11:46:55.670 INFO:teuthology.orchestra.run.smithi087.stdout: mds bal merge size = 5 2020-11-20T11:46:55.670 INFO:teuthology.orchestra.run.smithi087.stdout: mds bal split bits = 3 2020-11-20T11:46:55.670 INFO:teuthology.orchestra.run.smithi087.stdout: mds bal split size = 100 2020-11-20T11:46:55.671 INFO:teuthology.orchestra.run.smithi087.stdout: mds debug frag = True 2020-11-20T11:46:55.671 INFO:teuthology.orchestra.run.smithi087.stdout: mds debug scatterstat = True 2020-11-20T11:46:55.671 INFO:teuthology.orchestra.run.smithi087.stdout: mds op complaint time = 180 2020-11-20T11:46:55.671 INFO:teuthology.orchestra.run.smithi087.stdout: mds verify scatter = True 2020-11-20T11:46:55.671 INFO:teuthology.orchestra.run.smithi087.stdout: osd op complaint time = 180 2020-11-20T11:46:55.672 INFO:teuthology.orchestra.run.smithi087.stdout: rados mon op timeout = 15m 2020-11-20T11:46:55.672 INFO:teuthology.orchestra.run.smithi087.stdout: rados osd op timeout = 15m 2020-11-20T11:46:55.674 INFO:teuthology.orchestra.run.smithi192.stdout:[global] 2020-11-20T11:46:55.674 INFO:teuthology.orchestra.run.smithi192.stdout: chdir = "" 2020-11-20T11:46:55.674 INFO:teuthology.orchestra.run.smithi192.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-11-20T11:46:55.675 INFO:teuthology.orchestra.run.smithi192.stdout: auth supported = cephx 2020-11-20T11:46:55.675 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:46:55.675 INFO:teuthology.orchestra.run.smithi192.stdout: filestore xattr use omap = true 2020-11-20T11:46:55.675 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:46:55.675 INFO:teuthology.orchestra.run.smithi192.stdout: mon clock drift allowed = 1.000 2020-11-20T11:46:55.676 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:46:55.676 INFO:teuthology.orchestra.run.smithi192.stdout: osd crush chooseleaf type = 0 2020-11-20T11:46:55.676 INFO:teuthology.orchestra.run.smithi192.stdout: auth debug = true 2020-11-20T11:46:55.676 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:46:55.676 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on old message = true 2020-11-20T11:46:55.677 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on bug = true 2020-11-20T11:46:55.677 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:46:55.677 INFO:teuthology.orchestra.run.smithi192.stdout: mon max pg per osd = 10000 # >= luminous 2020-11-20T11:46:55.677 INFO:teuthology.orchestra.run.smithi192.stdout: mon pg warn max object skew = 0 2020-11-20T11:46:55.677 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:46:55.678 INFO:teuthology.orchestra.run.smithi192.stdout: # disable pg_autoscaler by default for new pools 2020-11-20T11:46:55.678 INFO:teuthology.orchestra.run.smithi192.stdout: osd_pool_default_pg_autoscale_mode = off 2020-11-20T11:46:55.678 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:46:55.678 INFO:teuthology.orchestra.run.smithi192.stdout: osd pool default size = 2 2020-11-20T11:46:55.678 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:46:55.679 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd allow primary affinity = true 2020-11-20T11:46:55.679 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd allow pg remap = true 2020-11-20T11:46:55.679 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on legacy crush tunables = false 2020-11-20T11:46:55.679 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on crush straw calc version zero = false 2020-11-20T11:46:55.679 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on no sortbitwise = false 2020-11-20T11:46:55.680 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on osd down out interval zero = false 2020-11-20T11:46:55.680 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on too few osds = false 2020-11-20T11:46:55.680 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-11-20T11:46:55.680 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_pool_no_redundancy = false 2020-11-20T11:46:55.680 INFO:teuthology.orchestra.run.smithi192.stdout: mon_allow_pool_size_one = true 2020-11-20T11:46:55.681 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:46:55.681 INFO:teuthology.orchestra.run.smithi192.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-11-20T11:46:55.681 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:46:55.681 INFO:teuthology.orchestra.run.smithi192.stdout: osd default data pool replay window = 5 2020-11-20T11:46:55.681 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:46:55.682 INFO:teuthology.orchestra.run.smithi192.stdout: mon allow pool delete = true 2020-11-20T11:46:55.682 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:46:55.682 INFO:teuthology.orchestra.run.smithi192.stdout: mon cluster log file level = debug 2020-11-20T11:46:55.682 INFO:teuthology.orchestra.run.smithi192.stdout: debug asserts on shutdown = true 2020-11-20T11:46:55.682 INFO:teuthology.orchestra.run.smithi192.stdout: mon health detail to clog = false 2020-11-20T11:46:55.683 INFO:teuthology.orchestra.run.smithi192.stdout: mon host = "172.21.15.192,172.21.15.146,172.21.15.87" 2020-11-20T11:46:55.683 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on skipped message = False 2020-11-20T11:46:55.683 INFO:teuthology.orchestra.run.smithi192.stdout: fsid = 4871390d-d110-4379-8302-5810d7b54f34 2020-11-20T11:46:55.683 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:46:55.683 INFO:teuthology.orchestra.run.smithi192.stdout:[osd] 2020-11-20T11:46:55.683 INFO:teuthology.orchestra.run.smithi192.stdout: osd journal size = 100 2020-11-20T11:46:55.684 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:46:55.684 INFO:teuthology.orchestra.run.smithi192.stdout: osd scrub load threshold = 5.0 2020-11-20T11:46:55.684 INFO:teuthology.orchestra.run.smithi192.stdout: osd scrub max interval = 600 2020-11-20T11:46:55.684 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:46:55.684 INFO:teuthology.orchestra.run.smithi192.stdout: osd recover clone overlap = true 2020-11-20T11:46:55.685 INFO:teuthology.orchestra.run.smithi192.stdout: osd recovery max chunk = 1048576 2020-11-20T11:46:55.685 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:46:55.685 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug shutdown = true 2020-11-20T11:46:55.685 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug op order = true 2020-11-20T11:46:55.685 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug verify stray on activate = true 2020-11-20T11:46:55.686 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:46:55.686 INFO:teuthology.orchestra.run.smithi192.stdout: osd open classes on start = true 2020-11-20T11:46:55.686 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug pg log writeout = true 2020-11-20T11:46:55.686 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:46:55.686 INFO:teuthology.orchestra.run.smithi192.stdout: osd deep scrub update digest min age = 30 2020-11-20T11:46:55.687 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:46:55.687 INFO:teuthology.orchestra.run.smithi192.stdout: osd map max advance = 10 2020-11-20T11:46:55.687 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:46:55.687 INFO:teuthology.orchestra.run.smithi192.stdout: journal zero on create = true 2020-11-20T11:46:55.687 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:46:55.688 INFO:teuthology.orchestra.run.smithi192.stdout: filestore ondisk finisher threads = 3 2020-11-20T11:46:55.688 INFO:teuthology.orchestra.run.smithi192.stdout: filestore apply finisher threads = 3 2020-11-20T11:46:55.688 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:46:55.688 INFO:teuthology.orchestra.run.smithi192.stdout: bdev debug aio = true 2020-11-20T11:46:55.688 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug misdirected ops = true 2020-11-20T11:46:55.689 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore block size = 96636764160 2020-11-20T11:46:55.689 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore compression mode = aggressive 2020-11-20T11:46:55.689 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore fsck on mount = True 2020-11-20T11:46:55.689 INFO:teuthology.orchestra.run.smithi192.stdout: debug bluefs = 20 2020-11-20T11:46:55.689 INFO:teuthology.orchestra.run.smithi192.stdout: debug bluestore = 20 2020-11-20T11:46:55.689 INFO:teuthology.orchestra.run.smithi192.stdout: debug filestore = 20 2020-11-20T11:46:55.690 INFO:teuthology.orchestra.run.smithi192.stdout: debug journal = 20 2020-11-20T11:46:55.690 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 20 2020-11-20T11:46:55.690 INFO:teuthology.orchestra.run.smithi192.stdout: debug osd = 25 2020-11-20T11:46:55.690 INFO:teuthology.orchestra.run.smithi192.stdout: debug rocksdb = 10 2020-11-20T11:46:55.690 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd backfillfull_ratio = 0.85 2020-11-20T11:46:55.691 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd full ratio = 0.9 2020-11-20T11:46:55.691 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd nearfull ratio = 0.8 2020-11-20T11:46:55.691 INFO:teuthology.orchestra.run.smithi192.stdout: osd failsafe full ratio = 0.95 2020-11-20T11:46:55.691 INFO:teuthology.orchestra.run.smithi192.stdout: osd objectstore = bluestore 2020-11-20T11:46:55.691 INFO:teuthology.orchestra.run.smithi192.stdout: osd op complaint time = 180 2020-11-20T11:46:55.692 INFO:teuthology.orchestra.run.smithi192.stdout: osd shutdown pgref assert = True 2020-11-20T11:46:55.692 INFO:teuthology.orchestra.run.smithi192.stdout: osd_max_omap_entries_per_request = 10 2020-11-20T11:46:55.692 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:46:55.692 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr] 2020-11-20T11:46:55.692 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2020-11-20T11:46:55.693 INFO:teuthology.orchestra.run.smithi192.stdout: debug mgr = 20 2020-11-20T11:46:55.693 INFO:teuthology.orchestra.run.smithi192.stdout: debug mon = 20 2020-11-20T11:46:55.693 INFO:teuthology.orchestra.run.smithi192.stdout: debug auth = 20 2020-11-20T11:46:55.693 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min pgs per osd = 4 2020-11-20T11:46:55.693 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min bytes per osd = 10 2020-11-20T11:46:55.694 INFO:teuthology.orchestra.run.smithi192.stdout: mgr/telemetry/nag = false 2020-11-20T11:46:55.694 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:46:55.694 INFO:teuthology.orchestra.run.smithi192.stdout:[mon] 2020-11-20T11:46:55.694 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2020-11-20T11:46:55.694 INFO:teuthology.orchestra.run.smithi192.stdout: debug mon = 20 2020-11-20T11:46:55.695 INFO:teuthology.orchestra.run.smithi192.stdout: debug paxos = 20 2020-11-20T11:46:55.695 INFO:teuthology.orchestra.run.smithi192.stdout: debug auth = 20 2020-11-20T11:46:55.695 INFO:teuthology.orchestra.run.smithi192.stdout: mon data avail warn = 5 2020-11-20T11:46:55.695 INFO:teuthology.orchestra.run.smithi192.stdout: mon mgr mkfs grace = 240 2020-11-20T11:46:55.695 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min pgs per osd = 4 2020-11-20T11:46:55.695 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd reporter subtree level = osd 2020-11-20T11:46:55.696 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd prime pg temp = true 2020-11-20T11:46:55.696 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min bytes per osd = 10 2020-11-20T11:46:55.696 INFO:teuthology.orchestra.run.smithi192.stdout: mon op complaint time = 120 2020-11-20T11:46:55.696 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:46:55.696 INFO:teuthology.orchestra.run.smithi192.stdout:[client] 2020-11-20T11:46:55.700 INFO:teuthology.orchestra.run.smithi192.stdout: rgw cache enabled = true 2020-11-20T11:46:55.700 INFO:teuthology.orchestra.run.smithi192.stdout: rgw enable ops log = true 2020-11-20T11:46:55.700 INFO:teuthology.orchestra.run.smithi192.stdout: rgw enable usage log = true 2020-11-20T11:46:55.701 INFO:teuthology.orchestra.run.smithi192.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-11-20T11:46:55.701 INFO:teuthology.orchestra.run.smithi192.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-11-20T11:46:55.701 INFO:teuthology.orchestra.run.smithi192.stdout: client mount timeout = 600 2020-11-20T11:46:55.701 INFO:teuthology.orchestra.run.smithi192.stdout: debug client = 20 2020-11-20T11:46:55.701 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2020-11-20T11:46:55.702 INFO:teuthology.orchestra.run.smithi192.stdout: rados mon op timeout = 15m 2020-11-20T11:46:55.702 INFO:teuthology.orchestra.run.smithi192.stdout: rados osd op timeout = 15m 2020-11-20T11:46:55.702 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.a] 2020-11-20T11:46:55.702 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.b] 2020-11-20T11:46:55.702 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.c] 2020-11-20T11:46:55.703 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.a] 2020-11-20T11:46:55.703 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.b] 2020-11-20T11:46:55.703 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.c] 2020-11-20T11:46:55.703 INFO:teuthology.orchestra.run.smithi192.stdout:[mds] 2020-11-20T11:46:55.703 INFO:teuthology.orchestra.run.smithi192.stdout: debug mds = 20 2020-11-20T11:46:55.704 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2020-11-20T11:46:55.704 INFO:teuthology.orchestra.run.smithi192.stdout: mds bal frag = True 2020-11-20T11:46:55.704 INFO:teuthology.orchestra.run.smithi192.stdout: mds bal fragment size max = 10000 2020-11-20T11:46:55.704 INFO:teuthology.orchestra.run.smithi192.stdout: mds bal merge size = 5 2020-11-20T11:46:55.704 INFO:teuthology.orchestra.run.smithi192.stdout: mds bal split bits = 3 2020-11-20T11:46:55.705 INFO:teuthology.orchestra.run.smithi192.stdout: mds bal split size = 100 2020-11-20T11:46:55.705 INFO:teuthology.orchestra.run.smithi192.stdout: mds debug frag = True 2020-11-20T11:46:55.705 INFO:teuthology.orchestra.run.smithi192.stdout: mds debug scatterstat = True 2020-11-20T11:46:55.705 INFO:teuthology.orchestra.run.smithi192.stdout: mds op complaint time = 180 2020-11-20T11:46:55.705 INFO:teuthology.orchestra.run.smithi192.stdout: mds verify scatter = True 2020-11-20T11:46:55.706 INFO:teuthology.orchestra.run.smithi192.stdout: osd op complaint time = 180 2020-11-20T11:46:55.706 INFO:teuthology.orchestra.run.smithi192.stdout: rados mon op timeout = 15m 2020-11-20T11:46:55.706 INFO:teuthology.orchestra.run.smithi192.stdout: rados osd op timeout = 15m 2020-11-20T11:46:55.706 INFO:teuthology.orchestra.run.smithi146.stdout:[global] 2020-11-20T11:46:55.707 INFO:teuthology.orchestra.run.smithi146.stdout: chdir = "" 2020-11-20T11:46:55.707 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-11-20T11:46:55.707 INFO:teuthology.orchestra.run.smithi146.stdout: auth supported = cephx 2020-11-20T11:46:55.707 INFO:teuthology.orchestra.run.smithi146.stdout: 2020-11-20T11:46:55.707 INFO:teuthology.orchestra.run.smithi146.stdout: filestore xattr use omap = true 2020-11-20T11:46:55.708 INFO:teuthology.orchestra.run.smithi146.stdout: 2020-11-20T11:46:55.708 INFO:teuthology.orchestra.run.smithi146.stdout: mon clock drift allowed = 1.000 2020-11-20T11:46:55.708 INFO:teuthology.orchestra.run.smithi146.stdout: 2020-11-20T11:46:55.708 INFO:teuthology.orchestra.run.smithi146.stdout: osd crush chooseleaf type = 0 2020-11-20T11:46:55.708 INFO:teuthology.orchestra.run.smithi146.stdout: auth debug = true 2020-11-20T11:46:55.709 INFO:teuthology.orchestra.run.smithi146.stdout: 2020-11-20T11:46:55.709 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on old message = true 2020-11-20T11:46:55.709 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on bug = true 2020-11-20T11:46:55.709 INFO:teuthology.orchestra.run.smithi146.stdout: 2020-11-20T11:46:55.709 INFO:teuthology.orchestra.run.smithi146.stdout: mon max pg per osd = 10000 # >= luminous 2020-11-20T11:46:55.710 INFO:teuthology.orchestra.run.smithi146.stdout: mon pg warn max object skew = 0 2020-11-20T11:46:55.710 INFO:teuthology.orchestra.run.smithi146.stdout: 2020-11-20T11:46:55.710 INFO:teuthology.orchestra.run.smithi146.stdout: # disable pg_autoscaler by default for new pools 2020-11-20T11:46:55.710 INFO:teuthology.orchestra.run.smithi146.stdout: osd_pool_default_pg_autoscale_mode = off 2020-11-20T11:46:55.710 INFO:teuthology.orchestra.run.smithi146.stdout: 2020-11-20T11:46:55.711 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default size = 2 2020-11-20T11:46:55.711 INFO:teuthology.orchestra.run.smithi146.stdout: 2020-11-20T11:46:55.711 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow primary affinity = true 2020-11-20T11:46:55.711 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow pg remap = true 2020-11-20T11:46:55.711 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on legacy crush tunables = false 2020-11-20T11:46:55.712 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on crush straw calc version zero = false 2020-11-20T11:46:55.712 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on no sortbitwise = false 2020-11-20T11:46:55.712 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on osd down out interval zero = false 2020-11-20T11:46:55.712 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on too few osds = false 2020-11-20T11:46:55.712 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-11-20T11:46:55.713 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_no_redundancy = false 2020-11-20T11:46:55.717 INFO:teuthology.orchestra.run.smithi146.stdout: mon_allow_pool_size_one = true 2020-11-20T11:46:55.717 INFO:teuthology.orchestra.run.smithi146.stdout: 2020-11-20T11:46:55.717 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-11-20T11:46:55.717 INFO:teuthology.orchestra.run.smithi146.stdout: 2020-11-20T11:46:55.718 INFO:teuthology.orchestra.run.smithi146.stdout: osd default data pool replay window = 5 2020-11-20T11:46:55.718 INFO:teuthology.orchestra.run.smithi146.stdout: 2020-11-20T11:46:55.718 INFO:teuthology.orchestra.run.smithi146.stdout: mon allow pool delete = true 2020-11-20T11:46:55.718 INFO:teuthology.orchestra.run.smithi146.stdout: 2020-11-20T11:46:55.718 INFO:teuthology.orchestra.run.smithi146.stdout: mon cluster log file level = debug 2020-11-20T11:46:55.719 INFO:teuthology.orchestra.run.smithi146.stdout: debug asserts on shutdown = true 2020-11-20T11:46:55.719 INFO:teuthology.orchestra.run.smithi146.stdout: mon health detail to clog = false 2020-11-20T11:46:55.719 INFO:teuthology.orchestra.run.smithi146.stdout: mon host = "172.21.15.192,172.21.15.146,172.21.15.87" 2020-11-20T11:46:55.719 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on skipped message = False 2020-11-20T11:46:55.719 INFO:teuthology.orchestra.run.smithi146.stdout: fsid = 4871390d-d110-4379-8302-5810d7b54f34 2020-11-20T11:46:55.720 INFO:teuthology.orchestra.run.smithi146.stdout: 2020-11-20T11:46:55.720 INFO:teuthology.orchestra.run.smithi146.stdout:[osd] 2020-11-20T11:46:55.720 INFO:teuthology.orchestra.run.smithi146.stdout: osd journal size = 100 2020-11-20T11:46:55.720 INFO:teuthology.orchestra.run.smithi146.stdout: 2020-11-20T11:46:55.720 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub load threshold = 5.0 2020-11-20T11:46:55.721 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub max interval = 600 2020-11-20T11:46:55.721 INFO:teuthology.orchestra.run.smithi146.stdout: 2020-11-20T11:46:55.721 INFO:teuthology.orchestra.run.smithi146.stdout: osd recover clone overlap = true 2020-11-20T11:46:55.721 INFO:teuthology.orchestra.run.smithi146.stdout: osd recovery max chunk = 1048576 2020-11-20T11:46:55.721 INFO:teuthology.orchestra.run.smithi146.stdout: 2020-11-20T11:46:55.722 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug shutdown = true 2020-11-20T11:46:55.722 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug op order = true 2020-11-20T11:46:55.722 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug verify stray on activate = true 2020-11-20T11:46:55.722 INFO:teuthology.orchestra.run.smithi146.stdout: 2020-11-20T11:46:55.722 INFO:teuthology.orchestra.run.smithi146.stdout: osd open classes on start = true 2020-11-20T11:46:55.723 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug pg log writeout = true 2020-11-20T11:46:55.723 INFO:teuthology.orchestra.run.smithi146.stdout: 2020-11-20T11:46:55.723 INFO:teuthology.orchestra.run.smithi146.stdout: osd deep scrub update digest min age = 30 2020-11-20T11:46:55.723 INFO:teuthology.orchestra.run.smithi146.stdout: 2020-11-20T11:46:55.723 INFO:teuthology.orchestra.run.smithi146.stdout: osd map max advance = 10 2020-11-20T11:46:55.724 INFO:teuthology.orchestra.run.smithi146.stdout: 2020-11-20T11:46:55.724 INFO:teuthology.orchestra.run.smithi146.stdout: journal zero on create = true 2020-11-20T11:46:55.724 INFO:teuthology.orchestra.run.smithi146.stdout: 2020-11-20T11:46:55.724 INFO:teuthology.orchestra.run.smithi146.stdout: filestore ondisk finisher threads = 3 2020-11-20T11:46:55.724 INFO:teuthology.orchestra.run.smithi146.stdout: filestore apply finisher threads = 3 2020-11-20T11:46:55.725 INFO:teuthology.orchestra.run.smithi146.stdout: 2020-11-20T11:46:55.725 INFO:teuthology.orchestra.run.smithi146.stdout: bdev debug aio = true 2020-11-20T11:46:55.725 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug misdirected ops = true 2020-11-20T11:46:55.725 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore block size = 96636764160 2020-11-20T11:46:55.725 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore compression mode = aggressive 2020-11-20T11:46:55.726 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore fsck on mount = True 2020-11-20T11:46:55.726 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluefs = 20 2020-11-20T11:46:55.726 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluestore = 20 2020-11-20T11:46:55.726 INFO:teuthology.orchestra.run.smithi146.stdout: debug filestore = 20 2020-11-20T11:46:55.727 INFO:teuthology.orchestra.run.smithi146.stdout: debug journal = 20 2020-11-20T11:46:55.727 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 20 2020-11-20T11:46:55.727 INFO:teuthology.orchestra.run.smithi146.stdout: debug osd = 25 2020-11-20T11:46:55.727 INFO:teuthology.orchestra.run.smithi146.stdout: debug rocksdb = 10 2020-11-20T11:46:55.727 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd backfillfull_ratio = 0.85 2020-11-20T11:46:55.728 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd full ratio = 0.9 2020-11-20T11:46:55.728 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd nearfull ratio = 0.8 2020-11-20T11:46:55.728 INFO:teuthology.orchestra.run.smithi146.stdout: osd failsafe full ratio = 0.95 2020-11-20T11:46:55.728 INFO:teuthology.orchestra.run.smithi146.stdout: osd objectstore = bluestore 2020-11-20T11:46:55.728 INFO:teuthology.orchestra.run.smithi146.stdout: osd op complaint time = 180 2020-11-20T11:46:55.729 INFO:teuthology.orchestra.run.smithi146.stdout: osd shutdown pgref assert = True 2020-11-20T11:46:55.729 INFO:teuthology.orchestra.run.smithi146.stdout: osd_max_omap_entries_per_request = 10 2020-11-20T11:46:55.729 INFO:teuthology.orchestra.run.smithi146.stdout: 2020-11-20T11:46:55.729 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr] 2020-11-20T11:46:55.729 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2020-11-20T11:46:55.730 INFO:teuthology.orchestra.run.smithi146.stdout: debug mgr = 20 2020-11-20T11:46:55.730 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2020-11-20T11:46:55.730 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2020-11-20T11:46:55.730 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2020-11-20T11:46:55.730 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2020-11-20T11:46:55.731 INFO:teuthology.orchestra.run.smithi146.stdout: mgr/telemetry/nag = false 2020-11-20T11:46:55.731 INFO:teuthology.orchestra.run.smithi146.stdout: 2020-11-20T11:46:55.731 INFO:teuthology.orchestra.run.smithi146.stdout:[mon] 2020-11-20T11:46:55.731 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2020-11-20T11:46:55.731 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2020-11-20T11:46:55.732 INFO:teuthology.orchestra.run.smithi146.stdout: debug paxos = 20 2020-11-20T11:46:55.732 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2020-11-20T11:46:55.732 INFO:teuthology.orchestra.run.smithi146.stdout: mon data avail warn = 5 2020-11-20T11:46:55.732 INFO:teuthology.orchestra.run.smithi146.stdout: mon mgr mkfs grace = 240 2020-11-20T11:46:55.732 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2020-11-20T11:46:55.733 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd reporter subtree level = osd 2020-11-20T11:46:55.733 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd prime pg temp = true 2020-11-20T11:46:55.733 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2020-11-20T11:46:55.733 INFO:teuthology.orchestra.run.smithi146.stdout: mon op complaint time = 120 2020-11-20T11:46:55.733 INFO:teuthology.orchestra.run.smithi146.stdout: 2020-11-20T11:46:55.734 INFO:teuthology.orchestra.run.smithi146.stdout:[client] 2020-11-20T11:46:55.734 INFO:teuthology.orchestra.run.smithi146.stdout: rgw cache enabled = true 2020-11-20T11:46:55.734 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable ops log = true 2020-11-20T11:46:55.734 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable usage log = true 2020-11-20T11:46:55.734 INFO:teuthology.orchestra.run.smithi146.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-11-20T11:46:55.735 INFO:teuthology.orchestra.run.smithi146.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-11-20T11:46:55.735 INFO:teuthology.orchestra.run.smithi146.stdout: client mount timeout = 600 2020-11-20T11:46:55.735 INFO:teuthology.orchestra.run.smithi146.stdout: debug client = 20 2020-11-20T11:46:55.735 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2020-11-20T11:46:55.735 INFO:teuthology.orchestra.run.smithi146.stdout: rados mon op timeout = 15m 2020-11-20T11:46:55.736 INFO:teuthology.orchestra.run.smithi146.stdout: rados osd op timeout = 15m 2020-11-20T11:46:55.736 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.a] 2020-11-20T11:46:55.736 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.b] 2020-11-20T11:46:55.736 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.c] 2020-11-20T11:46:55.736 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.a] 2020-11-20T11:46:55.736 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.b] 2020-11-20T11:46:55.737 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.c] 2020-11-20T11:46:55.737 INFO:teuthology.orchestra.run.smithi146.stdout:[mds] 2020-11-20T11:46:55.737 INFO:teuthology.orchestra.run.smithi146.stdout: debug mds = 20 2020-11-20T11:46:55.737 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2020-11-20T11:46:55.737 INFO:teuthology.orchestra.run.smithi146.stdout: mds bal frag = True 2020-11-20T11:46:55.738 INFO:teuthology.orchestra.run.smithi146.stdout: mds bal fragment size max = 10000 2020-11-20T11:46:55.738 INFO:teuthology.orchestra.run.smithi146.stdout: mds bal merge size = 5 2020-11-20T11:46:55.738 INFO:teuthology.orchestra.run.smithi146.stdout: mds bal split bits = 3 2020-11-20T11:46:55.738 INFO:teuthology.orchestra.run.smithi146.stdout: mds bal split size = 100 2020-11-20T11:46:55.738 INFO:teuthology.orchestra.run.smithi146.stdout: mds debug frag = True 2020-11-20T11:46:55.739 INFO:teuthology.orchestra.run.smithi146.stdout: mds debug scatterstat = True 2020-11-20T11:46:55.739 INFO:teuthology.orchestra.run.smithi146.stdout: mds op complaint time = 180 2020-11-20T11:46:55.739 INFO:teuthology.orchestra.run.smithi146.stdout: mds verify scatter = True 2020-11-20T11:46:55.739 INFO:teuthology.orchestra.run.smithi146.stdout: osd op complaint time = 180 2020-11-20T11:46:55.739 INFO:teuthology.orchestra.run.smithi146.stdout: rados mon op timeout = 15m 2020-11-20T11:46:55.740 INFO:teuthology.orchestra.run.smithi146.stdout: rados osd op timeout = 15m 2020-11-20T11:46:55.741 INFO:tasks.ceph:Creating admin key on mon.a... 2020-11-20T11:46:55.741 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2020-11-20T11:46:55.832 INFO:tasks.ceph:Copying monmap to all nodes... 2020-11-20T11:46:55.833 INFO:teuthology.orchestra.run.smithi192:> set -ex 2020-11-20T11:46:55.834 INFO:teuthology.orchestra.run.smithi192:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2020-11-20T11:46:55.850 INFO:teuthology.orchestra.run.smithi192.stderr:+ dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2020-11-20T11:46:55.851 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records in 2020-11-20T11:46:55.851 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records out 2020-11-20T11:46:55.851 INFO:teuthology.orchestra.run.smithi192.stderr:206 bytes copied, 2.9559e-05 s, 7.0 MB/s 2020-11-20T11:46:55.851 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.] 2020-11-20T11:46:55.852 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCvrLdflA+bERAAfggeeANxWBkYqyayChTsZQ== 2020-11-20T11:46:55.852 INFO:teuthology.orchestra.run.smithi192.stdout:[client.admin] 2020-11-20T11:46:55.852 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCvrLdfLAtcMRAAL54B59j5bHetfqkBg3jtHg== 2020-11-20T11:46:55.853 INFO:teuthology.orchestra.run.smithi192.stdout: caps mds = "allow *" 2020-11-20T11:46:55.853 INFO:teuthology.orchestra.run.smithi192.stdout: caps mgr = "allow *" 2020-11-20T11:46:55.853 INFO:teuthology.orchestra.run.smithi192.stdout: caps mon = "allow *" 2020-11-20T11:46:55.853 INFO:teuthology.orchestra.run.smithi192.stdout: caps osd = "allow *" 2020-11-20T11:46:55.854 INFO:teuthology.orchestra.run.smithi192:> set -ex 2020-11-20T11:46:55.854 INFO:teuthology.orchestra.run.smithi192:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2020-11-20T11:46:55.911 INFO:teuthology.orchestra.run.smithi192.stderr:+ dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2020-11-20T11:46:55.911 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records in 2020-11-20T11:46:55.911 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records out 2020-11-20T11:46:55.912 INFO:teuthology.orchestra.run.smithi192.stderr:409 bytes copied, 2.6334e-05 s, 15.5 MB/s 2020-11-20T11:46:55.912 INFO:teuthology.orchestra.run.smithi192.stdout: �Hq9 �Cy�X׵O4���_L����_L��aXa �����bXb �����cXc �W��Wabc 2020-11-20T11:46:55.912 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi192.front.sepia.ceph.com 2020-11-20T11:46:55.913 INFO:teuthology.orchestra.run.smithi192:> set -ex 2020-11-20T11:46:55.913 INFO:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T11:46:55.913 INFO:teuthology.orchestra.run.smithi192:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T11:46:55.966 INFO:teuthology.orchestra.run.smithi192.stderr:+ sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T11:46:55.976 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records in 2020-11-20T11:46:55.976 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records out 2020-11-20T11:46:55.976 INFO:teuthology.orchestra.run.smithi192.stderr:206 bytes copied, 5.6668e-05 s, 3.6 MB/s 2020-11-20T11:46:55.977 INFO:teuthology.orchestra.run.smithi192.stderr:+ sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T11:46:55.988 INFO:teuthology.orchestra.run.smithi192:> set -ex 2020-11-20T11:46:55.989 INFO:teuthology.orchestra.run.smithi192:> dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:46:56.044 INFO:teuthology.orchestra.run.smithi192.stderr:+ dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:46:56.045 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records in 2020-11-20T11:46:56.046 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records out 2020-11-20T11:46:56.046 INFO:teuthology.orchestra.run.smithi192.stderr:409 bytes copied, 4.8843e-05 s, 8.4 MB/s 2020-11-20T11:46:56.046 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi146.front.sepia.ceph.com 2020-11-20T11:46:56.047 INFO:teuthology.orchestra.run.smithi146:> set -ex 2020-11-20T11:46:56.047 INFO:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T11:46:56.047 INFO:teuthology.orchestra.run.smithi146:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T11:46:56.065 INFO:teuthology.orchestra.run.smithi146.stderr:+ sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T11:46:56.076 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records in 2020-11-20T11:46:56.076 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records out 2020-11-20T11:46:56.077 INFO:teuthology.orchestra.run.smithi146.stderr:206 bytes copied, 3.6137e-05 s, 5.7 MB/s 2020-11-20T11:46:56.077 INFO:teuthology.orchestra.run.smithi146.stderr:+ sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T11:46:56.091 INFO:teuthology.orchestra.run.smithi146:> set -ex 2020-11-20T11:46:56.092 INFO:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:46:56.152 INFO:teuthology.orchestra.run.smithi146.stderr:+ dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:46:56.157 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records in 2020-11-20T11:46:56.158 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records out 2020-11-20T11:46:56.158 INFO:teuthology.orchestra.run.smithi146.stderr:409 bytes copied, 0.000909278 s, 450 kB/s 2020-11-20T11:46:56.158 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi087.front.sepia.ceph.com 2020-11-20T11:46:56.159 INFO:teuthology.orchestra.run.smithi087:> set -ex 2020-11-20T11:46:56.159 INFO:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T11:46:56.159 INFO:teuthology.orchestra.run.smithi087:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T11:46:56.179 INFO:teuthology.orchestra.run.smithi087.stderr:+ sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T11:46:56.189 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records in 2020-11-20T11:46:56.190 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records out 2020-11-20T11:46:56.190 INFO:teuthology.orchestra.run.smithi087.stderr:206 bytes copied, 3.441e-05 s, 6.0 MB/s 2020-11-20T11:46:56.190 INFO:teuthology.orchestra.run.smithi087.stderr:+ sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T11:46:56.202 INFO:teuthology.orchestra.run.smithi087:> set -ex 2020-11-20T11:46:56.203 INFO:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:46:56.259 INFO:teuthology.orchestra.run.smithi087.stderr:+ dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:46:56.260 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records in 2020-11-20T11:46:56.260 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records out 2020-11-20T11:46:56.261 INFO:teuthology.orchestra.run.smithi087.stderr:409 bytes copied, 0.00027688 s, 1.5 MB/s 2020-11-20T11:46:56.261 INFO:tasks.ceph:Setting up mon nodes... 2020-11-20T11:46:56.262 INFO:tasks.ceph:Setting up mgr nodes... 2020-11-20T11:46:56.262 INFO:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2020-11-20T11:46:56.313 INFO:teuthology.orchestra.run.smithi192.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2020-11-20T11:46:56.315 INFO:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2020-11-20T11:46:56.381 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2020-11-20T11:46:56.384 INFO:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mgr/ceph-z && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.z /var/lib/ceph/mgr/ceph-z/keyring 2020-11-20T11:46:56.451 INFO:teuthology.orchestra.run.smithi087.stdout:creating /var/lib/ceph/mgr/ceph-z/keyring 2020-11-20T11:46:56.453 INFO:tasks.ceph:Setting up mds nodes... 2020-11-20T11:46:56.454 INFO:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2020-11-20T11:46:56.502 INFO:teuthology.orchestra.run.smithi192.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2020-11-20T11:46:56.504 INFO:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2020-11-20T11:46:56.528 INFO:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2020-11-20T11:46:56.580 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2020-11-20T11:46:56.582 INFO:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2020-11-20T11:46:56.607 INFO:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2020-11-20T11:46:56.660 INFO:teuthology.orchestra.run.smithi087.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2020-11-20T11:46:56.662 INFO:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2020-11-20T11:46:56.689 INFO:tasks.ceph_client:Setting up client nodes... 2020-11-20T11:46:56.690 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-11-20T11:46:56.726 INFO:teuthology.orchestra.run.smithi192.stdout:creating /etc/ceph/ceph.client.0.keyring 2020-11-20T11:46:56.738 INFO:tasks.ceph:Running mkfs on osd nodes... 2020-11-20T11:46:56.738 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi192.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi146.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi087.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'}} 2020-11-20T11:46:56.739 INFO:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2020-11-20T11:46:56.802 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2020-11-20T11:46:56.802 INFO:tasks.ceph:role: osd.0 2020-11-20T11:46:56.802 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi192.front.sepia.ceph.com 2020-11-20T11:46:56.803 INFO:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-11-20T11:46:56.874 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:46:56.874 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:46:56.874 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:46:56.875 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 2020-11-20T11:46:56.875 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:46:56.875 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:46:56.875 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:46:56.875 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:46:56.876 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:46:56.876 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:46:57.235 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2020-11-20T11:46:57.237 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2020-11-20T11:46:57.237 INFO:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2020-11-20T11:46:57.346 INFO:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2020-11-20T11:46:57.375 INFO:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2020-11-20T11:46:57.438 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2020-11-20T11:46:57.439 INFO:tasks.ceph:role: osd.3 2020-11-20T11:46:57.439 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi192.front.sepia.ceph.com 2020-11-20T11:46:57.440 INFO:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-11-20T11:46:57.510 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:46:57.510 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:46:57.510 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:46:57.511 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 2020-11-20T11:46:57.511 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:46:57.511 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:46:57.511 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:46:57.511 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:46:57.512 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:46:57.512 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:46:57.875 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2020-11-20T11:46:57.877 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2020-11-20T11:46:57.877 INFO:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2020-11-20T11:46:57.963 INFO:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2020-11-20T11:46:57.993 INFO:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2020-11-20T11:46:58.057 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2020-11-20T11:46:58.057 INFO:tasks.ceph:role: osd.6 2020-11-20T11:46:58.057 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi192.front.sepia.ceph.com 2020-11-20T11:46:58.058 INFO:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-11-20T11:46:58.131 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:46:58.131 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:46:58.131 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:46:58.131 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 2020-11-20T11:46:58.132 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:46:58.132 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:46:58.132 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:46:58.132 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:46:58.133 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:46:58.133 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:46:58.497 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2020-11-20T11:46:58.499 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2020-11-20T11:46:58.500 INFO:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2020-11-20T11:46:58.634 INFO:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2020-11-20T11:46:58.665 INFO:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-9 2020-11-20T11:46:58.730 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2020-11-20T11:46:58.730 INFO:tasks.ceph:role: osd.9 2020-11-20T11:46:58.731 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi192.front.sepia.ceph.com 2020-11-20T11:46:58.732 INFO:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-11-20T11:46:58.802 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:46:58.850 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:46:58.851 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:46:58.852 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 2020-11-20T11:46:58.852 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:46:58.852 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:46:58.853 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:46:58.853 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:46:58.854 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:46:58.854 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:46:59.178 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2020-11-20T11:46:59.179 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2020-11-20T11:46:59.180 INFO:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-9 2020-11-20T11:46:59.311 INFO:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-9 2020-11-20T11:46:59.340 INFO:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:46:59.421 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:46:59.418+0000 7f19ebf17f40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2020-11-20T11:46:59.425 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:46:59.422+0000 7f19ebf17f40 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2020-11-20T11:46:59.425 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:46:59.422+0000 7f19ebf17f40 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-11-20T11:46:59.425 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:46:59.422+0000 7f19ebf17f40 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-11-20T11:46:59.426 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:46:59.422+0000 7f19ebf17f40 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-11-20T11:46:59.430 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:46:59.426+0000 7f19ebf17f40 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2020-11-20T11:47:02.271 INFO:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-11-20T11:47:02.341 INFO:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:47:02.430 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:02.425+0000 7fb9c6eeef40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2020-11-20T11:47:02.431 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:02.425+0000 7fb9c6eeef40 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2020-11-20T11:47:02.431 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:02.425+0000 7fb9c6eeef40 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-11-20T11:47:02.431 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:02.425+0000 7fb9c6eeef40 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-11-20T11:47:02.431 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:02.425+0000 7fb9c6eeef40 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-11-20T11:47:02.431 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:02.425+0000 7fb9c6eeef40 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2020-11-20T11:47:05.279 INFO:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-11-20T11:47:05.323 INFO:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:47:05.422 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:05.418+0000 7fc46e78bf40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2020-11-20T11:47:05.423 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:05.418+0000 7fc46e78bf40 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2020-11-20T11:47:05.423 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:05.418+0000 7fc46e78bf40 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-11-20T11:47:05.423 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:05.418+0000 7fc46e78bf40 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-11-20T11:47:05.423 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:05.418+0000 7fc46e78bf40 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-11-20T11:47:05.424 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:05.419+0000 7fc46e78bf40 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2020-11-20T11:47:08.271 INFO:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-11-20T11:47:08.340 INFO:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 9 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:47:08.432 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:08.424+0000 7fa1eecfdf40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-9/keyring: can't open /var/lib/ceph/osd/ceph-9/keyring: (2) No such file or directory 2020-11-20T11:47:08.432 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:08.424+0000 7fa1eecfdf40 -1 created new key in keyring /var/lib/ceph/osd/ceph-9/keyring 2020-11-20T11:47:08.433 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:08.424+0000 7fa1eecfdf40 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2020-11-20T11:47:08.433 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:08.424+0000 7fa1eecfdf40 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2020-11-20T11:47:08.434 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:08.424+0000 7fa1eecfdf40 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2020-11-20T11:47:08.434 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:08.424+0000 7fa1eecfdf40 -1 bluestore(/var/lib/ceph/osd/ceph-9) _read_fsid unparsable uuid 2020-11-20T11:47:11.286 INFO:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2020-11-20T11:47:11.323 INFO:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2020-11-20T11:47:11.360 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2020-11-20T11:47:11.360 INFO:tasks.ceph:role: osd.1 2020-11-20T11:47:11.360 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi146.front.sepia.ceph.com 2020-11-20T11:47:11.361 INFO:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-11-20T11:47:11.448 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:47:11.448 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:47:11.448 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:47:11.449 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 2020-11-20T11:47:11.449 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:47:11.449 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:47:11.449 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:47:11.449 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:47:11.450 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:47:11.450 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:47:11.810 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2020-11-20T11:47:11.812 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2020-11-20T11:47:11.812 INFO:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2020-11-20T11:47:11.928 INFO:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2020-11-20T11:47:11.965 INFO:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2020-11-20T11:47:12.035 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2020-11-20T11:47:12.036 INFO:tasks.ceph:role: osd.4 2020-11-20T11:47:12.036 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi146.front.sepia.ceph.com 2020-11-20T11:47:12.036 INFO:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-11-20T11:47:12.109 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:47:12.110 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:47:12.110 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:47:12.110 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 2020-11-20T11:47:12.111 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:47:12.111 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:47:12.111 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:47:12.111 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:47:12.111 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:47:12.112 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:47:12.473 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2020-11-20T11:47:12.474 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2020-11-20T11:47:12.475 INFO:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2020-11-20T11:47:12.565 INFO:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2020-11-20T11:47:12.598 INFO:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2020-11-20T11:47:12.663 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2020-11-20T11:47:12.664 INFO:tasks.ceph:role: osd.7 2020-11-20T11:47:12.664 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi146.front.sepia.ceph.com 2020-11-20T11:47:12.665 INFO:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-11-20T11:47:12.736 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:47:12.737 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:47:12.737 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:47:12.737 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 2020-11-20T11:47:12.737 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:47:12.738 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:47:12.738 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:47:12.738 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:47:12.738 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:47:12.738 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:47:13.111 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2020-11-20T11:47:13.112 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2020-11-20T11:47:13.113 INFO:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-7 2020-11-20T11:47:13.225 INFO:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2020-11-20T11:47:13.254 INFO:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-10 2020-11-20T11:47:13.319 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2020-11-20T11:47:13.319 INFO:tasks.ceph:role: osd.10 2020-11-20T11:47:13.320 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi146.front.sepia.ceph.com 2020-11-20T11:47:13.320 INFO:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-11-20T11:47:13.393 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:47:13.393 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:47:13.393 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:47:13.394 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 2020-11-20T11:47:13.394 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:47:13.394 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:47:13.394 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:47:13.394 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:47:13.395 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:47:13.395 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:47:13.766 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2020-11-20T11:47:13.767 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2020-11-20T11:47:13.768 INFO:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-10 2020-11-20T11:47:13.889 INFO:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-10 2020-11-20T11:47:13.919 INFO:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:47:14.004 INFO:teuthology.orchestra.run.smithi146.stderr:2020-11-20T11:47:14.001+0000 7f99988a9f40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2020-11-20T11:47:14.009 INFO:teuthology.orchestra.run.smithi146.stderr:2020-11-20T11:47:14.006+0000 7f99988a9f40 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2020-11-20T11:47:14.009 INFO:teuthology.orchestra.run.smithi146.stderr:2020-11-20T11:47:14.006+0000 7f99988a9f40 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-11-20T11:47:14.009 INFO:teuthology.orchestra.run.smithi146.stderr:2020-11-20T11:47:14.006+0000 7f99988a9f40 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-11-20T11:47:14.009 INFO:teuthology.orchestra.run.smithi146.stderr:2020-11-20T11:47:14.006+0000 7f99988a9f40 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-11-20T11:47:14.010 INFO:teuthology.orchestra.run.smithi146.stderr:2020-11-20T11:47:14.007+0000 7f99988a9f40 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2020-11-20T11:47:16.850 INFO:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-11-20T11:47:16.889 INFO:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:47:16.980 INFO:teuthology.orchestra.run.smithi146.stderr:2020-11-20T11:47:16.976+0000 7fdc2a04bf40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2020-11-20T11:47:16.980 INFO:teuthology.orchestra.run.smithi146.stderr:2020-11-20T11:47:16.976+0000 7fdc2a04bf40 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2020-11-20T11:47:16.980 INFO:teuthology.orchestra.run.smithi146.stderr:2020-11-20T11:47:16.977+0000 7fdc2a04bf40 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-11-20T11:47:16.981 INFO:teuthology.orchestra.run.smithi146.stderr:2020-11-20T11:47:16.977+0000 7fdc2a04bf40 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-11-20T11:47:16.981 INFO:teuthology.orchestra.run.smithi146.stderr:2020-11-20T11:47:16.977+0000 7fdc2a04bf40 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-11-20T11:47:16.981 INFO:teuthology.orchestra.run.smithi146.stderr:2020-11-20T11:47:16.977+0000 7fdc2a04bf40 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2020-11-20T11:47:19.825 INFO:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-11-20T11:47:19.895 INFO:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:47:19.980 INFO:teuthology.orchestra.run.smithi146.stderr:2020-11-20T11:47:19.976+0000 7f7bd634af40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2020-11-20T11:47:19.980 INFO:teuthology.orchestra.run.smithi146.stderr:2020-11-20T11:47:19.977+0000 7f7bd634af40 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2020-11-20T11:47:19.980 INFO:teuthology.orchestra.run.smithi146.stderr:2020-11-20T11:47:19.977+0000 7f7bd634af40 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-11-20T11:47:19.981 INFO:teuthology.orchestra.run.smithi146.stderr:2020-11-20T11:47:19.977+0000 7f7bd634af40 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-11-20T11:47:19.981 INFO:teuthology.orchestra.run.smithi146.stderr:2020-11-20T11:47:19.977+0000 7f7bd634af40 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-11-20T11:47:19.981 INFO:teuthology.orchestra.run.smithi146.stderr:2020-11-20T11:47:19.977+0000 7f7bd634af40 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2020-11-20T11:47:22.828 INFO:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-11-20T11:47:22.975 INFO:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 10 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:47:23.069 INFO:teuthology.orchestra.run.smithi146.stderr:2020-11-20T11:47:23.064+0000 7f841d123f40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-10/keyring: can't open /var/lib/ceph/osd/ceph-10/keyring: (2) No such file or directory 2020-11-20T11:47:23.070 INFO:teuthology.orchestra.run.smithi146.stderr:2020-11-20T11:47:23.064+0000 7f841d123f40 -1 created new key in keyring /var/lib/ceph/osd/ceph-10/keyring 2020-11-20T11:47:23.070 INFO:teuthology.orchestra.run.smithi146.stderr:2020-11-20T11:47:23.064+0000 7f841d123f40 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2020-11-20T11:47:23.070 INFO:teuthology.orchestra.run.smithi146.stderr:2020-11-20T11:47:23.064+0000 7f841d123f40 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2020-11-20T11:47:23.070 INFO:teuthology.orchestra.run.smithi146.stderr:2020-11-20T11:47:23.064+0000 7f841d123f40 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2020-11-20T11:47:23.071 INFO:teuthology.orchestra.run.smithi146.stderr:2020-11-20T11:47:23.065+0000 7f841d123f40 -1 bluestore(/var/lib/ceph/osd/ceph-10) _read_fsid unparsable uuid 2020-11-20T11:47:24.017 INFO:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:47:24.020 INFO:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:47:24.022 INFO:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:47:25.914 INFO:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-10 2020-11-20T11:47:25.942 INFO:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2020-11-20T11:47:25.971 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2020-11-20T11:47:25.972 INFO:tasks.ceph:role: osd.2 2020-11-20T11:47:25.972 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi087.front.sepia.ceph.com 2020-11-20T11:47:25.973 INFO:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-11-20T11:47:26.046 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:47:26.047 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:47:26.047 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:47:26.047 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 2020-11-20T11:47:26.047 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:47:26.048 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:47:26.048 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:47:26.048 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:47:26.048 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:47:26.049 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:47:26.410 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2020-11-20T11:47:26.412 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2020-11-20T11:47:26.413 INFO:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2020-11-20T11:47:26.541 INFO:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2020-11-20T11:47:26.586 INFO:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2020-11-20T11:47:26.670 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2020-11-20T11:47:26.670 INFO:tasks.ceph:role: osd.5 2020-11-20T11:47:26.670 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi087.front.sepia.ceph.com 2020-11-20T11:47:26.671 INFO:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-11-20T11:47:26.756 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:47:26.756 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:47:26.757 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:47:26.758 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 2020-11-20T11:47:26.758 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:47:26.759 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:47:26.759 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:47:26.760 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:47:26.760 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:47:26.761 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:47:27.108 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2020-11-20T11:47:27.109 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2020-11-20T11:47:27.109 INFO:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2020-11-20T11:47:27.198 INFO:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2020-11-20T11:47:27.228 INFO:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-8 2020-11-20T11:47:27.294 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2020-11-20T11:47:27.295 INFO:tasks.ceph:role: osd.8 2020-11-20T11:47:27.295 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi087.front.sepia.ceph.com 2020-11-20T11:47:27.295 INFO:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-11-20T11:47:27.368 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:47:27.368 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:47:27.368 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:47:27.369 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 2020-11-20T11:47:27.369 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:47:27.369 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:47:27.369 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:47:27.369 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:47:27.370 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:47:27.370 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:47:27.740 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2020-11-20T11:47:27.742 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2020-11-20T11:47:27.742 INFO:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-8 2020-11-20T11:47:27.871 INFO:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-8 2020-11-20T11:47:27.967 INFO:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/ceph-11 2020-11-20T11:47:28.072 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2020-11-20T11:47:28.072 INFO:tasks.ceph:role: osd.11 2020-11-20T11:47:28.073 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi087.front.sepia.ceph.com 2020-11-20T11:47:28.073 INFO:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-11-20T11:47:28.192 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:47:28.193 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:47:28.195 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T11:47:28.195 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 2020-11-20T11:47:28.196 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:47:28.196 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:47:28.196 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T11:47:28.196 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:47:28.196 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:47:28.197 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:47:28.559 INFO:teuthology.orchestra.run.smithi087.stdout:Discarding blocks...Done. 2020-11-20T11:47:28.561 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2020-11-20T11:47:28.561 INFO:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-11 2020-11-20T11:47:28.704 INFO:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-11 2020-11-20T11:47:28.740 INFO:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:47:28.825 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:28.822+0000 7f05b1d77f40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2020-11-20T11:47:28.826 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:28.823+0000 7f05b1d77f40 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2020-11-20T11:47:28.827 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:28.823+0000 7f05b1d77f40 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-11-20T11:47:28.827 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:28.823+0000 7f05b1d77f40 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-11-20T11:47:28.827 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:28.823+0000 7f05b1d77f40 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-11-20T11:47:28.834 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:28.831+0000 7f05b1d77f40 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2020-11-20T11:47:31.681 INFO:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-11-20T11:47:31.750 INFO:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:47:31.837 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:31.833+0000 7f9a1286cf40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2020-11-20T11:47:31.837 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:31.833+0000 7f9a1286cf40 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2020-11-20T11:47:31.837 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:31.833+0000 7f9a1286cf40 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-11-20T11:47:31.837 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:31.833+0000 7f9a1286cf40 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-11-20T11:47:31.838 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:31.833+0000 7f9a1286cf40 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-11-20T11:47:31.838 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:31.834+0000 7f9a1286cf40 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2020-11-20T11:47:34.687 INFO:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-11-20T11:47:34.717 INFO:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 8 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:47:34.807 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:34.803+0000 7f5e79fcff40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-8/keyring: can't open /var/lib/ceph/osd/ceph-8/keyring: (2) No such file or directory 2020-11-20T11:47:34.808 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:34.804+0000 7f5e79fcff40 -1 created new key in keyring /var/lib/ceph/osd/ceph-8/keyring 2020-11-20T11:47:34.808 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:34.804+0000 7f5e79fcff40 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2020-11-20T11:47:34.808 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:34.804+0000 7f5e79fcff40 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2020-11-20T11:47:34.808 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:34.804+0000 7f5e79fcff40 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2020-11-20T11:47:34.808 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:34.804+0000 7f5e79fcff40 -1 bluestore(/var/lib/ceph/osd/ceph-8) _read_fsid unparsable uuid 2020-11-20T11:47:37.648 INFO:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2020-11-20T11:47:37.717 INFO:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 11 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:47:37.804 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:37.800+0000 7f8720311f40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-11/keyring: can't open /var/lib/ceph/osd/ceph-11/keyring: (2) No such file or directory 2020-11-20T11:47:37.804 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:37.801+0000 7f8720311f40 -1 created new key in keyring /var/lib/ceph/osd/ceph-11/keyring 2020-11-20T11:47:37.804 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:37.801+0000 7f8720311f40 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2020-11-20T11:47:37.804 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:37.801+0000 7f8720311f40 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2020-11-20T11:47:37.805 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:37.801+0000 7f8720311f40 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2020-11-20T11:47:37.805 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:37.801+0000 7f8720311f40 -1 bluestore(/var/lib/ceph/osd/ceph-11) _read_fsid unparsable uuid 2020-11-20T11:47:40.651 INFO:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-11 2020-11-20T11:47:40.683 INFO:tasks.ceph:Reading keys from all nodes... 2020-11-20T11:47:40.683 INFO:teuthology.orchestra.run.smithi192:> set -ex 2020-11-20T11:47:40.684 INFO:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2020-11-20T11:47:40.701 INFO:teuthology.orchestra.run.smithi192.stderr:+ sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2020-11-20T11:47:40.713 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr.x] 2020-11-20T11:47:40.713 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCwrLdfH5mMEhAAvAz0kOUIz8olFy6rKT7b0g== 2020-11-20T11:47:40.713 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records in 2020-11-20T11:47:40.714 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records out 2020-11-20T11:47:40.714 INFO:teuthology.orchestra.run.smithi192.stderr:56 bytes copied, 4.1327e-05 s, 1.4 MB/s 2020-11-20T11:47:40.715 INFO:teuthology.orchestra.run.smithi192:> set -ex 2020-11-20T11:47:40.716 INFO:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2020-11-20T11:47:40.775 INFO:teuthology.orchestra.run.smithi192.stderr:+ sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2020-11-20T11:47:40.787 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.a] 2020-11-20T11:47:40.787 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCwrLdfzmrXHRAANiJQ8KVBZ84dHJH83PxNqg== 2020-11-20T11:47:40.787 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records in 2020-11-20T11:47:40.788 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records out 2020-11-20T11:47:40.788 INFO:teuthology.orchestra.run.smithi192.stderr:56 bytes copied, 4.3141e-05 s, 1.3 MB/s 2020-11-20T11:47:40.788 INFO:teuthology.orchestra.run.smithi192:> set -ex 2020-11-20T11:47:40.789 INFO:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2020-11-20T11:47:40.845 INFO:teuthology.orchestra.run.smithi192.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2020-11-20T11:47:40.855 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.0] 2020-11-20T11:47:40.856 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCzrLdfUw8DGRAAbImMHboukTGKZ3ebowgsxw== 2020-11-20T11:47:40.856 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records in 2020-11-20T11:47:40.856 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records out 2020-11-20T11:47:40.856 INFO:teuthology.orchestra.run.smithi192.stderr:56 bytes copied, 3.0809e-05 s, 1.8 MB/s 2020-11-20T11:47:40.857 INFO:teuthology.orchestra.run.smithi192:> set -ex 2020-11-20T11:47:40.858 INFO:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2020-11-20T11:47:40.916 INFO:teuthology.orchestra.run.smithi192.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2020-11-20T11:47:40.926 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.3] 2020-11-20T11:47:40.927 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQC2rLdfPFVmGRAAKFqHlJAb+UYyMff8Awi1vw== 2020-11-20T11:47:40.927 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records in 2020-11-20T11:47:40.927 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records out 2020-11-20T11:47:40.927 INFO:teuthology.orchestra.run.smithi192.stderr:56 bytes copied, 3.0182e-05 s, 1.9 MB/s 2020-11-20T11:47:40.928 INFO:teuthology.orchestra.run.smithi192:> set -ex 2020-11-20T11:47:40.929 INFO:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2020-11-20T11:47:40.988 INFO:teuthology.orchestra.run.smithi192.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2020-11-20T11:47:40.998 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.6] 2020-11-20T11:47:40.998 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQC5rLdfGcMAGRAAdBn4IIcJSr9uqDFO/oASWQ== 2020-11-20T11:47:40.999 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records in 2020-11-20T11:47:40.999 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records out 2020-11-20T11:47:40.999 INFO:teuthology.orchestra.run.smithi192.stderr:56 bytes copied, 4.8797e-05 s, 1.1 MB/s 2020-11-20T11:47:41.000 INFO:teuthology.orchestra.run.smithi192:> set -ex 2020-11-20T11:47:41.000 INFO:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2020-11-20T11:47:41.063 INFO:teuthology.orchestra.run.smithi192.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2020-11-20T11:47:41.073 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.9] 2020-11-20T11:47:41.073 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQC8rLdf/6VWGRAAl0EGN9iEVg+uHl+5zvrXDQ== 2020-11-20T11:47:41.073 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records in 2020-11-20T11:47:41.074 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records out 2020-11-20T11:47:41.074 INFO:teuthology.orchestra.run.smithi192.stderr:56 bytes copied, 3.352e-05 s, 1.7 MB/s 2020-11-20T11:47:41.075 INFO:teuthology.orchestra.run.smithi146:> set -ex 2020-11-20T11:47:41.075 INFO:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2020-11-20T11:47:41.094 INFO:teuthology.orchestra.run.smithi146.stderr:+ sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2020-11-20T11:47:41.105 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr.y] 2020-11-20T11:47:41.106 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCwrLdf41yfFhAAqmZJtzXwDbO+QFhQ9AmbAw== 2020-11-20T11:47:41.107 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records in 2020-11-20T11:47:41.107 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records out 2020-11-20T11:47:41.108 INFO:teuthology.orchestra.run.smithi146.stderr:56 bytes copied, 4.3393e-05 s, 1.3 MB/s 2020-11-20T11:47:41.108 INFO:teuthology.orchestra.run.smithi146:> set -ex 2020-11-20T11:47:41.109 INFO:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2020-11-20T11:47:41.165 INFO:teuthology.orchestra.run.smithi146.stderr:+ sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2020-11-20T11:47:41.178 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.b] 2020-11-20T11:47:41.178 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCwrLdf3lByIhAAIXaA+y3TwX2GHZMYV+64+w== 2020-11-20T11:47:41.179 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records in 2020-11-20T11:47:41.179 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records out 2020-11-20T11:47:41.179 INFO:teuthology.orchestra.run.smithi146.stderr:56 bytes copied, 4.3749e-05 s, 1.3 MB/s 2020-11-20T11:47:41.180 INFO:teuthology.orchestra.run.smithi146:> set -ex 2020-11-20T11:47:41.180 INFO:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2020-11-20T11:47:41.238 INFO:teuthology.orchestra.run.smithi146.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2020-11-20T11:47:41.249 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.1] 2020-11-20T11:47:41.249 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDCrLdfJiYkABAAktd0Z9/AUGAFi4sbpqJ3sQ== 2020-11-20T11:47:41.250 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records in 2020-11-20T11:47:41.250 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records out 2020-11-20T11:47:41.250 INFO:teuthology.orchestra.run.smithi146.stderr:56 bytes copied, 3.2912e-05 s, 1.7 MB/s 2020-11-20T11:47:41.251 INFO:teuthology.orchestra.run.smithi146:> set -ex 2020-11-20T11:47:41.252 INFO:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2020-11-20T11:47:41.310 INFO:teuthology.orchestra.run.smithi146.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2020-11-20T11:47:41.321 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.4] 2020-11-20T11:47:41.321 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDErLdfgrtGOhAA7KgMz5hG8gis8iknxdk5vA== 2020-11-20T11:47:41.321 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records in 2020-11-20T11:47:41.321 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records out 2020-11-20T11:47:41.322 INFO:teuthology.orchestra.run.smithi146.stderr:56 bytes copied, 3.6217e-05 s, 1.5 MB/s 2020-11-20T11:47:41.323 INFO:teuthology.orchestra.run.smithi146:> set -ex 2020-11-20T11:47:41.323 INFO:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2020-11-20T11:47:41.382 INFO:teuthology.orchestra.run.smithi146.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2020-11-20T11:47:41.393 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.7] 2020-11-20T11:47:41.394 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDHrLdfo+BJOhAAUVfFy/nuMGgje/hinINPWQ== 2020-11-20T11:47:41.394 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records in 2020-11-20T11:47:41.394 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records out 2020-11-20T11:47:41.394 INFO:teuthology.orchestra.run.smithi146.stderr:56 bytes copied, 3.1045e-05 s, 1.8 MB/s 2020-11-20T11:47:41.395 INFO:teuthology.orchestra.run.smithi146:> set -ex 2020-11-20T11:47:41.396 INFO:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-10/keyring of=/dev/stdout 2020-11-20T11:47:41.452 INFO:teuthology.orchestra.run.smithi146.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-10/keyring of=/dev/stdout 2020-11-20T11:47:41.462 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.10] 2020-11-20T11:47:41.462 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDLrLdf//bjAxAAdDW+lFfszz2zucNaveFSzw== 2020-11-20T11:47:41.463 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records in 2020-11-20T11:47:41.463 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records out 2020-11-20T11:47:41.463 INFO:teuthology.orchestra.run.smithi146.stderr:57 bytes copied, 3.1136e-05 s, 1.8 MB/s 2020-11-20T11:47:41.464 INFO:teuthology.orchestra.run.smithi087:> set -ex 2020-11-20T11:47:41.465 INFO:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/mgr/ceph-z/keyring of=/dev/stdout 2020-11-20T11:47:41.481 INFO:teuthology.orchestra.run.smithi087.stderr:+ sudo dd if=/var/lib/ceph/mgr/ceph-z/keyring of=/dev/stdout 2020-11-20T11:47:41.492 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr.z] 2020-11-20T11:47:41.493 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCwrLdf56bLGhAAFItDmW+h3BBuOi5e0nnEdg== 2020-11-20T11:47:41.493 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records in 2020-11-20T11:47:41.493 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records out 2020-11-20T11:47:41.493 INFO:teuthology.orchestra.run.smithi087.stderr:56 bytes copied, 4.1351e-05 s, 1.4 MB/s 2020-11-20T11:47:41.494 INFO:teuthology.orchestra.run.smithi087:> set -ex 2020-11-20T11:47:41.495 INFO:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2020-11-20T11:47:41.550 INFO:teuthology.orchestra.run.smithi087.stderr:+ sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2020-11-20T11:47:41.561 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.c] 2020-11-20T11:47:41.561 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCwrLdf/GJBJxAAKDqAYXeyAKYArU0bgZHFAg== 2020-11-20T11:47:41.561 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records in 2020-11-20T11:47:41.562 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records out 2020-11-20T11:47:41.562 INFO:teuthology.orchestra.run.smithi087.stderr:56 bytes copied, 6.4766e-05 s, 865 kB/s 2020-11-20T11:47:41.563 INFO:teuthology.orchestra.run.smithi087:> set -ex 2020-11-20T11:47:41.563 INFO:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2020-11-20T11:47:41.618 INFO:teuthology.orchestra.run.smithi087.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2020-11-20T11:47:41.628 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.2] 2020-11-20T11:47:41.628 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDQrLdfpZ0YMRAA1QWSN2+i2XCAfOCDeYSmXw== 2020-11-20T11:47:41.628 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records in 2020-11-20T11:47:41.629 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records out 2020-11-20T11:47:41.629 INFO:teuthology.orchestra.run.smithi087.stderr:56 bytes copied, 3.2906e-05 s, 1.7 MB/s 2020-11-20T11:47:41.630 INFO:teuthology.orchestra.run.smithi087:> set -ex 2020-11-20T11:47:41.630 INFO:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2020-11-20T11:47:41.684 INFO:teuthology.orchestra.run.smithi087.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2020-11-20T11:47:41.694 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.5] 2020-11-20T11:47:41.694 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDTrLdf2pTAMRAAK9Qj2rWtHIjFr0G1EHBUiw== 2020-11-20T11:47:41.695 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records in 2020-11-20T11:47:41.695 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records out 2020-11-20T11:47:41.695 INFO:teuthology.orchestra.run.smithi087.stderr:56 bytes copied, 2.9328e-05 s, 1.9 MB/s 2020-11-20T11:47:41.696 INFO:teuthology.orchestra.run.smithi087:> set -ex 2020-11-20T11:47:41.696 INFO:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2020-11-20T11:47:41.750 INFO:teuthology.orchestra.run.smithi087.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2020-11-20T11:47:41.760 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.8] 2020-11-20T11:47:41.760 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDWrLdfnfP5LxAAIPk1R5EFR9xJqWmXqDgFeA== 2020-11-20T11:47:41.761 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records in 2020-11-20T11:47:41.761 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records out 2020-11-20T11:47:41.761 INFO:teuthology.orchestra.run.smithi087.stderr:56 bytes copied, 4.8065e-05 s, 1.2 MB/s 2020-11-20T11:47:41.762 INFO:teuthology.orchestra.run.smithi087:> set -ex 2020-11-20T11:47:41.763 INFO:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-11/keyring of=/dev/stdout 2020-11-20T11:47:41.816 INFO:teuthology.orchestra.run.smithi087.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-11/keyring of=/dev/stdout 2020-11-20T11:47:41.826 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.11] 2020-11-20T11:47:41.826 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDZrLdf6bbKLxAAh7PbZU5auscnRcPCrn5FFQ== 2020-11-20T11:47:41.826 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records in 2020-11-20T11:47:41.827 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records out 2020-11-20T11:47:41.827 INFO:teuthology.orchestra.run.smithi087.stderr:57 bytes copied, 3.1553e-05 s, 1.8 MB/s 2020-11-20T11:47:41.828 INFO:teuthology.orchestra.run.smithi192:> set -ex 2020-11-20T11:47:41.828 INFO:teuthology.orchestra.run.smithi192:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2020-11-20T11:47:41.844 INFO:teuthology.orchestra.run.smithi192.stderr:+ dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2020-11-20T11:47:41.845 INFO:teuthology.orchestra.run.smithi192.stdout:[client.0] 2020-11-20T11:47:41.845 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCwrLdfo8ssKxAAtKzBwoMyVonpVQKddgBWEg== 2020-11-20T11:47:41.846 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records in 2020-11-20T11:47:41.846 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records out 2020-11-20T11:47:41.846 INFO:teuthology.orchestra.run.smithi192.stderr:59 bytes copied, 3.8215e-05 s, 1.5 MB/s 2020-11-20T11:47:41.846 INFO:tasks.ceph:Adding keys to all mons... 2020-11-20T11:47:41.847 INFO:teuthology.orchestra.run.smithi087:> sudo tee -a /etc/ceph/ceph.keyring 2020-11-20T11:47:41.870 INFO:teuthology.orchestra.run.smithi146:> sudo tee -a /etc/ceph/ceph.keyring 2020-11-20T11:47:41.873 INFO:teuthology.orchestra.run.smithi192:> sudo tee -a /etc/ceph/ceph.keyring 2020-11-20T11:47:41.890 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr.x] 2020-11-20T11:47:41.890 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCwrLdfH5mMEhAAvAz0kOUIz8olFy6rKT7b0g== 2020-11-20T11:47:41.890 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.a] 2020-11-20T11:47:41.891 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCwrLdfzmrXHRAANiJQ8KVBZ84dHJH83PxNqg== 2020-11-20T11:47:41.891 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.0] 2020-11-20T11:47:41.891 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCzrLdfUw8DGRAAbImMHboukTGKZ3ebowgsxw== 2020-11-20T11:47:41.891 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.3] 2020-11-20T11:47:41.891 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQC2rLdfPFVmGRAAKFqHlJAb+UYyMff8Awi1vw== 2020-11-20T11:47:41.892 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.6] 2020-11-20T11:47:41.892 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQC5rLdfGcMAGRAAdBn4IIcJSr9uqDFO/oASWQ== 2020-11-20T11:47:41.892 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.9] 2020-11-20T11:47:41.892 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQC8rLdf/6VWGRAAl0EGN9iEVg+uHl+5zvrXDQ== 2020-11-20T11:47:41.893 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr.y] 2020-11-20T11:47:41.893 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCwrLdf41yfFhAAqmZJtzXwDbO+QFhQ9AmbAw== 2020-11-20T11:47:41.893 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.b] 2020-11-20T11:47:41.893 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCwrLdf3lByIhAAIXaA+y3TwX2GHZMYV+64+w== 2020-11-20T11:47:41.893 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.1] 2020-11-20T11:47:41.894 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDCrLdfJiYkABAAktd0Z9/AUGAFi4sbpqJ3sQ== 2020-11-20T11:47:41.894 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.4] 2020-11-20T11:47:41.894 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDErLdfgrtGOhAA7KgMz5hG8gis8iknxdk5vA== 2020-11-20T11:47:41.894 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.7] 2020-11-20T11:47:41.894 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDHrLdfo+BJOhAAUVfFy/nuMGgje/hinINPWQ== 2020-11-20T11:47:41.895 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.10] 2020-11-20T11:47:41.895 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDLrLdf//bjAxAAdDW+lFfszz2zucNaveFSzw== 2020-11-20T11:47:41.895 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr.z] 2020-11-20T11:47:41.895 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCwrLdf56bLGhAAFItDmW+h3BBuOi5e0nnEdg== 2020-11-20T11:47:41.895 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.c] 2020-11-20T11:47:41.896 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCwrLdf/GJBJxAAKDqAYXeyAKYArU0bgZHFAg== 2020-11-20T11:47:41.896 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.2] 2020-11-20T11:47:41.896 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDQrLdfpZ0YMRAA1QWSN2+i2XCAfOCDeYSmXw== 2020-11-20T11:47:41.896 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.5] 2020-11-20T11:47:41.896 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDTrLdf2pTAMRAAK9Qj2rWtHIjFr0G1EHBUiw== 2020-11-20T11:47:41.897 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.8] 2020-11-20T11:47:41.897 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDWrLdfnfP5LxAAIPk1R5EFR9xJqWmXqDgFeA== 2020-11-20T11:47:41.897 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.11] 2020-11-20T11:47:41.897 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDZrLdf6bbKLxAAh7PbZU5auscnRcPCrn5FFQ== 2020-11-20T11:47:41.898 INFO:teuthology.orchestra.run.smithi087.stdout:[client.0] 2020-11-20T11:47:41.898 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQCwrLdfo8ssKxAAtKzBwoMyVonpVQKddgBWEg== 2020-11-20T11:47:41.899 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr.x] 2020-11-20T11:47:41.899 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCwrLdfH5mMEhAAvAz0kOUIz8olFy6rKT7b0g== 2020-11-20T11:47:41.899 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.a] 2020-11-20T11:47:41.900 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCwrLdfzmrXHRAANiJQ8KVBZ84dHJH83PxNqg== 2020-11-20T11:47:41.900 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.0] 2020-11-20T11:47:41.900 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCzrLdfUw8DGRAAbImMHboukTGKZ3ebowgsxw== 2020-11-20T11:47:41.900 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.3] 2020-11-20T11:47:41.900 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQC2rLdfPFVmGRAAKFqHlJAb+UYyMff8Awi1vw== 2020-11-20T11:47:41.901 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.6] 2020-11-20T11:47:41.901 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQC5rLdfGcMAGRAAdBn4IIcJSr9uqDFO/oASWQ== 2020-11-20T11:47:41.901 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.9] 2020-11-20T11:47:41.901 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQC8rLdf/6VWGRAAl0EGN9iEVg+uHl+5zvrXDQ== 2020-11-20T11:47:41.901 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr.y] 2020-11-20T11:47:41.902 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCwrLdf41yfFhAAqmZJtzXwDbO+QFhQ9AmbAw== 2020-11-20T11:47:41.902 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.b] 2020-11-20T11:47:41.902 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCwrLdf3lByIhAAIXaA+y3TwX2GHZMYV+64+w== 2020-11-20T11:47:41.902 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.1] 2020-11-20T11:47:41.902 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDCrLdfJiYkABAAktd0Z9/AUGAFi4sbpqJ3sQ== 2020-11-20T11:47:41.903 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.4] 2020-11-20T11:47:41.903 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDErLdfgrtGOhAA7KgMz5hG8gis8iknxdk5vA== 2020-11-20T11:47:41.903 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.7] 2020-11-20T11:47:41.903 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDHrLdfo+BJOhAAUVfFy/nuMGgje/hinINPWQ== 2020-11-20T11:47:41.903 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.10] 2020-11-20T11:47:41.904 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDLrLdf//bjAxAAdDW+lFfszz2zucNaveFSzw== 2020-11-20T11:47:41.904 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr.z] 2020-11-20T11:47:41.904 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCwrLdf56bLGhAAFItDmW+h3BBuOi5e0nnEdg== 2020-11-20T11:47:41.904 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.c] 2020-11-20T11:47:41.904 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCwrLdf/GJBJxAAKDqAYXeyAKYArU0bgZHFAg== 2020-11-20T11:47:41.905 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.2] 2020-11-20T11:47:41.905 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDQrLdfpZ0YMRAA1QWSN2+i2XCAfOCDeYSmXw== 2020-11-20T11:47:41.905 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.5] 2020-11-20T11:47:41.905 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDTrLdf2pTAMRAAK9Qj2rWtHIjFr0G1EHBUiw== 2020-11-20T11:47:41.905 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.8] 2020-11-20T11:47:41.906 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDWrLdfnfP5LxAAIPk1R5EFR9xJqWmXqDgFeA== 2020-11-20T11:47:41.906 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.11] 2020-11-20T11:47:41.906 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDZrLdf6bbKLxAAh7PbZU5auscnRcPCrn5FFQ== 2020-11-20T11:47:41.906 INFO:teuthology.orchestra.run.smithi146.stdout:[client.0] 2020-11-20T11:47:41.906 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQCwrLdfo8ssKxAAtKzBwoMyVonpVQKddgBWEg== 2020-11-20T11:47:41.912 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr.x] 2020-11-20T11:47:41.912 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCwrLdfH5mMEhAAvAz0kOUIz8olFy6rKT7b0g== 2020-11-20T11:47:41.912 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.a] 2020-11-20T11:47:41.912 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCwrLdfzmrXHRAANiJQ8KVBZ84dHJH83PxNqg== 2020-11-20T11:47:41.913 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.0] 2020-11-20T11:47:41.913 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCzrLdfUw8DGRAAbImMHboukTGKZ3ebowgsxw== 2020-11-20T11:47:41.913 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.3] 2020-11-20T11:47:41.913 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQC2rLdfPFVmGRAAKFqHlJAb+UYyMff8Awi1vw== 2020-11-20T11:47:41.913 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.6] 2020-11-20T11:47:41.914 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQC5rLdfGcMAGRAAdBn4IIcJSr9uqDFO/oASWQ== 2020-11-20T11:47:41.914 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.9] 2020-11-20T11:47:41.914 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQC8rLdf/6VWGRAAl0EGN9iEVg+uHl+5zvrXDQ== 2020-11-20T11:47:41.914 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr.y] 2020-11-20T11:47:41.914 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCwrLdf41yfFhAAqmZJtzXwDbO+QFhQ9AmbAw== 2020-11-20T11:47:41.915 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.b] 2020-11-20T11:47:41.915 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCwrLdf3lByIhAAIXaA+y3TwX2GHZMYV+64+w== 2020-11-20T11:47:41.915 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.1] 2020-11-20T11:47:41.915 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDCrLdfJiYkABAAktd0Z9/AUGAFi4sbpqJ3sQ== 2020-11-20T11:47:41.915 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.4] 2020-11-20T11:47:41.916 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDErLdfgrtGOhAA7KgMz5hG8gis8iknxdk5vA== 2020-11-20T11:47:41.916 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.7] 2020-11-20T11:47:41.916 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDHrLdfo+BJOhAAUVfFy/nuMGgje/hinINPWQ== 2020-11-20T11:47:41.916 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.10] 2020-11-20T11:47:41.917 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDLrLdf//bjAxAAdDW+lFfszz2zucNaveFSzw== 2020-11-20T11:47:41.917 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr.z] 2020-11-20T11:47:41.917 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCwrLdf56bLGhAAFItDmW+h3BBuOi5e0nnEdg== 2020-11-20T11:47:41.917 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.c] 2020-11-20T11:47:41.917 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCwrLdf/GJBJxAAKDqAYXeyAKYArU0bgZHFAg== 2020-11-20T11:47:41.918 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.2] 2020-11-20T11:47:41.918 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDQrLdfpZ0YMRAA1QWSN2+i2XCAfOCDeYSmXw== 2020-11-20T11:47:41.918 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.5] 2020-11-20T11:47:41.918 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDTrLdf2pTAMRAAK9Qj2rWtHIjFr0G1EHBUiw== 2020-11-20T11:47:41.918 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.8] 2020-11-20T11:47:41.919 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDWrLdfnfP5LxAAIPk1R5EFR9xJqWmXqDgFeA== 2020-11-20T11:47:41.919 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.11] 2020-11-20T11:47:41.919 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDZrLdf6bbKLxAAh7PbZU5auscnRcPCrn5FFQ== 2020-11-20T11:47:41.919 INFO:teuthology.orchestra.run.smithi192.stdout:[client.0] 2020-11-20T11:47:41.919 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCwrLdfo8ssKxAAtKzBwoMyVonpVQKddgBWEg== 2020-11-20T11:47:41.920 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:47:41.942 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:47:41.945 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:47:42.010 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:47:42.027 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:47:42.030 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:47:42.081 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:47:42.085 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:47:42.088 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:47:42.134 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:47:42.169 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:47:42.173 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:47:42.219 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:47:42.253 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:47:42.259 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:47:42.304 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:47:42.338 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:47:42.343 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:47:42.388 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:47:42.424 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:47:42.427 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:47:42.472 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:47:42.508 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:47:42.511 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:47:42.559 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:47:42.561 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:47:42.563 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:47:42.609 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:47:42.612 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:47:42.648 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:47:42.693 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:47:42.697 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:47:42.733 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:47:42.778 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:47:42.782 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:47:42.818 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:47:42.863 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:47:42.867 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:47:42.903 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:47:42.948 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:47:42.951 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:47:42.988 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:47:43.036 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:47:43.039 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:47:43.042 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:47:43.086 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:47:43.124 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:47:43.128 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:47:43.174 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:47:43.209 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:47:43.212 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:47:43.257 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:47:43.260 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:47:43.263 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:47:43.308 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-11-20T11:47:43.345 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-11-20T11:47:43.348 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-11-20T11:47:43.396 INFO:tasks.ceph:Running mkfs on mon nodes... 2020-11-20T11:47:43.396 INFO:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2020-11-20T11:47:43.420 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-11-20T11:47:43.510 INFO:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2020-11-20T11:47:43.535 INFO:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2020-11-20T11:47:43.559 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-11-20T11:47:43.650 INFO:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2020-11-20T11:47:43.674 INFO:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2020-11-20T11:47:43.699 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-11-20T11:47:43.789 INFO:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2020-11-20T11:47:43.815 INFO:teuthology.orchestra.run.smithi087:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:47:43.858 INFO:teuthology.orchestra.run.smithi146:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:47:43.861 INFO:teuthology.orchestra.run.smithi192:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:47:43.876 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2020-11-20T11:47:43.877 INFO:tasks.ceph.mon.a:Restarting daemon 2020-11-20T11:47:43.878 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-11-20T11:47:43.922 INFO:tasks.ceph.mon.a:Started 2020-11-20T11:47:43.922 INFO:tasks.ceph.mon.b:Restarting daemon 2020-11-20T11:47:43.923 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-11-20T11:47:43.925 INFO:tasks.ceph.mon.b:Started 2020-11-20T11:47:43.926 INFO:tasks.ceph.mon.c:Restarting daemon 2020-11-20T11:47:43.926 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-11-20T11:47:43.928 INFO:tasks.ceph.mon.c:Started 2020-11-20T11:47:43.929 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2020-11-20T11:47:43.929 INFO:tasks.ceph.mgr.x:Restarting daemon 2020-11-20T11:47:43.930 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2020-11-20T11:47:43.931 INFO:tasks.ceph.mgr.x:Started 2020-11-20T11:47:43.932 INFO:tasks.ceph.mgr.y:Restarting daemon 2020-11-20T11:47:43.932 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2020-11-20T11:47:43.935 INFO:tasks.ceph.mgr.y:Started 2020-11-20T11:47:43.935 INFO:tasks.ceph.mgr.z:Restarting daemon 2020-11-20T11:47:43.935 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i z 2020-11-20T11:47:43.938 INFO:tasks.ceph.mgr.z:Started 2020-11-20T11:47:43.938 INFO:tasks.ceph:Setting crush tunables to default 2020-11-20T11:47:43.938 INFO:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd crush tunables default 2020-11-20T11:47:44.064 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.058+0000 7f78af03a700 1 Processor -- start 2020-11-20T11:47:44.064 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.058+0000 7f78af03a700 1 -- start start 2020-11-20T11:47:44.064 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.059+0000 7f78af03a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f78a8060370 0x7f78a8060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:44.065 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.059+0000 7f78af03a700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f78a8064c40 0x7f78a8151340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:44.065 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.059+0000 7f78af03a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a8151e80 con 0x7f78a8154920 2020-11-20T11:47:44.065 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.059+0000 7f78af03a700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a8152120 con 0x7f78a8064c40 2020-11-20T11:47:44.065 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.059+0000 7f78af03a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a8064260 con 0x7f78a8060370 2020-11-20T11:47:44.066 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.059+0000 7f78ad5d7700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f78a8064c40 0x7f78a8151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:44.066 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.059+0000 7f78ad5d7700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f78a8064c40 0x7f78a8151340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.192:57570/0 (socket says 172.21.15.192:57570) 2020-11-20T11:47:44.066 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.059+0000 7f78ad5d7700 1 -- 172.21.15.192:0/3661146551 learned_addr learned my addr 172.21.15.192:0/3661146551 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:47:44.066 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.059+0000 7f78acdd6700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.146:3300/0 conn(0x7f78a8060370 0x7f78a8060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:44.066 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.059+0000 7f78ad5d7700 1 -- 172.21.15.192:0/3661146551 >> v2:172.21.15.87:3300/0 conn(0x7f78a8064c40 msgr2=0x7f78a8151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-11-20T11:47:44.067 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.059+0000 7f78ad5d7700 1 -- 172.21.15.192:0/3661146551 >> v2:172.21.15.87:3300/0 conn(0x7f78a8064c40 msgr2=0x7f78a8151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:47:44.067 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.059+0000 7f78ad5d7700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.87:3300/0 conn(0x7f78a8064c40 0x7f78a8151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:47:44.067 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.059+0000 7f78ad5d7700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.87:3300/0 conn(0x7f78a8064c40 0x7f78a8151340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2020-11-20T11:47:44.067 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.059+0000 7f78acdd6700 1 -- 172.21.15.192:0/3661146551 >> v2:172.21.15.146:3300/0 conn(0x7f78a8060370 msgr2=0x7f78a8060750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-11-20T11:47:44.067 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.059+0000 7f78acdd6700 1 -- 172.21.15.192:0/3661146551 >> v2:172.21.15.146:3300/0 conn(0x7f78a8060370 msgr2=0x7f78a8060750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:47:44.068 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.059+0000 7f78acdd6700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.146:3300/0 conn(0x7f78a8060370 0x7f78a8060750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:47:44.068 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.059+0000 7f78acdd6700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.146:3300/0 conn(0x7f78a8060370 0x7f78a8060750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2020-11-20T11:47:44.264 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.260+0000 7f78ad5d7700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.87:3300/0 conn(0x7f78a8064c40 0x7f78a8151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:44.264 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.260+0000 7f78ad5d7700 1 -- 172.21.15.192:0/3661146551 >> v2:172.21.15.87:3300/0 conn(0x7f78a8064c40 msgr2=0x7f78a8151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-11-20T11:47:44.264 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.260+0000 7f78ad5d7700 1 -- 172.21.15.192:0/3661146551 >> v2:172.21.15.87:3300/0 conn(0x7f78a8064c40 msgr2=0x7f78a8151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:47:44.264 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.260+0000 7f78ad5d7700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.87:3300/0 conn(0x7f78a8064c40 0x7f78a8151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:47:44.265 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.260+0000 7f78ad5d7700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.87:3300/0 conn(0x7f78a8064c40 0x7f78a8151340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2020-11-20T11:47:44.265 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.260+0000 7f78acdd6700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.146:3300/0 conn(0x7f78a8060370 0x7f78a8060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:44.265 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.260+0000 7f78acdd6700 1 -- 172.21.15.192:0/3661146551 >> v2:172.21.15.146:3300/0 conn(0x7f78a8060370 msgr2=0x7f78a8060750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-11-20T11:47:44.265 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.260+0000 7f78acdd6700 1 -- 172.21.15.192:0/3661146551 >> v2:172.21.15.146:3300/0 conn(0x7f78a8060370 msgr2=0x7f78a8060750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:47:44.265 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.260+0000 7f78acdd6700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.146:3300/0 conn(0x7f78a8060370 0x7f78a8060750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:47:44.266 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.260+0000 7f78acdd6700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.146:3300/0 conn(0x7f78a8060370 0x7f78a8060750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2020-11-20T11:47:44.665 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.661+0000 7f78ad5d7700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.87:3300/0 conn(0x7f78a8064c40 0x7f78a8151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:44.665 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.661+0000 7f78ad5d7700 1 -- 172.21.15.192:0/3661146551 >> v2:172.21.15.87:3300/0 conn(0x7f78a8064c40 msgr2=0x7f78a8151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-11-20T11:47:44.665 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.661+0000 7f78ad5d7700 1 -- 172.21.15.192:0/3661146551 >> v2:172.21.15.87:3300/0 conn(0x7f78a8064c40 msgr2=0x7f78a8151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:47:44.666 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.661+0000 7f78ad5d7700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.87:3300/0 conn(0x7f78a8064c40 0x7f78a8151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:47:44.666 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.661+0000 7f78ad5d7700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.87:3300/0 conn(0x7f78a8064c40 0x7f78a8151340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2020-11-20T11:47:44.666 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.661+0000 7f78acdd6700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.146:3300/0 conn(0x7f78a8060370 0x7f78a8060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:44.666 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.661+0000 7f78acdd6700 1 -- 172.21.15.192:0/3661146551 >> v2:172.21.15.146:3300/0 conn(0x7f78a8060370 msgr2=0x7f78a8060750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-11-20T11:47:44.666 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.661+0000 7f78acdd6700 1 -- 172.21.15.192:0/3661146551 >> v2:172.21.15.146:3300/0 conn(0x7f78a8060370 msgr2=0x7f78a8060750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:47:44.667 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.661+0000 7f78acdd6700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.146:3300/0 conn(0x7f78a8060370 0x7f78a8060750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:47:44.667 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:44.661+0000 7f78acdd6700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.146:3300/0 conn(0x7f78a8060370 0x7f78a8060750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2020-11-20T11:47:45.466 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:45.463+0000 7f78ad5d7700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.87:3300/0 conn(0x7f78a8064c40 0x7f78a8151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:45.466 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:45.463+0000 7f78ad5d7700 1 -- 172.21.15.192:0/3661146551 >> v2:172.21.15.87:3300/0 conn(0x7f78a8064c40 msgr2=0x7f78a8151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-11-20T11:47:45.466 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:45.463+0000 7f78ad5d7700 1 -- 172.21.15.192:0/3661146551 >> v2:172.21.15.87:3300/0 conn(0x7f78a8064c40 msgr2=0x7f78a8151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:47:45.467 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:45.463+0000 7f78ad5d7700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.87:3300/0 conn(0x7f78a8064c40 0x7f78a8151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:47:45.467 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:45.463+0000 7f78ad5d7700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.87:3300/0 conn(0x7f78a8064c40 0x7f78a8151340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2020-11-20T11:47:45.467 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:45.463+0000 7f78acdd6700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.146:3300/0 conn(0x7f78a8060370 0x7f78a8060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:45.467 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:45.463+0000 7f78acdd6700 1 -- 172.21.15.192:0/3661146551 >> v2:172.21.15.146:3300/0 conn(0x7f78a8060370 msgr2=0x7f78a8060750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-11-20T11:47:45.468 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:45.463+0000 7f78acdd6700 1 -- 172.21.15.192:0/3661146551 >> v2:172.21.15.146:3300/0 conn(0x7f78a8060370 msgr2=0x7f78a8060750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:47:45.468 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:45.463+0000 7f78acdd6700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.146:3300/0 conn(0x7f78a8060370 0x7f78a8060750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:47:45.468 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:45.463+0000 7f78acdd6700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.146:3300/0 conn(0x7f78a8060370 0x7f78a8060750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2020-11-20T11:47:47.063 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:47.059+0000 7f78a67fc700 1 -- 172.21.15.192:0/3661146551 >> v2:172.21.15.146:3300/0 conn(0x7f78a8060370 msgr2=0x7f78a8060750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-11-20T11:47:47.063 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:47.059+0000 7f78a67fc700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.146:3300/0 conn(0x7f78a8060370 0x7f78a8060750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:47.063 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:47.059+0000 7f78a67fc700 1 -- 172.21.15.192:0/3661146551 >> v2:172.21.15.87:3300/0 conn(0x7f78a8064c40 msgr2=0x7f78a8151340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-11-20T11:47:47.063 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:47.059+0000 7f78a67fc700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.87:3300/0 conn(0x7f78a8064c40 0x7f78a8151340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:47.064 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:47.059+0000 7f78a67fc700 1 -- 172.21.15.192:0/3661146551 >> v1:172.21.15.146:6789/0 conn(0x7f78a8154920 legacy=0x7f78a80c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:47.064 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:47.059+0000 7f78a67fc700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.192:3300/0 conn(0x7f78900070e0 0x7f78900095a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:47.064 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:47.059+0000 7f78a67fc700 1 -- 172.21.15.192:0/3661146551 --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a8064500 con 0x7f78900033f0 2020-11-20T11:47:47.065 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:47.059+0000 7f78a67fc700 1 -- 172.21.15.192:0/3661146551 --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f789000e9c0 con 0x7f7890009c30 2020-11-20T11:47:47.065 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:47.059+0000 7f78a67fc700 1 -- 172.21.15.192:0/3661146551 --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a8152120 con 0x7f78900070e0 2020-11-20T11:47:47.065 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:47.059+0000 7f78a7fff700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.192:3300/0 conn(0x7f78900070e0 0x7f78900095a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:47.065 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:47.059+0000 7f78a7fff700 1 -- 172.21.15.192:0/3661146551 >> v2:172.21.15.192:3300/0 conn(0x7f78900070e0 msgr2=0x7f78900095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-11-20T11:47:47.066 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:47.060+0000 7f78a7fff700 1 -- 172.21.15.192:0/3661146551 >> v2:172.21.15.192:3300/0 conn(0x7f78900070e0 msgr2=0x7f78900095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:47:47.066 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:47.060+0000 7f78a7fff700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.192:3300/0 conn(0x7f78900070e0 0x7f78900095a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:47:47.066 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:47.060+0000 7f78a7fff700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.192:3300/0 conn(0x7f78900070e0 0x7f78900095a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2020-11-20T11:47:47.264 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:47.261+0000 7f78a7fff700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.192:3300/0 conn(0x7f78900070e0 0x7f78900095a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:47.264 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:47.261+0000 7f78a7fff700 1 -- 172.21.15.192:0/3661146551 >> v2:172.21.15.192:3300/0 conn(0x7f78900070e0 msgr2=0x7f78900095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-11-20T11:47:47.265 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:47.261+0000 7f78a7fff700 1 -- 172.21.15.192:0/3661146551 >> v2:172.21.15.192:3300/0 conn(0x7f78900070e0 msgr2=0x7f78900095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:47:47.265 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:47.261+0000 7f78a7fff700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.192:3300/0 conn(0x7f78900070e0 0x7f78900095a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:47:47.265 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:47.261+0000 7f78a7fff700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.192:3300/0 conn(0x7f78900070e0 0x7f78900095a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2020-11-20T11:47:47.665 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:47.662+0000 7f78a7fff700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.192:3300/0 conn(0x7f78900070e0 0x7f78900095a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:47.665 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:47.662+0000 7f78a7fff700 1 -- 172.21.15.192:0/3661146551 >> v2:172.21.15.192:3300/0 conn(0x7f78900070e0 msgr2=0x7f78900095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-11-20T11:47:47.665 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:47.662+0000 7f78a7fff700 1 -- 172.21.15.192:0/3661146551 >> v2:172.21.15.192:3300/0 conn(0x7f78900070e0 msgr2=0x7f78900095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:47:47.666 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:47.662+0000 7f78a7fff700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.192:3300/0 conn(0x7f78900070e0 0x7f78900095a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:47:47.666 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:47.662+0000 7f78a7fff700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.192:3300/0 conn(0x7f78900070e0 0x7f78900095a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2020-11-20T11:47:48.466 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:48.463+0000 7f78a7fff700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.192:3300/0 conn(0x7f78900070e0 0x7f78900095a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:48.466 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:48.463+0000 7f78a7fff700 1 -- 172.21.15.192:0/3661146551 >> v2:172.21.15.192:3300/0 conn(0x7f78900070e0 msgr2=0x7f78900095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-11-20T11:47:48.467 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:48.463+0000 7f78a7fff700 1 -- 172.21.15.192:0/3661146551 >> v2:172.21.15.192:3300/0 conn(0x7f78900070e0 msgr2=0x7f78900095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:47:48.467 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:48.463+0000 7f78a7fff700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.192:3300/0 conn(0x7f78900070e0 0x7f78900095a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:47:48.467 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:48.463+0000 7f78a7fff700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.192:3300/0 conn(0x7f78900070e0 0x7f78900095a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2020-11-20T11:47:49.072 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.069+0000 7f78a77fe700 1 -- 172.21.15.192:0/3661146551 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2430311517 0 0) 0x7f78a8064500 con 0x7f78900033f0 2020-11-20T11:47:49.073 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.069+0000 7f78a77fe700 1 -- 172.21.15.192:0/3661146551 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f788c003280 con 0x7f78900033f0 2020-11-20T11:47:49.075 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.070+0000 7f78a77fe700 1 -- 172.21.15.192:0/3661146551 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1238562354 0 0) 0x7f788c003280 con 0x7f78900033f0 2020-11-20T11:47:49.075 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.070+0000 7f78a77fe700 1 -- 172.21.15.192:0/3661146551 >> v2:172.21.15.192:3300/0 conn(0x7f78900070e0 msgr2=0x7f78900095a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-11-20T11:47:49.075 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.070+0000 7f78a77fe700 1 --2- 172.21.15.192:0/3661146551 >> v2:172.21.15.192:3300/0 conn(0x7f78900070e0 0x7f78900095a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:49.076 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.070+0000 7f78a77fe700 1 -- 172.21.15.192:0/3661146551 >> v1:172.21.15.192:6789/0 conn(0x7f7890009c30 legacy=0x7f789000c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:49.076 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.070+0000 7f78a77fe700 1 -- 172.21.15.192:0/3661146551 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f789000fd00 con 0x7f78900033f0 2020-11-20T11:47:49.076 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.070+0000 7f78ad5d7700 1 -- 172.21.15.192:0/3661146551 reap_dead start 2020-11-20T11:47:49.076 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.070+0000 7f78a77fe700 1 -- 172.21.15.192:0/3661146551 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3985397220 0 0) 0x7f789c00d1c0 con 0x7f78900033f0 2020-11-20T11:47:49.076 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.070+0000 7f78a77fe700 1 -- 172.21.15.192:0/3661146551 >> v1:172.21.15.87:6789/0 conn(0x7f78900033f0 legacy=0x7f7890005840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:49.077 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.070+0000 7f78a77fe700 1 --2- 172.21.15.192:0/3661146551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f788c0037c0 0x7f788c003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:49.077 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.070+0000 7f78a77fe700 1 --2- 172.21.15.192:0/3661146551 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f788c004520 0x7f788c0049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:49.077 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.070+0000 7f78a77fe700 1 --2- 172.21.15.192:0/3661146551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f788c004e90 0x7f788c00b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:49.077 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.070+0000 7f78a77fe700 1 -- 172.21.15.192:0/3661146551 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a8152120 con 0x7f788c004e90 2020-11-20T11:47:49.077 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.070+0000 7f78a77fe700 1 -- 172.21.15.192:0/3661146551 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788c0053f0 con 0x7f788c0037c0 2020-11-20T11:47:49.078 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.070+0000 7f78a77fe700 1 -- 172.21.15.192:0/3661146551 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788c00bce0 con 0x7f788c004520 2020-11-20T11:47:49.078 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.070+0000 7f78a7fff700 1 --2- 172.21.15.192:0/3661146551 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f788c004520 0x7f788c0049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:49.078 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.070+0000 7f78ad5d7700 1 --2- 172.21.15.192:0/3661146551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f788c004e90 0x7f788c00b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:49.078 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.071+0000 7f78acdd6700 1 --2- 172.21.15.192:0/3661146551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f788c0037c0 0x7f788c003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:49.078 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.071+0000 7f78a7fff700 1 -- 172.21.15.192:0/3661146551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f788c0037c0 msgr2=0x7f788c003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:47:49.079 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.071+0000 7f78a7fff700 1 --2- 172.21.15.192:0/3661146551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f788c0037c0 0x7f788c003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:49.079 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.071+0000 7f78a7fff700 1 -- 172.21.15.192:0/3661146551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f788c004e90 msgr2=0x7f788c00b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:47:49.079 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.071+0000 7f78a7fff700 1 --2- 172.21.15.192:0/3661146551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f788c004e90 0x7f788c00b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:49.079 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.071+0000 7f78a7fff700 1 -- 172.21.15.192:0/3661146551 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f788c003280 con 0x7f788c004520 2020-11-20T11:47:49.079 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.071+0000 7f78a7fff700 1 --2- 172.21.15.192:0/3661146551 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f788c004520 0x7f788c0049a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f78a80c2a50 tx=0x7f7894009040).ready entity=mon.2 client_cookie=b411c554251fcc2d server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:47:49.082 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.073+0000 7f78a77fe700 1 -- 172.21.15.192:0/3661146551 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78940166a0 con 0x7f788c004520 2020-11-20T11:47:49.082 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.074+0000 7f78a77fe700 1 -- 172.21.15.192:0/3661146551 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7894016800 con 0x7f788c004520 2020-11-20T11:47:49.082 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.074+0000 7f78a77fe700 1 -- 172.21.15.192:0/3661146551 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7894016ba0 con 0x7f788c004520 2020-11-20T11:47:49.082 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.074+0000 7f78af03a700 1 -- 172.21.15.192:0/3661146551 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f788c004520 msgr2=0x7f788c0049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:49.083 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.074+0000 7f78af03a700 1 --2- 172.21.15.192:0/3661146551 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f788c004520 0x7f788c0049a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f78a80c2a50 tx=0x7f7894009040).stop 2020-11-20T11:47:49.083 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.074+0000 7f78af03a700 1 -- 172.21.15.192:0/3661146551 shutdown_connections 2020-11-20T11:47:49.083 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.074+0000 7f78af03a700 1 --2- 172.21.15.192:0/3661146551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f788c004e90 0x7f788c00b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:49.083 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.074+0000 7f78af03a700 1 --2- 172.21.15.192:0/3661146551 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f788c004520 0x7f788c0049a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:49.083 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.074+0000 7f78af03a700 1 --2- 172.21.15.192:0/3661146551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f788c0037c0 0x7f788c003be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:49.084 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.074+0000 7f78af03a700 1 -- 172.21.15.192:0/3661146551 >> 172.21.15.192:0/3661146551 conn(0x7f78a8062100 msgr2=0x7f78a80c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:47:49.084 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.074+0000 7f78af03a700 1 -- 172.21.15.192:0/3661146551 shutdown_connections 2020-11-20T11:47:49.084 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.074+0000 7f78af03a700 1 -- 172.21.15.192:0/3661146551 wait complete. 2020-11-20T11:47:49.084 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.076+0000 7f78af03a700 1 Processor -- start 2020-11-20T11:47:49.084 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.076+0000 7f78af03a700 1 -- start start 2020-11-20T11:47:49.085 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.077+0000 7f78af03a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f788c0037c0 0x7f78a80c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:49.085 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.078+0000 7f78acdd6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f788c0037c0 0x7f78a80c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:49.085 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.078+0000 7f78acdd6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f788c0037c0 0x7f78a80c7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.192:57640/0 (socket says 172.21.15.192:57640) 2020-11-20T11:47:49.085 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.078+0000 7f78af03a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f788c004520 0x7f78a80c0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:49.085 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.078+0000 7f78acdd6700 1 -- 172.21.15.192:0/1584752133 learned_addr learned my addr 172.21.15.192:0/1584752133 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:47:49.086 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.078+0000 7f78af03a700 1 --2- 172.21.15.192:0/1584752133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f788c004e90 0x7f78a8160120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:49.086 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.078+0000 7f78af03a700 1 -- 172.21.15.192:0/1584752133 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a8160d40 con 0x7f788c0037c0 2020-11-20T11:47:49.086 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.078+0000 7f78af03a700 1 -- 172.21.15.192:0/1584752133 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a8160fe0 con 0x7f788c004e90 2020-11-20T11:47:49.086 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.078+0000 7f78af03a700 1 -- 172.21.15.192:0/1584752133 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a80b0340 con 0x7f788c004520 2020-11-20T11:47:49.086 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.078+0000 7f78ad5d7700 1 --2- 172.21.15.192:0/1584752133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f788c004e90 0x7f78a8160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:49.087 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.078+0000 7f78a7fff700 1 --2- 172.21.15.192:0/1584752133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f788c004520 0x7f78a80c0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:49.087 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.078+0000 7f78acdd6700 1 -- 172.21.15.192:0/1584752133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f788c004520 msgr2=0x7f78a80c0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:49.087 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.078+0000 7f78acdd6700 1 --2- 172.21.15.192:0/1584752133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f788c004520 0x7f78a80c0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:49.087 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.078+0000 7f78acdd6700 1 -- 172.21.15.192:0/1584752133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f788c004e90 msgr2=0x7f78a8160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:49.087 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.078+0000 7f78acdd6700 1 --2- 172.21.15.192:0/1584752133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f788c004e90 0x7f78a8160120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:49.088 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.078+0000 7f78acdd6700 1 -- 172.21.15.192:0/1584752133 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a80b05e0 con 0x7f788c0037c0 2020-11-20T11:47:49.088 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.078+0000 7f78a7fff700 1 --2- 172.21.15.192:0/1584752133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f788c004520 0x7f78a80c0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:47:49.088 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.078+0000 7f78ad5d7700 1 --2- 172.21.15.192:0/1584752133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f788c004e90 0x7f78a8160120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:47:49.088 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.078+0000 7f78acdd6700 1 --2- 172.21.15.192:0/1584752133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f788c0037c0 0x7f78a80c7cc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f789c016d80 tx=0x7f789c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:47:49.089 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.080+0000 7f78a4ff9700 1 -- 172.21.15.192:0/1584752133 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c016e60 con 0x7f788c0037c0 2020-11-20T11:47:49.090 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.080+0000 7f78a4ff9700 1 -- 172.21.15.192:0/1584752133 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789c014d80 con 0x7f788c0037c0 2020-11-20T11:47:49.090 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.080+0000 7f78af03a700 1 -- 172.21.15.192:0/1584752133 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a80b0880 con 0x7f788c0037c0 2020-11-20T11:47:49.090 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.080+0000 7f78a4ff9700 1 -- 172.21.15.192:0/1584752133 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c017440 con 0x7f788c0037c0 2020-11-20T11:47:49.090 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.080+0000 7f78af03a700 1 -- 172.21.15.192:0/1584752133 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a80c0f30 con 0x7f788c0037c0 2020-11-20T11:47:49.091 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.080+0000 7f78a4ff9700 1 -- 172.21.15.192:0/1584752133 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f789c012040 con 0x7f788c0037c0 2020-11-20T11:47:49.091 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.080+0000 7f78a4ff9700 1 -- 172.21.15.192:0/1584752133 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f789c0207d0 con 0x7f788c0037c0 2020-11-20T11:47:49.091 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.081+0000 7f78af03a700 1 -- 172.21.15.192:0/1584752133 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a80699a0 con 0x7f788c0037c0 2020-11-20T11:47:49.091 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.083+0000 7f78a4ff9700 1 -- 172.21.15.192:0/1584752133 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f789c024020 con 0x7f788c0037c0 2020-11-20T11:47:49.163 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.160+0000 7f78af03a700 1 -- 172.21.15.192:0/1584752133 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f78a805ca80 con 0x7f788c0037c0 2020-11-20T11:47:49.168 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.165+0000 7f78a4ff9700 1 -- 172.21.15.192:0/1584752133 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f789c017d80 con 0x7f788c0037c0 2020-11-20T11:47:49.169 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.166+0000 7f78af03a700 1 -- 172.21.15.192:0/1584752133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f788c0037c0 msgr2=0x7f78a80c7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:49.169 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.166+0000 7f78af03a700 1 --2- 172.21.15.192:0/1584752133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f788c0037c0 0x7f78a80c7cc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f789c016d80 tx=0x7f789c008040).stop 2020-11-20T11:47:49.170 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.166+0000 7f78af03a700 1 -- 172.21.15.192:0/1584752133 shutdown_connections 2020-11-20T11:47:49.170 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.166+0000 7f78af03a700 1 --2- 172.21.15.192:0/1584752133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f788c004e90 0x7f78a8160120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:49.170 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.166+0000 7f78af03a700 1 --2- 172.21.15.192:0/1584752133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f788c0037c0 0x7f78a80c7cc0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:49.170 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.166+0000 7f78af03a700 1 --2- 172.21.15.192:0/1584752133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f788c004520 0x7f78a80c0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:49.170 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.166+0000 7f78af03a700 1 -- 172.21.15.192:0/1584752133 >> 172.21.15.192:0/1584752133 conn(0x7f78a8062100 msgr2=0x7f78a8067650 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:47:49.171 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.166+0000 7f78af03a700 1 -- 172.21.15.192:0/1584752133 shutdown_connections 2020-11-20T11:47:49.171 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:47:49.166+0000 7f78af03a700 1 -- 172.21.15.192:0/1584752133 wait complete. 2020-11-20T11:47:49.171 INFO:teuthology.orchestra.run.smithi192.stderr:adjusted tunables profile to default 2020-11-20T11:47:49.181 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2020-11-20T11:47:49.181 INFO:teuthology.orchestra.run.smithi192:> set -ex 2020-11-20T11:47:49.182 INFO:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2020-11-20T11:47:49.195 INFO:teuthology.orchestra.run.smithi192.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2020-11-20T11:47:49.205 INFO:teuthology.orchestra.run.smithi192.stdout:77a5e1d9-0fb0-450c-872e-4aee77dede49 2020-11-20T11:47:49.205 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records in 2020-11-20T11:47:49.206 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records out 2020-11-20T11:47:49.206 INFO:teuthology.orchestra.run.smithi192.stderr:37 bytes copied, 3.0518e-05 s, 1.2 MB/s 2020-11-20T11:47:49.207 INFO:teuthology.orchestra.run.smithi192:> set -ex 2020-11-20T11:47:49.207 INFO:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2020-11-20T11:47:49.260 INFO:teuthology.orchestra.run.smithi192.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2020-11-20T11:47:49.270 INFO:teuthology.orchestra.run.smithi192.stdout:4668cfdf-d172-4f30-95b8-ac842108a520 2020-11-20T11:47:49.270 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records in 2020-11-20T11:47:49.270 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records out 2020-11-20T11:47:49.271 INFO:teuthology.orchestra.run.smithi192.stderr:37 bytes copied, 3.3201e-05 s, 1.1 MB/s 2020-11-20T11:47:49.272 INFO:teuthology.orchestra.run.smithi192:> set -ex 2020-11-20T11:47:49.272 INFO:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2020-11-20T11:47:49.325 INFO:teuthology.orchestra.run.smithi192.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2020-11-20T11:47:49.334 INFO:teuthology.orchestra.run.smithi192.stdout:a659da2b-bdce-42ac-8b30-b8c69b4c7041 2020-11-20T11:47:49.335 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records in 2020-11-20T11:47:49.335 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records out 2020-11-20T11:47:49.335 INFO:teuthology.orchestra.run.smithi192.stderr:37 bytes copied, 3.1068e-05 s, 1.2 MB/s 2020-11-20T11:47:49.336 INFO:teuthology.orchestra.run.smithi192:> set -ex 2020-11-20T11:47:49.336 INFO:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2020-11-20T11:47:49.390 INFO:teuthology.orchestra.run.smithi192.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2020-11-20T11:47:49.399 INFO:teuthology.orchestra.run.smithi192.stdout:3523676f-c9b8-47ae-86c0-4930dca17831 2020-11-20T11:47:49.399 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records in 2020-11-20T11:47:49.399 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records out 2020-11-20T11:47:49.399 INFO:teuthology.orchestra.run.smithi192.stderr:37 bytes copied, 4.4029e-05 s, 840 kB/s 2020-11-20T11:47:49.400 INFO:teuthology.orchestra.run.smithi146:> set -ex 2020-11-20T11:47:49.401 INFO:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2020-11-20T11:47:49.416 INFO:teuthology.orchestra.run.smithi146.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2020-11-20T11:47:49.425 INFO:teuthology.orchestra.run.smithi146.stdout:564330c6-5c45-4ef6-8718-bbfa97848e6e 2020-11-20T11:47:49.425 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records in 2020-11-20T11:47:49.426 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records out 2020-11-20T11:47:49.426 INFO:teuthology.orchestra.run.smithi146.stderr:37 bytes copied, 4.0011e-05 s, 925 kB/s 2020-11-20T11:47:49.427 INFO:teuthology.orchestra.run.smithi146:> set -ex 2020-11-20T11:47:49.427 INFO:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2020-11-20T11:47:49.480 INFO:teuthology.orchestra.run.smithi146.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2020-11-20T11:47:49.491 INFO:teuthology.orchestra.run.smithi146.stdout:c4bc8ba5-0d22-49f5-97a6-2ca71e3a8c62 2020-11-20T11:47:49.492 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records in 2020-11-20T11:47:49.492 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records out 2020-11-20T11:47:49.492 INFO:teuthology.orchestra.run.smithi146.stderr:37 bytes copied, 5.2071e-05 s, 711 kB/s 2020-11-20T11:47:49.492 INFO:teuthology.orchestra.run.smithi146:> set -ex 2020-11-20T11:47:49.493 INFO:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2020-11-20T11:47:49.545 INFO:teuthology.orchestra.run.smithi146.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2020-11-20T11:47:49.554 INFO:teuthology.orchestra.run.smithi146.stdout:d6e41ac5-bab7-49e2-a17a-ef794bcc4a09 2020-11-20T11:47:49.555 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records in 2020-11-20T11:47:49.555 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records out 2020-11-20T11:47:49.555 INFO:teuthology.orchestra.run.smithi146.stderr:37 bytes copied, 3.4084e-05 s, 1.1 MB/s 2020-11-20T11:47:49.556 INFO:teuthology.orchestra.run.smithi146:> set -ex 2020-11-20T11:47:49.556 INFO:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-10/fsid of=/dev/stdout 2020-11-20T11:47:49.610 INFO:teuthology.orchestra.run.smithi146.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-10/fsid of=/dev/stdout 2020-11-20T11:47:49.620 INFO:teuthology.orchestra.run.smithi146.stdout:88d5c251-0bb1-4624-8fa2-7f3b74bd1bf1 2020-11-20T11:47:49.620 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records in 2020-11-20T11:47:49.620 INFO:teuthology.orchestra.run.smithi146.stderr:0+1 records out 2020-11-20T11:47:49.621 INFO:teuthology.orchestra.run.smithi146.stderr:37 bytes copied, 3.245e-05 s, 1.1 MB/s 2020-11-20T11:47:49.622 INFO:teuthology.orchestra.run.smithi087:> set -ex 2020-11-20T11:47:49.622 INFO:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2020-11-20T11:47:49.636 INFO:teuthology.orchestra.run.smithi087.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2020-11-20T11:47:49.646 INFO:teuthology.orchestra.run.smithi087.stdout:128ddb77-579b-4fa3-a0cb-7465ad959f3f 2020-11-20T11:47:49.646 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records in 2020-11-20T11:47:49.646 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records out 2020-11-20T11:47:49.646 INFO:teuthology.orchestra.run.smithi087.stderr:37 bytes copied, 3.2354e-05 s, 1.1 MB/s 2020-11-20T11:47:49.647 INFO:teuthology.orchestra.run.smithi087:> set -ex 2020-11-20T11:47:49.648 INFO:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2020-11-20T11:47:49.711 INFO:teuthology.orchestra.run.smithi087.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2020-11-20T11:47:49.720 INFO:teuthology.orchestra.run.smithi087.stdout:2d15f1db-e580-4715-9728-8fe5dd7e34d2 2020-11-20T11:47:49.721 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records in 2020-11-20T11:47:49.721 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records out 2020-11-20T11:47:49.721 INFO:teuthology.orchestra.run.smithi087.stderr:37 bytes copied, 3.1594e-05 s, 1.2 MB/s 2020-11-20T11:47:49.722 INFO:teuthology.orchestra.run.smithi087:> set -ex 2020-11-20T11:47:49.722 INFO:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2020-11-20T11:47:49.795 INFO:teuthology.orchestra.run.smithi087.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2020-11-20T11:47:49.810 INFO:teuthology.orchestra.run.smithi087.stdout:c4907993-7513-4162-974f-07dcb0a260a7 2020-11-20T11:47:49.812 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records in 2020-11-20T11:47:49.812 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records out 2020-11-20T11:47:49.813 INFO:teuthology.orchestra.run.smithi087.stderr:37 bytes copied, 3.2322e-05 s, 1.1 MB/s 2020-11-20T11:47:49.813 INFO:teuthology.orchestra.run.smithi087:> set -ex 2020-11-20T11:47:49.813 INFO:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/ceph-11/fsid of=/dev/stdout 2020-11-20T11:47:49.869 INFO:teuthology.orchestra.run.smithi087.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-11/fsid of=/dev/stdout 2020-11-20T11:47:49.881 INFO:teuthology.orchestra.run.smithi087.stdout:31f650d6-ba1e-4f29-92ff-6abee04c0f12 2020-11-20T11:47:49.882 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records in 2020-11-20T11:47:49.883 INFO:teuthology.orchestra.run.smithi087.stderr:0+1 records out 2020-11-20T11:47:49.883 INFO:teuthology.orchestra.run.smithi087.stderr:37 bytes copied, 3.2418e-05 s, 1.1 MB/s 2020-11-20T11:47:49.885 INFO:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new 77a5e1d9-0fb0-450c-872e-4aee77dede49 0 2020-11-20T11:47:50.039 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.036+0000 7f3495e83700 1 Processor -- start 2020-11-20T11:47:50.039 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.036+0000 7f3495e83700 1 -- start start 2020-11-20T11:47:50.041 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.036+0000 7f3495e83700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3490154920 0x7f3490060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:50.042 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.036+0000 7f3495e83700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3490151e80 con 0x7f3490064c40 2020-11-20T11:47:50.042 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.036+0000 7f3495e83700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3490152120 con 0x7f3490060370 2020-11-20T11:47:50.042 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.036+0000 7f3495e83700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3490064260 con 0x7f3490154920 2020-11-20T11:47:50.042 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.037+0000 7f348ffff700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f3490064c40 0x7f3490151340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:46446/0 (socket says 172.21.15.87:46446) 2020-11-20T11:47:50.043 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.037+0000 7f348ffff700 1 -- 172.21.15.87:0/4101932920 learned_addr learned my addr 172.21.15.87:0/4101932920 (peer_addr_for_me v1:172.21.15.87:0/0) 2020-11-20T11:47:50.043 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.037+0000 7f348effd700 1 --2- 172.21.15.87:0/4101932920 >> v2:172.21.15.146:3300/0 conn(0x7f3490154920 0x7f3490060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:50.043 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.037+0000 7f348e7fc700 1 -- 172.21.15.87:0/4101932920 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 767724996 0 0) 0x7f3490151e80 con 0x7f3490064c40 2020-11-20T11:47:50.043 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.037+0000 7f348e7fc700 1 -- 172.21.15.87:0/4101932920 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f347c003280 con 0x7f3490064c40 2020-11-20T11:47:50.043 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.037+0000 7f348e7fc700 1 -- 172.21.15.87:0/4101932920 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4039536655 0 0) 0x7f3490152120 con 0x7f3490060370 2020-11-20T11:47:50.044 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.037+0000 7f348e7fc700 1 -- 172.21.15.87:0/4101932920 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3490151e80 con 0x7f3490060370 2020-11-20T11:47:50.044 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.037+0000 7f348effd700 1 -- 172.21.15.87:0/4101932920 >> v1:172.21.15.192:6789/0 conn(0x7f3490060370 legacy=0x7f34900c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:50.044 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.037+0000 7f348effd700 1 -- 172.21.15.87:0/4101932920 >> v1:172.21.15.87:6789/0 conn(0x7f3490064c40 legacy=0x7f3490151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:50.044 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.037+0000 7f348effd700 1 -- 172.21.15.87:0/4101932920 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3490064500 con 0x7f3490154920 2020-11-20T11:47:50.045 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.037+0000 7f348effd700 1 --2- 172.21.15.87:0/4101932920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3490154920 0x7f3490060750 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f3484006fd0 tx=0x7f3484006e30).ready entity=mon.1 client_cookie=88417182e003302d server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:47:50.045 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.037+0000 7f348e7fc700 1 -- 172.21.15.87:0/4101932920 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34840096c0 con 0x7f3490154920 2020-11-20T11:47:50.045 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.037+0000 7f348e7fc700 1 -- 172.21.15.87:0/4101932920 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3484000e90 con 0x7f3490154920 2020-11-20T11:47:50.046 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.037+0000 7f348e7fc700 1 -- 172.21.15.87:0/4101932920 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3484009a30 con 0x7f3490154920 2020-11-20T11:47:50.046 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.038+0000 7f3495e83700 1 -- 172.21.15.87:0/4101932920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3490154920 msgr2=0x7f3490060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:50.046 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.038+0000 7f3495e83700 1 --2- 172.21.15.87:0/4101932920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3490154920 0x7f3490060750 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f3484006fd0 tx=0x7f3484006e30).stop 2020-11-20T11:47:50.046 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.038+0000 7f3495e83700 1 -- 172.21.15.87:0/4101932920 shutdown_connections 2020-11-20T11:47:50.047 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.038+0000 7f3495e83700 1 --2- 172.21.15.87:0/4101932920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3490154920 0x7f3490060750 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:50.047 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.038+0000 7f3495e83700 1 -- 172.21.15.87:0/4101932920 >> 172.21.15.87:0/4101932920 conn(0x7f3490062100 msgr2=0x7f34900c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:47:50.047 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.038+0000 7f3495e83700 1 -- 172.21.15.87:0/4101932920 shutdown_connections 2020-11-20T11:47:50.047 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.038+0000 7f3495e83700 1 -- 172.21.15.87:0/4101932920 wait complete. 2020-11-20T11:47:50.050 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.039+0000 7f3495e83700 1 Processor -- start 2020-11-20T11:47:50.050 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.039+0000 7f3495e83700 1 -- start start 2020-11-20T11:47:50.050 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.040+0000 7f3495e83700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3490060370 0x7f34901585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:50.051 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.040+0000 7f3495e83700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3490064c40 0x7f34900c4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:50.051 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.040+0000 7f3495e83700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3490154920 0x7f349014c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:50.051 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.040+0000 7f3495e83700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3490164950 con 0x7f3490154920 2020-11-20T11:47:50.051 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.040+0000 7f3495e83700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34900c1df0 con 0x7f3490064c40 2020-11-20T11:47:50.052 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.040+0000 7f3495e83700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34900c1610 con 0x7f3490060370 2020-11-20T11:47:50.052 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.040+0000 7f348ffff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3490154920 0x7f349014c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:50.052 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.040+0000 7f348ffff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3490154920 0x7f349014c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42498/0 (socket says 172.21.15.87:42498) 2020-11-20T11:47:50.052 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.040+0000 7f348ffff700 1 -- 172.21.15.87:0/2100223815 learned_addr learned my addr 172.21.15.87:0/2100223815 (peer_addr_for_me v2:172.21.15.87:0/0) 2020-11-20T11:47:50.052 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.040+0000 7f348effd700 1 --2- 172.21.15.87:0/2100223815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3490064c40 0x7f34900c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:50.053 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.040+0000 7f348f7fe700 1 --2- 172.21.15.87:0/2100223815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3490060370 0x7f34901585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:50.053 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.040+0000 7f348ffff700 1 -- 172.21.15.87:0/2100223815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3490060370 msgr2=0x7f34901585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:50.053 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.040+0000 7f348ffff700 1 --2- 172.21.15.87:0/2100223815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3490060370 0x7f34901585a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:50.053 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.040+0000 7f348ffff700 1 -- 172.21.15.87:0/2100223815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3490064c40 msgr2=0x7f34900c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:50.054 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.040+0000 7f348ffff700 1 --2- 172.21.15.87:0/2100223815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3490064c40 0x7f34900c4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:50.054 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.040+0000 7f348ffff700 1 -- 172.21.15.87:0/2100223815 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34900c18b0 con 0x7f3490154920 2020-11-20T11:47:50.054 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.040+0000 7f348ffff700 1 --2- 172.21.15.87:0/2100223815 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3490154920 0x7f349014c4f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f348000c6a0 tx=0x7f3480007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:47:50.054 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.041+0000 7f346f7fe700 1 -- 172.21.15.87:0/2100223815 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34800072e0 con 0x7f3490154920 2020-11-20T11:47:50.054 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.041+0000 7f346f7fe700 1 -- 172.21.15.87:0/2100223815 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3480007440 con 0x7f3490154920 2020-11-20T11:47:50.055 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.041+0000 7f3495e83700 1 -- 172.21.15.87:0/2100223815 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34900c1b50 con 0x7f3490154920 2020-11-20T11:47:50.055 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.041+0000 7f346f7fe700 1 -- 172.21.15.87:0/2100223815 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3480005840 con 0x7f3490154920 2020-11-20T11:47:50.055 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.041+0000 7f3495e83700 1 -- 172.21.15.87:0/2100223815 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34900c0360 con 0x7f3490154920 2020-11-20T11:47:50.055 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.041+0000 7f346f7fe700 1 -- 172.21.15.87:0/2100223815 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f348001a060 con 0x7f3490154920 2020-11-20T11:47:50.055 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.041+0000 7f346f7fe700 1 -- 172.21.15.87:0/2100223815 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7f3480013850 con 0x7f3490154920 2020-11-20T11:47:50.056 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.042+0000 7f3495e83700 1 -- 172.21.15.87:0/2100223815 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f349014bec0 con 0x7f3490154920 2020-11-20T11:47:50.056 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.044+0000 7f346f7fe700 1 -- 172.21.15.87:0/2100223815 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f3480018070 con 0x7f3490154920 2020-11-20T11:47:50.126 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.123+0000 7f3495e83700 1 -- 172.21.15.87:0/2100223815 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "77a5e1d9-0fb0-450c-872e-4aee77dede49", "id": 0} v 0) v1 -- 0x7f34900699a0 con 0x7f3490154920 2020-11-20T11:47:50.129 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.126+0000 7f346f7fe700 1 -- 172.21.15.87:0/2100223815 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "77a5e1d9-0fb0-450c-872e-4aee77dede49", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3480013a90 con 0x7f3490154920 2020-11-20T11:47:50.129 INFO:teuthology.orchestra.run.smithi087.stdout:0 2020-11-20T11:47:50.131 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.128+0000 7f346d7fa700 1 -- 172.21.15.87:0/2100223815 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3490154920 msgr2=0x7f349014c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:50.131 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.128+0000 7f346d7fa700 1 --2- 172.21.15.87:0/2100223815 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3490154920 0x7f349014c4f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f348000c6a0 tx=0x7f3480007ae0).stop 2020-11-20T11:47:50.131 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.128+0000 7f346d7fa700 1 -- 172.21.15.87:0/2100223815 shutdown_connections 2020-11-20T11:47:50.131 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.128+0000 7f346d7fa700 1 --2- 172.21.15.87:0/2100223815 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3490154920 0x7f349014c4f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:50.132 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.128+0000 7f346d7fa700 1 --2- 172.21.15.87:0/2100223815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3490060370 0x7f34901585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:50.132 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.128+0000 7f346d7fa700 1 --2- 172.21.15.87:0/2100223815 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3490064c40 0x7f34900c4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:50.132 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.128+0000 7f346d7fa700 1 -- 172.21.15.87:0/2100223815 >> 172.21.15.87:0/2100223815 conn(0x7f3490062100 msgr2=0x7f3490153030 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:47:50.132 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.128+0000 7f346d7fa700 1 -- 172.21.15.87:0/2100223815 shutdown_connections 2020-11-20T11:47:50.132 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.128+0000 7f346d7fa700 1 -- 172.21.15.87:0/2100223815 wait complete. 2020-11-20T11:47:50.145 INFO:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new 564330c6-5c45-4ef6-8718-bbfa97848e6e 1 2020-11-20T11:47:50.288 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.285+0000 7fad3ad3b700 1 Processor -- start 2020-11-20T11:47:50.288 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.285+0000 7fad3ad3b700 1 -- start start 2020-11-20T11:47:50.291 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.286+0000 7fad3ad3b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fad341519d0 0x7fad34060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:50.291 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.286+0000 7fad3ad3b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fad340bce00 0x7fad340bd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:50.291 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.286+0000 7fad3ad3b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad3414dc50 con 0x7fad34060370 2020-11-20T11:47:50.291 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.286+0000 7fad3ad3b700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad3414def0 con 0x7fad341519d0 2020-11-20T11:47:50.292 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.286+0000 7fad3ad3b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad3414e190 con 0x7fad340bce00 2020-11-20T11:47:50.292 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.286+0000 7fad33fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fad341519d0 0x7fad34060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:50.292 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.286+0000 7fad33fff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fad341519d0 0x7fad34060750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42502/0 (socket says 172.21.15.87:42502) 2020-11-20T11:47:50.292 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.286+0000 7fad33fff700 1 -- 172.21.15.87:0/2127482014 learned_addr learned my addr 172.21.15.87:0/2127482014 (peer_addr_for_me v2:172.21.15.87:0/0) 2020-11-20T11:47:50.292 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.286+0000 7fad392d8700 1 --2- 172.21.15.87:0/2127482014 >> v2:172.21.15.146:3300/0 conn(0x7fad340bce00 0x7fad340bd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:50.293 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.286+0000 7fad33fff700 1 -- 172.21.15.87:0/2127482014 >> v2:172.21.15.146:3300/0 conn(0x7fad340bce00 msgr2=0x7fad340bd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:47:50.293 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.286+0000 7fad33fff700 1 --2- 172.21.15.87:0/2127482014 >> v2:172.21.15.146:3300/0 conn(0x7fad340bce00 0x7fad340bd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:50.293 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.286+0000 7fad33fff700 1 -- 172.21.15.87:0/2127482014 >> v1:172.21.15.146:6789/0 conn(0x7fad34060370 legacy=0x7fad340bbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:50.293 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.286+0000 7fad33fff700 1 -- 172.21.15.87:0/2127482014 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3414e430 con 0x7fad341519d0 2020-11-20T11:47:50.293 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.286+0000 7fad392d8700 1 --2- 172.21.15.87:0/2127482014 >> v2:172.21.15.146:3300/0 conn(0x7fad340bce00 0x7fad340bd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:47:50.294 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.286+0000 7fad33fff700 1 --2- 172.21.15.87:0/2127482014 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad341519d0 0x7fad34060750 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fad34066840 tx=0x7fad20006ef0).ready entity=mon.0 client_cookie=45490ca368965dc8 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:47:50.294 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.287+0000 7fad337fe700 1 -- 172.21.15.87:0/2127482014 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2000b860 con 0x7fad341519d0 2020-11-20T11:47:50.294 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.287+0000 7fad337fe700 1 -- 172.21.15.87:0/2127482014 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad20000e90 con 0x7fad341519d0 2020-11-20T11:47:50.294 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.287+0000 7fad337fe700 1 -- 172.21.15.87:0/2127482014 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2000bbd0 con 0x7fad341519d0 2020-11-20T11:47:50.294 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.287+0000 7fad3ad3b700 1 -- 172.21.15.87:0/2127482014 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad341519d0 msgr2=0x7fad34060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:50.295 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.287+0000 7fad3ad3b700 1 --2- 172.21.15.87:0/2127482014 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad341519d0 0x7fad34060750 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fad34066840 tx=0x7fad20006ef0).stop 2020-11-20T11:47:50.295 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.287+0000 7fad3ad3b700 1 -- 172.21.15.87:0/2127482014 shutdown_connections 2020-11-20T11:47:50.295 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.287+0000 7fad3ad3b700 1 --2- 172.21.15.87:0/2127482014 >> v2:172.21.15.146:3300/0 conn(0x7fad340bce00 0x7fad340bd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:50.295 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.287+0000 7fad3ad3b700 1 --2- 172.21.15.87:0/2127482014 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad341519d0 0x7fad34060750 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:50.295 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.287+0000 7fad3ad3b700 1 -- 172.21.15.87:0/2127482014 >> 172.21.15.87:0/2127482014 conn(0x7fad34062100 msgr2=0x7fad340c3590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:47:50.296 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.287+0000 7fad3ad3b700 1 -- 172.21.15.87:0/2127482014 shutdown_connections 2020-11-20T11:47:50.296 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.287+0000 7fad3ad3b700 1 -- 172.21.15.87:0/2127482014 wait complete. 2020-11-20T11:47:50.298 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.288+0000 7fad3ad3b700 1 Processor -- start 2020-11-20T11:47:50.299 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.288+0000 7fad3ad3b700 1 -- start start 2020-11-20T11:47:50.299 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.289+0000 7fad3ad3b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad34060370 0x7fad340c0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:50.299 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.289+0000 7fad3ad3b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad340bce00 0x7fad340b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:50.299 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.289+0000 7fad3ad3b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad341519d0 0x7fad340b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:50.300 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.289+0000 7fad3ad3b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3414ba40 con 0x7fad341519d0 2020-11-20T11:47:50.300 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.289+0000 7fad3ad3b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3414bce0 con 0x7fad34060370 2020-11-20T11:47:50.300 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.289+0000 7fad3ad3b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3414bf80 con 0x7fad340bce00 2020-11-20T11:47:50.300 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.289+0000 7fad392d8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad341519d0 0x7fad340b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:50.300 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.289+0000 7fad392d8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad341519d0 0x7fad340b2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42510/0 (socket says 172.21.15.87:42510) 2020-11-20T11:47:50.301 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.289+0000 7fad392d8700 1 -- 172.21.15.87:0/732183804 learned_addr learned my addr 172.21.15.87:0/732183804 (peer_addr_for_me v2:172.21.15.87:0/0) 2020-11-20T11:47:50.301 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.289+0000 7fad38ad7700 1 --2- 172.21.15.87:0/732183804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad34060370 0x7fad340c0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:50.301 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.289+0000 7fad33fff700 1 --2- 172.21.15.87:0/732183804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad340bce00 0x7fad340b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:50.301 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.290+0000 7fad392d8700 1 -- 172.21.15.87:0/732183804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad340bce00 msgr2=0x7fad340b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:50.302 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.290+0000 7fad392d8700 1 --2- 172.21.15.87:0/732183804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad340bce00 0x7fad340b1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:50.302 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.290+0000 7fad392d8700 1 -- 172.21.15.87:0/732183804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad34060370 msgr2=0x7fad340c0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:50.302 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.290+0000 7fad392d8700 1 --2- 172.21.15.87:0/732183804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad34060370 0x7fad340c0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:50.302 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.290+0000 7fad392d8700 1 -- 172.21.15.87:0/732183804 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3414c220 con 0x7fad341519d0 2020-11-20T11:47:50.302 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.290+0000 7fad33fff700 1 --2- 172.21.15.87:0/732183804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad340bce00 0x7fad340b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:47:50.303 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.290+0000 7fad392d8700 1 --2- 172.21.15.87:0/732183804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad341519d0 0x7fad340b2080 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fad2c00ecc0 tx=0x7fad2c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:47:50.303 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.290+0000 7fad30ff9700 1 -- 172.21.15.87:0/732183804 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2c00c790 con 0x7fad341519d0 2020-11-20T11:47:50.303 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.290+0000 7fad30ff9700 1 -- 172.21.15.87:0/732183804 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad2c00c8f0 con 0x7fad341519d0 2020-11-20T11:47:50.303 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.290+0000 7fad3ad3b700 1 -- 172.21.15.87:0/732183804 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad3414c4c0 con 0x7fad341519d0 2020-11-20T11:47:50.303 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.290+0000 7fad30ff9700 1 -- 172.21.15.87:0/732183804 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2c00cc70 con 0x7fad341519d0 2020-11-20T11:47:50.304 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.290+0000 7fad3ad3b700 1 -- 172.21.15.87:0/732183804 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad340c0740 con 0x7fad341519d0 2020-11-20T11:47:50.304 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.290+0000 7fad30ff9700 1 -- 172.21.15.87:0/732183804 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fad2c005cf0 con 0x7fad341519d0 2020-11-20T11:47:50.304 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.290+0000 7fad30ff9700 1 -- 172.21.15.87:0/732183804 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7fad2c006020 con 0x7fad341519d0 2020-11-20T11:47:50.304 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.291+0000 7fad3ad3b700 1 -- 172.21.15.87:0/732183804 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad34163f20 con 0x7fad341519d0 2020-11-20T11:47:50.304 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.293+0000 7fad30ff9700 1 -- 172.21.15.87:0/732183804 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7fad34163f20 con 0x7fad341519d0 2020-11-20T11:47:50.373 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.370+0000 7fad3ad3b700 1 -- 172.21.15.87:0/732183804 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "564330c6-5c45-4ef6-8718-bbfa97848e6e", "id": 1} v 0) v1 -- 0x7fad340699a0 con 0x7fad341519d0 2020-11-20T11:47:50.376 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.373+0000 7fad30ff9700 1 -- 172.21.15.87:0/732183804 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "564330c6-5c45-4ef6-8718-bbfa97848e6e", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fad2c02c0b0 con 0x7fad341519d0 2020-11-20T11:47:50.377 INFO:teuthology.orchestra.run.smithi087.stdout:1 2020-11-20T11:47:50.379 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.374+0000 7fad3ad3b700 1 -- 172.21.15.87:0/732183804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad341519d0 msgr2=0x7fad340b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:50.379 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.374+0000 7fad3ad3b700 1 --2- 172.21.15.87:0/732183804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad341519d0 0x7fad340b2080 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fad2c00ecc0 tx=0x7fad2c008040).stop 2020-11-20T11:47:50.380 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.374+0000 7fad3ad3b700 1 -- 172.21.15.87:0/732183804 shutdown_connections 2020-11-20T11:47:50.380 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.374+0000 7fad3ad3b700 1 --2- 172.21.15.87:0/732183804 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad341519d0 0x7fad340b2080 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:50.380 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.374+0000 7fad3ad3b700 1 --2- 172.21.15.87:0/732183804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad34060370 0x7fad340c0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:50.381 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.374+0000 7fad3ad3b700 1 --2- 172.21.15.87:0/732183804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad340bce00 0x7fad340b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:50.381 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.374+0000 7fad3ad3b700 1 -- 172.21.15.87:0/732183804 >> 172.21.15.87:0/732183804 conn(0x7fad34062100 msgr2=0x7fad34068140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:47:50.382 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.374+0000 7fad3ad3b700 1 -- 172.21.15.87:0/732183804 shutdown_connections 2020-11-20T11:47:50.382 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.374+0000 7fad3ad3b700 1 -- 172.21.15.87:0/732183804 wait complete. 2020-11-20T11:47:50.389 INFO:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new 128ddb77-579b-4fa3-a0cb-7465ad959f3f 2 2020-11-20T11:47:50.499 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.496+0000 7fe5cbdc7700 1 Processor -- start 2020-11-20T11:47:50.499 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.496+0000 7fe5cbdc7700 1 -- start start 2020-11-20T11:47:50.506 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.497+0000 7fe5cbdc7700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe5c41519d0 0x7fe5c4060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:50.506 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.497+0000 7fe5cbdc7700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5c40bd970 con 0x7fe5c40bce00 2020-11-20T11:47:50.506 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.497+0000 7fe5cbdc7700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5c414dc50 con 0x7fe5c4060370 2020-11-20T11:47:50.507 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.497+0000 7fe5cbdc7700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5c414def0 con 0x7fe5c41519d0 2020-11-20T11:47:50.507 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.497+0000 7fe5c9362700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe5c41519d0 0x7fe5c4060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:50.507 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.497+0000 7fe5ca364700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fe5c40bce00 0x7fe5c40bd260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:46470/0 (socket says 172.21.15.87:46470) 2020-11-20T11:47:50.507 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.497+0000 7fe5ca364700 1 -- 172.21.15.87:0/2846730166 learned_addr learned my addr 172.21.15.87:0/2846730166 (peer_addr_for_me v1:172.21.15.87:0/0) 2020-11-20T11:47:50.508 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.497+0000 7fe5c9362700 1 -- 172.21.15.87:0/2846730166 >> v1:172.21.15.146:6789/0 conn(0x7fe5c4060370 legacy=0x7fe5c40bbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:50.508 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.497+0000 7fe5c9362700 1 -- 172.21.15.87:0/2846730166 >> v1:172.21.15.87:6789/0 conn(0x7fe5c40bce00 legacy=0x7fe5c40bd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:50.508 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.497+0000 7fe5c8b61700 1 -- 172.21.15.87:0/2846730166 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3543816724 0 0) 0x7fe5c40bd970 con 0x7fe5c40bce00 2020-11-20T11:47:50.508 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.497+0000 7fe5c9362700 1 -- 172.21.15.87:0/2846730166 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c414e190 con 0x7fe5c41519d0 2020-11-20T11:47:50.509 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.497+0000 7fe5c9362700 1 --2- 172.21.15.87:0/2846730166 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5c41519d0 0x7fe5c4060750 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fe5b4006fd0 tx=0x7fe5b4006e30).ready entity=mon.0 client_cookie=aeb36d3fd0c814e4 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:47:50.509 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.497+0000 7fe5c8b61700 1 -- 172.21.15.87:0/2846730166 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b40097e0 con 0x7fe5c41519d0 2020-11-20T11:47:50.509 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.497+0000 7fe5c8b61700 1 -- 172.21.15.87:0/2846730166 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b4000e90 con 0x7fe5c41519d0 2020-11-20T11:47:50.509 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.497+0000 7fe5c8b61700 1 -- 172.21.15.87:0/2846730166 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b4009b50 con 0x7fe5c41519d0 2020-11-20T11:47:50.509 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.498+0000 7fe5cbdc7700 1 -- 172.21.15.87:0/2846730166 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5c41519d0 msgr2=0x7fe5c4060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:50.510 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.498+0000 7fe5cbdc7700 1 --2- 172.21.15.87:0/2846730166 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5c41519d0 0x7fe5c4060750 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fe5b4006fd0 tx=0x7fe5b4006e30).stop 2020-11-20T11:47:50.510 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.498+0000 7fe5cbdc7700 1 -- 172.21.15.87:0/2846730166 shutdown_connections 2020-11-20T11:47:50.510 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.498+0000 7fe5cbdc7700 1 --2- 172.21.15.87:0/2846730166 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5c41519d0 0x7fe5c4060750 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:50.510 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.498+0000 7fe5cbdc7700 1 -- 172.21.15.87:0/2846730166 >> 172.21.15.87:0/2846730166 conn(0x7fe5c4062100 msgr2=0x7fe5c40c3590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:47:50.510 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.498+0000 7fe5cbdc7700 1 -- 172.21.15.87:0/2846730166 shutdown_connections 2020-11-20T11:47:50.511 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.498+0000 7fe5cbdc7700 1 -- 172.21.15.87:0/2846730166 wait complete. 2020-11-20T11:47:50.511 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.499+0000 7fe5cbdc7700 1 Processor -- start 2020-11-20T11:47:50.511 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.499+0000 7fe5cbdc7700 1 -- start start 2020-11-20T11:47:50.511 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.500+0000 7fe5cbdc7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5c4060370 0x7fe5c40bbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:50.511 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.500+0000 7fe5cbdc7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5c40bce00 0x7fe5c40b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:50.512 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.500+0000 7fe5cbdc7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5c41519d0 0x7fe5c40b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:50.512 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.500+0000 7fe5cbdc7700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c4161be0 con 0x7fe5c40bce00 2020-11-20T11:47:50.512 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.500+0000 7fe5cbdc7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c4161e80 con 0x7fe5c4060370 2020-11-20T11:47:50.512 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.500+0000 7fe5cbdc7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c4162120 con 0x7fe5c41519d0 2020-11-20T11:47:50.512 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.500+0000 7fe5c9362700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5c40bce00 0x7fe5c40b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:50.513 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.500+0000 7fe5c9362700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5c40bce00 0x7fe5c40b39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42520/0 (socket says 172.21.15.87:42520) 2020-11-20T11:47:50.513 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.500+0000 7fe5c9362700 1 -- 172.21.15.87:0/34218991 learned_addr learned my addr 172.21.15.87:0/34218991 (peer_addr_for_me v2:172.21.15.87:0/0) 2020-11-20T11:47:50.513 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.500+0000 7fe5ca364700 1 --2- 172.21.15.87:0/34218991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5c41519d0 0x7fe5c40b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:50.513 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.500+0000 7fe5c9b63700 1 --2- 172.21.15.87:0/34218991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5c4060370 0x7fe5c40bbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:50.513 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.500+0000 7fe5c9362700 1 -- 172.21.15.87:0/34218991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5c41519d0 msgr2=0x7fe5c40b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:50.514 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.500+0000 7fe5c9362700 1 --2- 172.21.15.87:0/34218991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5c41519d0 0x7fe5c40b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:50.514 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.500+0000 7fe5c9362700 1 -- 172.21.15.87:0/34218991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5c4060370 msgr2=0x7fe5c40bbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:50.514 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.500+0000 7fe5c9362700 1 --2- 172.21.15.87:0/34218991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5c4060370 0x7fe5c40bbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:50.514 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.500+0000 7fe5c9362700 1 -- 172.21.15.87:0/34218991 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c41623c0 con 0x7fe5c40bce00 2020-11-20T11:47:50.515 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.500+0000 7fe5ca364700 1 --2- 172.21.15.87:0/34218991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5c41519d0 0x7fe5c40b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:47:50.515 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.500+0000 7fe5c9b63700 1 --2- 172.21.15.87:0/34218991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5c4060370 0x7fe5c40bbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:47:50.515 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.500+0000 7fe5c9362700 1 --2- 172.21.15.87:0/34218991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5c40bce00 0x7fe5c40b39a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fe5b400b150 tx=0x7fe5b4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:47:50.515 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.501+0000 7fe5b1ffb700 1 -- 172.21.15.87:0/34218991 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b401e460 con 0x7fe5c40bce00 2020-11-20T11:47:50.516 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.501+0000 7fe5b1ffb700 1 -- 172.21.15.87:0/34218991 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b401e5c0 con 0x7fe5c40bce00 2020-11-20T11:47:50.517 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.501+0000 7fe5cbdc7700 1 -- 172.21.15.87:0/34218991 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c4162660 con 0x7fe5c40bce00 2020-11-20T11:47:50.517 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.501+0000 7fe5b1ffb700 1 -- 172.21.15.87:0/34218991 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b401e960 con 0x7fe5c40bce00 2020-11-20T11:47:50.517 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.501+0000 7fe5cbdc7700 1 -- 172.21.15.87:0/34218991 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c40c2bf0 con 0x7fe5c40bce00 2020-11-20T11:47:50.517 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.501+0000 7fe5b1ffb700 1 -- 172.21.15.87:0/34218991 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fe5b4025030 con 0x7fe5c40bce00 2020-11-20T11:47:50.518 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.501+0000 7fe5b1ffb700 1 -- 172.21.15.87:0/34218991 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7fe5b4028ac0 con 0x7fe5c40bce00 2020-11-20T11:47:50.518 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.502+0000 7fe5cbdc7700 1 -- 172.21.15.87:0/34218991 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5c40699a0 con 0x7fe5c40bce00 2020-11-20T11:47:50.519 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.504+0000 7fe5b1ffb700 1 -- 172.21.15.87:0/34218991 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7fe5b402d060 con 0x7fe5c40bce00 2020-11-20T11:47:50.583 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.580+0000 7fe5cbdc7700 1 -- 172.21.15.87:0/34218991 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "128ddb77-579b-4fa3-a0cb-7465ad959f3f", "id": 2} v 0) v1 -- 0x7fe5c405ca80 con 0x7fe5c40bce00 2020-11-20T11:47:50.586 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.583+0000 7fe5b1ffb700 1 -- 172.21.15.87:0/34218991 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "128ddb77-579b-4fa3-a0cb-7465ad959f3f", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe5b4023070 con 0x7fe5c40bce00 2020-11-20T11:47:50.587 INFO:teuthology.orchestra.run.smithi087.stdout:2 2020-11-20T11:47:50.588 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.584+0000 7fe5cbdc7700 1 -- 172.21.15.87:0/34218991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5c40bce00 msgr2=0x7fe5c40b39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:50.588 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.584+0000 7fe5cbdc7700 1 --2- 172.21.15.87:0/34218991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5c40bce00 0x7fe5c40b39a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fe5b400b150 tx=0x7fe5b4015000).stop 2020-11-20T11:47:50.588 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.584+0000 7fe5cbdc7700 1 -- 172.21.15.87:0/34218991 shutdown_connections 2020-11-20T11:47:50.588 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.584+0000 7fe5cbdc7700 1 --2- 172.21.15.87:0/34218991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5c41519d0 0x7fe5c40b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:50.589 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.584+0000 7fe5cbdc7700 1 --2- 172.21.15.87:0/34218991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5c4060370 0x7fe5c40bbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:50.589 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.584+0000 7fe5cbdc7700 1 --2- 172.21.15.87:0/34218991 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe5c40bce00 0x7fe5c40b39a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:50.589 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.584+0000 7fe5cbdc7700 1 -- 172.21.15.87:0/34218991 >> 172.21.15.87:0/34218991 conn(0x7fe5c4062100 msgr2=0x7fe5c414bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:47:50.589 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.584+0000 7fe5cbdc7700 1 -- 172.21.15.87:0/34218991 shutdown_connections 2020-11-20T11:47:50.590 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.584+0000 7fe5cbdc7700 1 -- 172.21.15.87:0/34218991 wait complete. 2020-11-20T11:47:50.598 INFO:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new 4668cfdf-d172-4f30-95b8-ac842108a520 3 2020-11-20T11:47:50.709 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.706+0000 7f3da7591700 1 Processor -- start 2020-11-20T11:47:50.709 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.706+0000 7f3da7591700 1 -- start start 2020-11-20T11:47:50.712 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.707+0000 7f3da7591700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3da0154920 0x7f3da0060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:50.712 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.707+0000 7f3da7591700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da0151e80 con 0x7f3da0064c40 2020-11-20T11:47:50.712 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.707+0000 7f3da7591700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da0152120 con 0x7f3da0060370 2020-11-20T11:47:50.712 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.707+0000 7f3da7591700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da0064260 con 0x7f3da0154920 2020-11-20T11:47:50.713 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.707+0000 7f3da5b2e700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f3da0064c40 0x7f3da0151340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:46482/0 (socket says 172.21.15.87:46482) 2020-11-20T11:47:50.713 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.707+0000 7f3da5b2e700 1 -- 172.21.15.87:0/1621616851 learned_addr learned my addr 172.21.15.87:0/1621616851 (peer_addr_for_me v1:172.21.15.87:0/0) 2020-11-20T11:47:50.713 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.707+0000 7f3da4b2c700 1 --2- 172.21.15.87:0/1621616851 >> v2:172.21.15.146:3300/0 conn(0x7f3da0154920 0x7f3da0060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:50.713 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.707+0000 7f3d8ffff700 1 -- 172.21.15.87:0/1621616851 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 260623478 0 0) 0x7f3da0151e80 con 0x7f3da0064c40 2020-11-20T11:47:50.713 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.707+0000 7f3d8ffff700 1 -- 172.21.15.87:0/1621616851 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d88003280 con 0x7f3da0064c40 2020-11-20T11:47:50.714 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.708+0000 7f3d8ffff700 1 -- 172.21.15.87:0/1621616851 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 495108010 0 0) 0x7f3da0152120 con 0x7f3da0060370 2020-11-20T11:47:50.714 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.708+0000 7f3da4b2c700 1 -- 172.21.15.87:0/1621616851 >> v1:172.21.15.146:6789/0 conn(0x7f3da0060370 legacy=0x7f3da00c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:50.714 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.708+0000 7f3da4b2c700 1 -- 172.21.15.87:0/1621616851 >> v1:172.21.15.87:6789/0 conn(0x7f3da0064c40 legacy=0x7f3da0151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:50.714 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.708+0000 7f3da4b2c700 1 -- 172.21.15.87:0/1621616851 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da0064500 con 0x7f3da0154920 2020-11-20T11:47:50.714 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.708+0000 7f3da4b2c700 1 --2- 172.21.15.87:0/1621616851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3da0154920 0x7f3da0060750 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f3d9c006fd0 tx=0x7f3d9c006e30).ready entity=mon.1 client_cookie=837167f286fb75f8 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:47:50.715 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.708+0000 7f3d8ffff700 1 -- 172.21.15.87:0/1621616851 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c00bec0 con 0x7f3da0154920 2020-11-20T11:47:50.715 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.708+0000 7f3d8ffff700 1 -- 172.21.15.87:0/1621616851 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9c000e90 con 0x7f3da0154920 2020-11-20T11:47:50.715 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.708+0000 7f3d8ffff700 1 -- 172.21.15.87:0/1621616851 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c009a80 con 0x7f3da0154920 2020-11-20T11:47:50.715 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.708+0000 7f3da7591700 1 -- 172.21.15.87:0/1621616851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3da0154920 msgr2=0x7f3da0060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:50.716 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.708+0000 7f3da7591700 1 --2- 172.21.15.87:0/1621616851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3da0154920 0x7f3da0060750 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f3d9c006fd0 tx=0x7f3d9c006e30).stop 2020-11-20T11:47:50.716 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.708+0000 7f3da7591700 1 -- 172.21.15.87:0/1621616851 shutdown_connections 2020-11-20T11:47:50.716 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.708+0000 7f3da7591700 1 --2- 172.21.15.87:0/1621616851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3da0154920 0x7f3da0060750 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:50.716 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.708+0000 7f3da7591700 1 -- 172.21.15.87:0/1621616851 >> 172.21.15.87:0/1621616851 conn(0x7f3da0062100 msgr2=0x7f3da00c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:47:50.716 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.709+0000 7f3da7591700 1 -- 172.21.15.87:0/1621616851 shutdown_connections 2020-11-20T11:47:50.717 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.709+0000 7f3da7591700 1 -- 172.21.15.87:0/1621616851 wait complete. 2020-11-20T11:47:50.719 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.710+0000 7f3da7591700 1 Processor -- start 2020-11-20T11:47:50.719 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.710+0000 7f3da7591700 1 -- start start 2020-11-20T11:47:50.720 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.710+0000 7f3da7591700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3da0060370 0x7f3da00c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:50.720 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.710+0000 7f3da7591700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3da0064c40 0x7f3da01644c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:50.720 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.710+0000 7f3da7591700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3da0154920 0x7f3da0067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:50.720 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.710+0000 7f3da7591700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da01649b0 con 0x7f3da0154920 2020-11-20T11:47:50.720 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.710+0000 7f3da7591700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da01582f0 con 0x7f3da0060370 2020-11-20T11:47:50.721 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.711+0000 7f3da7591700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da00c0330 con 0x7f3da0064c40 2020-11-20T11:47:50.721 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.711+0000 7f3da5b2e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3da0154920 0x7f3da0067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:50.721 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.711+0000 7f3da532d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3da0060370 0x7f3da00c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:50.721 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.711+0000 7f3da532d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3da0060370 0x7f3da00c12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.87:35042/0 (socket says 172.21.15.87:35042) 2020-11-20T11:47:50.721 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.711+0000 7f3da5b2e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3da0154920 0x7f3da0067570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42534/0 (socket says 172.21.15.87:42534) 2020-11-20T11:47:50.722 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.711+0000 7f3da532d700 1 -- 172.21.15.87:0/3576718948 learned_addr learned my addr 172.21.15.87:0/3576718948 (peer_addr_for_me v2:172.21.15.87:0/0) 2020-11-20T11:47:50.722 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.711+0000 7f3da4b2c700 1 --2- 172.21.15.87:0/3576718948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3da0064c40 0x7f3da01644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:50.722 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.711+0000 7f3da532d700 1 -- 172.21.15.87:0/3576718948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3da0064c40 msgr2=0x7f3da01644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:50.722 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.711+0000 7f3da532d700 1 --2- 172.21.15.87:0/3576718948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3da0064c40 0x7f3da01644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:50.722 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.711+0000 7f3da532d700 1 -- 172.21.15.87:0/3576718948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3da0154920 msgr2=0x7f3da0067570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:50.723 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.711+0000 7f3da532d700 1 --2- 172.21.15.87:0/3576718948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3da0154920 0x7f3da0067570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:50.723 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.711+0000 7f3da532d700 1 -- 172.21.15.87:0/3576718948 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da00c1dd0 con 0x7f3da0060370 2020-11-20T11:47:50.723 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.711+0000 7f3da4b2c700 1 --2- 172.21.15.87:0/3576718948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3da0064c40 0x7f3da01644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:47:50.723 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.711+0000 7f3da532d700 1 --2- 172.21.15.87:0/3576718948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3da0060370 0x7f3da00c12a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f3d9000c760 tx=0x7f3d90007c90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:47:50.723 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.711+0000 7f3d8d7fa700 1 -- 172.21.15.87:0/3576718948 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d90001ea0 con 0x7f3da0060370 2020-11-20T11:47:50.724 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.711+0000 7f3d8d7fa700 1 -- 172.21.15.87:0/3576718948 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d90007020 con 0x7f3da0060370 2020-11-20T11:47:50.724 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.711+0000 7f3da7591700 1 -- 172.21.15.87:0/3576718948 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da0158550 con 0x7f3da0060370 2020-11-20T11:47:50.724 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.711+0000 7f3d8d7fa700 1 -- 172.21.15.87:0/3576718948 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d900073e0 con 0x7f3da0060370 2020-11-20T11:47:50.724 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.711+0000 7f3da7591700 1 -- 172.21.15.87:0/3576718948 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da00c1890 con 0x7f3da0060370 2020-11-20T11:47:50.724 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.711+0000 7f3d8d7fa700 1 -- 172.21.15.87:0/3576718948 <== mon.1 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f3d9001a060 con 0x7f3da0060370 2020-11-20T11:47:50.725 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.711+0000 7f3d8d7fa700 1 -- 172.21.15.87:0/3576718948 <== mon.1 v2:172.21.15.146:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7f3d9000e4a0 con 0x7f3da0060370 2020-11-20T11:47:50.725 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.712+0000 7f3da7591700 1 -- 172.21.15.87:0/3576718948 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da0154760 con 0x7f3da0060370 2020-11-20T11:47:50.725 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.715+0000 7f3d8d7fa700 1 -- 172.21.15.87:0/3576718948 <== mon.1 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f3d90018070 con 0x7f3da0060370 2020-11-20T11:47:50.795 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.792+0000 7f3da7591700 1 -- 172.21.15.87:0/3576718948 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4668cfdf-d172-4f30-95b8-ac842108a520", "id": 3} v 0) v1 -- 0x7f3da00699a0 con 0x7f3da0060370 2020-11-20T11:47:50.799 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.796+0000 7f3d8d7fa700 1 -- 172.21.15.87:0/3576718948 <== mon.1 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4668cfdf-d172-4f30-95b8-ac842108a520", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3d90006b60 con 0x7f3da0060370 2020-11-20T11:47:50.800 INFO:teuthology.orchestra.run.smithi087.stdout:3 2020-11-20T11:47:50.801 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.797+0000 7f3da7591700 1 -- 172.21.15.87:0/3576718948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3da0060370 msgr2=0x7f3da00c12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:50.801 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.797+0000 7f3da7591700 1 --2- 172.21.15.87:0/3576718948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3da0060370 0x7f3da00c12a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f3d9000c760 tx=0x7f3d90007c90).stop 2020-11-20T11:47:50.801 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.797+0000 7f3da7591700 1 -- 172.21.15.87:0/3576718948 shutdown_connections 2020-11-20T11:47:50.801 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.797+0000 7f3da7591700 1 --2- 172.21.15.87:0/3576718948 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3da0154920 0x7f3da0067570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:50.802 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.797+0000 7f3da7591700 1 --2- 172.21.15.87:0/3576718948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3da0060370 0x7f3da00c12a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:50.802 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.797+0000 7f3da7591700 1 --2- 172.21.15.87:0/3576718948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3da0064c40 0x7f3da01644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:50.802 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.797+0000 7f3da7591700 1 -- 172.21.15.87:0/3576718948 >> 172.21.15.87:0/3576718948 conn(0x7f3da0062100 msgr2=0x7f3da00c40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:47:50.802 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.797+0000 7f3da7591700 1 -- 172.21.15.87:0/3576718948 shutdown_connections 2020-11-20T11:47:50.802 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.797+0000 7f3da7591700 1 -- 172.21.15.87:0/3576718948 wait complete. 2020-11-20T11:47:50.812 INFO:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new c4bc8ba5-0d22-49f5-97a6-2ca71e3a8c62 4 2020-11-20T11:47:50.930 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.927+0000 7f9a9a8bc700 1 Processor -- start 2020-11-20T11:47:50.934 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.927+0000 7f9a9a8bc700 1 -- start start 2020-11-20T11:47:50.938 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.928+0000 7f9a9a8bc700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a94151110 con 0x7f9a94060370 2020-11-20T11:47:50.939 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.928+0000 7f9a9a8bc700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a94065700 con 0x7f9a940652a0 2020-11-20T11:47:50.939 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.928+0000 7f9a9a8bc700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a94151340 con 0x7f9a94060750 2020-11-20T11:47:50.939 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.928+0000 7f9a998ba700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f9a94060370 0x7f9a94064b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:46490/0 (socket says 172.21.15.87:46490) 2020-11-20T11:47:50.939 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.928+0000 7f9a998ba700 1 -- 172.21.15.87:0/2572852466 learned_addr learned my addr 172.21.15.87:0/2572852466 (peer_addr_for_me v1:172.21.15.87:0/0) 2020-11-20T11:47:50.940 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.928+0000 7f9a988b8700 1 -- 172.21.15.87:0/2572852466 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4288152425 0 0) 0x7f9a94151110 con 0x7f9a94060370 2020-11-20T11:47:50.940 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.928+0000 7f9a988b8700 1 -- 172.21.15.87:0/2572852466 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a7c003280 con 0x7f9a94060370 2020-11-20T11:47:50.940 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.928+0000 7f9a988b8700 1 -- 172.21.15.87:0/2572852466 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2318140732 0 0) 0x7f9a94065700 con 0x7f9a940652a0 2020-11-20T11:47:50.940 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.928+0000 7f9a988b8700 1 -- 172.21.15.87:0/2572852466 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a94151110 con 0x7f9a940652a0 2020-11-20T11:47:50.940 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.928+0000 7f9a988b8700 1 -- 172.21.15.87:0/2572852466 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1169220912 0 0) 0x7f9a94151340 con 0x7f9a94060750 2020-11-20T11:47:50.941 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.928+0000 7f9a988b8700 1 -- 172.21.15.87:0/2572852466 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a94065700 con 0x7f9a94060750 2020-11-20T11:47:50.941 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.928+0000 7f9a988b8700 1 -- 172.21.15.87:0/2572852466 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3169995825 0 0) 0x7f9a7c003280 con 0x7f9a94060370 2020-11-20T11:47:50.941 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.928+0000 7f9a988b8700 1 -- 172.21.15.87:0/2572852466 >> v1:172.21.15.192:6789/0 conn(0x7f9a94060750 legacy=0x7f9a94061630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:50.941 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.928+0000 7f9a988b8700 1 -- 172.21.15.87:0/2572852466 >> v1:172.21.15.146:6789/0 conn(0x7f9a940652a0 legacy=0x7f9a9415bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:50.941 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.928+0000 7f9a988b8700 1 -- 172.21.15.87:0/2572852466 --> v1:172.21.15.87:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a941515e0 con 0x7f9a94060370 2020-11-20T11:47:50.942 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.929+0000 7f9a988b8700 1 -- 172.21.15.87:0/2572852466 <== mon.0 v1:172.21.15.87:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3985397220 0 0) 0x7f9a90001520 con 0x7f9a94060370 2020-11-20T11:47:50.942 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.929+0000 7f9a988b8700 1 -- 172.21.15.87:0/2572852466 >> v1:172.21.15.87:6789/0 conn(0x7f9a94060370 legacy=0x7f9a94064b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:50.942 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.929+0000 7f9a988b8700 1 --2- 172.21.15.87:0/2572852466 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a7c003af0 0x7f9a7c003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:50.942 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.929+0000 7f9a988b8700 1 --2- 172.21.15.87:0/2572852466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a7c004520 0x7f9a7c0049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:50.942 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.929+0000 7f9a988b8700 1 --2- 172.21.15.87:0/2572852466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a7c004f80 0x7f9a7c00b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:50.946 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.929+0000 7f9a988b8700 1 -- 172.21.15.87:0/2572852466 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c00bc60 con 0x7f9a7c004520 2020-11-20T11:47:50.947 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.929+0000 7f9a988b8700 1 -- 172.21.15.87:0/2572852466 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c00bdd0 con 0x7f9a7c003af0 2020-11-20T11:47:50.947 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.929+0000 7f9a988b8700 1 -- 172.21.15.87:0/2572852466 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c00bf90 con 0x7f9a7c004f80 2020-11-20T11:47:50.947 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.929+0000 7f9a990b9700 1 --2- 172.21.15.87:0/2572852466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a7c004520 0x7f9a7c0049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:50.947 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.929+0000 7f9a998ba700 1 --2- 172.21.15.87:0/2572852466 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a7c003af0 0x7f9a7c003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:50.947 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.929+0000 7f9a9a0bb700 1 --2- 172.21.15.87:0/2572852466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a7c004f80 0x7f9a7c00b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:50.948 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.929+0000 7f9a990b9700 1 -- 172.21.15.87:0/2572852466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a7c004f80 msgr2=0x7f9a7c00b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:47:50.949 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.929+0000 7f9a990b9700 1 --2- 172.21.15.87:0/2572852466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a7c004f80 0x7f9a7c00b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:50.949 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.929+0000 7f9a990b9700 1 -- 172.21.15.87:0/2572852466 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a7c003af0 msgr2=0x7f9a7c003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:47:50.949 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.929+0000 7f9a990b9700 1 --2- 172.21.15.87:0/2572852466 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a7c003af0 0x7f9a7c003ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:50.949 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.929+0000 7f9a990b9700 1 -- 172.21.15.87:0/2572852466 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a7c003280 con 0x7f9a7c004520 2020-11-20T11:47:50.949 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.929+0000 7f9a9a0bb700 1 --2- 172.21.15.87:0/2572852466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a7c004f80 0x7f9a7c00b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:47:50.950 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.929+0000 7f9a9a0bb700 1 -- 172.21.15.87:0/2572852466 reap_dead start 2020-11-20T11:47:50.950 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.929+0000 7f9a990b9700 1 --2- 172.21.15.87:0/2572852466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a7c004520 0x7f9a7c0049a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f9a84007c70 tx=0x7f9a84002c00).ready entity=mon.0 client_cookie=3fd7757f3568fa24 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:47:50.950 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.929+0000 7f9a988b8700 1 -- 172.21.15.87:0/2572852466 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8400c960 con 0x7f9a7c004520 2020-11-20T11:47:50.950 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.929+0000 7f9a988b8700 1 -- 172.21.15.87:0/2572852466 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8400cac0 con 0x7f9a7c004520 2020-11-20T11:47:50.950 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.929+0000 7f9a988b8700 1 -- 172.21.15.87:0/2572852466 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8400ce80 con 0x7f9a7c004520 2020-11-20T11:47:50.951 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.930+0000 7f9a9a8bc700 1 -- 172.21.15.87:0/2572852466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a7c004520 msgr2=0x7f9a7c0049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:50.952 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.930+0000 7f9a9a8bc700 1 --2- 172.21.15.87:0/2572852466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a7c004520 0x7f9a7c0049a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f9a84007c70 tx=0x7f9a84002c00).stop 2020-11-20T11:47:50.952 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.930+0000 7f9a9a8bc700 1 -- 172.21.15.87:0/2572852466 shutdown_connections 2020-11-20T11:47:50.952 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.930+0000 7f9a9a8bc700 1 --2- 172.21.15.87:0/2572852466 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a7c004520 0x7f9a7c0049a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:50.952 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.930+0000 7f9a9a8bc700 1 -- 172.21.15.87:0/2572852466 >> 172.21.15.87:0/2572852466 conn(0x7f9a940ba9a0 msgr2=0x7f9a940badb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:47:50.952 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.930+0000 7f9a9a8bc700 1 -- 172.21.15.87:0/2572852466 shutdown_connections 2020-11-20T11:47:50.953 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.930+0000 7f9a9a8bc700 1 -- 172.21.15.87:0/2572852466 wait complete. 2020-11-20T11:47:50.953 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.931+0000 7f9a9a8bc700 1 Processor -- start 2020-11-20T11:47:50.954 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.931+0000 7f9a9a8bc700 1 -- start start 2020-11-20T11:47:50.954 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.932+0000 7f9a9a8bc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a7c004520 0x7f9a94153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:50.954 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.932+0000 7f9a9a8bc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a940c2bd0 0x7f9a940c3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:50.954 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.932+0000 7f9a9a8bc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a940c3c00 0x7f9a941602e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:50.955 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.932+0000 7f9a9a8bc700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9415fc10 con 0x7f9a7c004520 2020-11-20T11:47:50.955 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.932+0000 7f9a9a8bc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a94163630 con 0x7f9a940c2bd0 2020-11-20T11:47:50.955 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.932+0000 7f9a9a8bc700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a941638d0 con 0x7f9a940c3c00 2020-11-20T11:47:50.955 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.932+0000 7f9a998ba700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a7c004520 0x7f9a94153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:50.955 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.932+0000 7f9a998ba700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a7c004520 0x7f9a94153a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42548/0 (socket says 172.21.15.87:42548) 2020-11-20T11:47:50.955 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.932+0000 7f9a998ba700 1 -- 172.21.15.87:0/2669276048 learned_addr learned my addr 172.21.15.87:0/2669276048 (peer_addr_for_me v2:172.21.15.87:0/0) 2020-11-20T11:47:50.956 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.932+0000 7f9a9a0bb700 1 --2- 172.21.15.87:0/2669276048 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a940c3c00 0x7f9a941602e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:50.956 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.932+0000 7f9a990b9700 1 --2- 172.21.15.87:0/2669276048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a940c2bd0 0x7f9a940c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:50.956 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.932+0000 7f9a998ba700 1 -- 172.21.15.87:0/2669276048 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a940c3c00 msgr2=0x7f9a941602e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:50.957 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.932+0000 7f9a998ba700 1 --2- 172.21.15.87:0/2669276048 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a940c3c00 0x7f9a941602e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:50.958 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.932+0000 7f9a998ba700 1 -- 172.21.15.87:0/2669276048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a940c2bd0 msgr2=0x7f9a940c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:50.958 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.932+0000 7f9a998ba700 1 --2- 172.21.15.87:0/2669276048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a940c2bd0 0x7f9a940c3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:50.959 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.932+0000 7f9a998ba700 1 -- 172.21.15.87:0/2669276048 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a94163b70 con 0x7f9a7c004520 2020-11-20T11:47:50.959 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.932+0000 7f9a990b9700 1 --2- 172.21.15.87:0/2669276048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a940c2bd0 0x7f9a940c3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:47:50.960 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.932+0000 7f9a998ba700 1 --2- 172.21.15.87:0/2669276048 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a7c004520 0x7f9a94153a80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f9a90004b50 tx=0x7f9a94151770).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:47:50.960 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.932+0000 7f9a81ffb700 1 -- 172.21.15.87:0/2669276048 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9000f9a0 con 0x7f9a7c004520 2020-11-20T11:47:50.960 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.932+0000 7f9a81ffb700 1 -- 172.21.15.87:0/2669276048 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9000fb00 con 0x7f9a7c004520 2020-11-20T11:47:50.961 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.932+0000 7f9a9a8bc700 1 -- 172.21.15.87:0/2669276048 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a94163e10 con 0x7f9a7c004520 2020-11-20T11:47:50.961 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.932+0000 7f9a81ffb700 1 -- 172.21.15.87:0/2669276048 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9000fe80 con 0x7f9a7c004520 2020-11-20T11:47:50.961 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.932+0000 7f9a81ffb700 1 -- 172.21.15.87:0/2669276048 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f9a9001b030 con 0x7f9a7c004520 2020-11-20T11:47:50.962 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.932+0000 7f9a9a8bc700 1 -- 172.21.15.87:0/2669276048 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a9414f830 con 0x7f9a7c004520 2020-11-20T11:47:50.963 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.933+0000 7f9a81ffb700 1 -- 172.21.15.87:0/2669276048 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7f9a900011a0 con 0x7f9a7c004520 2020-11-20T11:47:50.963 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.933+0000 7f9a9a8bc700 1 -- 172.21.15.87:0/2669276048 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a94160000 con 0x7f9a7c004520 2020-11-20T11:47:50.964 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:50.937+0000 7f9a81ffb700 1 -- 172.21.15.87:0/2669276048 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f9a90019070 con 0x7f9a7c004520 2020-11-20T11:47:51.017 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.014+0000 7f9a9a8bc700 1 -- 172.21.15.87:0/2669276048 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c4bc8ba5-0d22-49f5-97a6-2ca71e3a8c62", "id": 4} v 0) v1 -- 0x7f9a9405ca80 con 0x7f9a7c004520 2020-11-20T11:47:51.019 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.016+0000 7f9a81ffb700 1 -- 172.21.15.87:0/2669276048 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c4bc8ba5-0d22-49f5-97a6-2ca71e3a8c62", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9a900129f0 con 0x7f9a7c004520 2020-11-20T11:47:51.020 INFO:teuthology.orchestra.run.smithi087.stdout:4 2020-11-20T11:47:51.022 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.017+0000 7f9a9a8bc700 1 -- 172.21.15.87:0/2669276048 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a7c004520 msgr2=0x7f9a94153a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:51.023 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.017+0000 7f9a9a8bc700 1 --2- 172.21.15.87:0/2669276048 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a7c004520 0x7f9a94153a80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f9a90004b50 tx=0x7f9a94151770).stop 2020-11-20T11:47:51.023 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.017+0000 7f9a9a8bc700 1 -- 172.21.15.87:0/2669276048 shutdown_connections 2020-11-20T11:47:51.023 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.017+0000 7f9a9a8bc700 1 --2- 172.21.15.87:0/2669276048 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a940c3c00 0x7f9a941602e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:51.023 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.017+0000 7f9a9a8bc700 1 --2- 172.21.15.87:0/2669276048 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a7c004520 0x7f9a94153a80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:51.024 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.017+0000 7f9a9a8bc700 1 --2- 172.21.15.87:0/2669276048 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a940c2bd0 0x7f9a940c3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:51.024 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.017+0000 7f9a9a8bc700 1 -- 172.21.15.87:0/2669276048 >> 172.21.15.87:0/2669276048 conn(0x7f9a940ba9a0 msgr2=0x7f9a940bee90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:47:51.024 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.017+0000 7f9a9a8bc700 1 -- 172.21.15.87:0/2669276048 shutdown_connections 2020-11-20T11:47:51.024 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.017+0000 7f9a9a8bc700 1 -- 172.21.15.87:0/2669276048 wait complete. 2020-11-20T11:47:51.031 INFO:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new 2d15f1db-e580-4715-9728-8fe5dd7e34d2 5 2020-11-20T11:47:51.178 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.175+0000 7f7585d7e700 1 Processor -- start 2020-11-20T11:47:51.178 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.175+0000 7f7585d7e700 1 -- start start 2020-11-20T11:47:51.180 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.175+0000 7f7585d7e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7580065540 0x7f7580065920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:51.181 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.175+0000 7f7585d7e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f75800603b0 0x7f7580060810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:51.181 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.175+0000 7f7585d7e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75800bd950 con 0x7f7580060d00 2020-11-20T11:47:51.181 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.175+0000 7f7585d7e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75800bdbf0 con 0x7f7580065540 2020-11-20T11:47:51.181 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.175+0000 7f7585d7e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75800bde90 con 0x7f75800603b0 2020-11-20T11:47:51.181 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.176+0000 7f757f7fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7580065540 0x7f7580065920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:51.182 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.176+0000 7f757f7fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7580065540 0x7f7580065920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42554/0 (socket says 172.21.15.87:42554) 2020-11-20T11:47:51.182 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.176+0000 7f757f7fe700 1 -- 172.21.15.87:0/3850472081 learned_addr learned my addr 172.21.15.87:0/3850472081 (peer_addr_for_me v2:172.21.15.87:0/0) 2020-11-20T11:47:51.182 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.176+0000 7f757effd700 1 --2- 172.21.15.87:0/3850472081 >> v2:172.21.15.146:3300/0 conn(0x7f75800603b0 0x7f7580060810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:51.182 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.176+0000 7f757f7fe700 1 -- 172.21.15.87:0/3850472081 >> v2:172.21.15.146:3300/0 conn(0x7f75800603b0 msgr2=0x7f7580060810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:47:51.182 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.176+0000 7f757f7fe700 1 --2- 172.21.15.87:0/3850472081 >> v2:172.21.15.146:3300/0 conn(0x7f75800603b0 0x7f7580060810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:51.183 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.176+0000 7f757f7fe700 1 -- 172.21.15.87:0/3850472081 >> v1:172.21.15.146:6789/0 conn(0x7f7580060d00 legacy=0x7f7580062820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:51.183 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.176+0000 7f757f7fe700 1 -- 172.21.15.87:0/3850472081 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75800be130 con 0x7f7580065540 2020-11-20T11:47:51.183 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.176+0000 7f757f7fe700 1 --2- 172.21.15.87:0/3850472081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7580065540 0x7f7580065920 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f7580065e10 tx=0x7f7570006ef0).ready entity=mon.0 client_cookie=1da3b254559329fb server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:47:51.183 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.176+0000 7f757e7fc700 1 -- 172.21.15.87:0/3850472081 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757000b8f0 con 0x7f7580065540 2020-11-20T11:47:51.184 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.176+0000 7f757e7fc700 1 -- 172.21.15.87:0/3850472081 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7570000e90 con 0x7f7580065540 2020-11-20T11:47:51.184 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.176+0000 7f757e7fc700 1 -- 172.21.15.87:0/3850472081 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757000bc60 con 0x7f7580065540 2020-11-20T11:47:51.184 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.177+0000 7f7585d7e700 1 -- 172.21.15.87:0/3850472081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7580065540 msgr2=0x7f7580065920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:51.184 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.177+0000 7f7585d7e700 1 --2- 172.21.15.87:0/3850472081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7580065540 0x7f7580065920 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f7580065e10 tx=0x7f7570006ef0).stop 2020-11-20T11:47:51.184 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.177+0000 7f7585d7e700 1 -- 172.21.15.87:0/3850472081 shutdown_connections 2020-11-20T11:47:51.185 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.177+0000 7f7585d7e700 1 --2- 172.21.15.87:0/3850472081 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7580065540 0x7f7580065920 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:51.185 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.177+0000 7f7585d7e700 1 --2- 172.21.15.87:0/3850472081 >> v2:172.21.15.146:3300/0 conn(0x7f75800603b0 0x7f7580060810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:51.185 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.177+0000 7f7585d7e700 1 -- 172.21.15.87:0/3850472081 >> 172.21.15.87:0/3850472081 conn(0x7f75800c46a0 msgr2=0x7f75800c4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:47:51.185 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.177+0000 7f7585d7e700 1 -- 172.21.15.87:0/3850472081 shutdown_connections 2020-11-20T11:47:51.185 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.177+0000 7f7585d7e700 1 -- 172.21.15.87:0/3850472081 wait complete. 2020-11-20T11:47:51.186 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.178+0000 7f7585d7e700 1 Processor -- start 2020-11-20T11:47:51.187 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.178+0000 7f7585d7e700 1 -- start start 2020-11-20T11:47:51.187 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.179+0000 7f7585d7e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75800603b0 0x7f75801135f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:51.187 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.179+0000 7f7585d7e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7580060d00 0x7f75801646a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:51.187 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.179+0000 7f7585d7e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7580065540 0x7f75800c31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:51.187 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.179+0000 7f7585d7e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7580113f80 con 0x7f7580065540 2020-11-20T11:47:51.192 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.179+0000 7f7585d7e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7580113ae0 con 0x7f75800603b0 2020-11-20T11:47:51.192 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.179+0000 7f7585d7e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7580164b90 con 0x7f7580060d00 2020-11-20T11:47:51.192 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.179+0000 7f757ffff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7580065540 0x7f75800c31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:51.192 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.179+0000 7f757ffff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7580065540 0x7f75800c31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42564/0 (socket says 172.21.15.87:42564) 2020-11-20T11:47:51.193 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.179+0000 7f757ffff700 1 -- 172.21.15.87:0/1864692158 learned_addr learned my addr 172.21.15.87:0/1864692158 (peer_addr_for_me v2:172.21.15.87:0/0) 2020-11-20T11:47:51.193 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.179+0000 7f757f7fe700 1 --2- 172.21.15.87:0/1864692158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75800603b0 0x7f75801135f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:51.193 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.179+0000 7f757effd700 1 --2- 172.21.15.87:0/1864692158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7580060d00 0x7f75801646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:51.193 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.179+0000 7f757ffff700 1 -- 172.21.15.87:0/1864692158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7580060d00 msgr2=0x7f75801646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:51.194 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.179+0000 7f757ffff700 1 --2- 172.21.15.87:0/1864692158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7580060d00 0x7f75801646a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:51.194 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.179+0000 7f757ffff700 1 -- 172.21.15.87:0/1864692158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75800603b0 msgr2=0x7f75801135f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:51.194 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.179+0000 7f757ffff700 1 --2- 172.21.15.87:0/1864692158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75800603b0 0x7f75801135f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:51.194 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.179+0000 7f757ffff700 1 -- 172.21.15.87:0/1864692158 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7580113ce0 con 0x7f7580065540 2020-11-20T11:47:51.194 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.179+0000 7f757effd700 1 --2- 172.21.15.87:0/1864692158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7580060d00 0x7f75801646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:47:51.195 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.179+0000 7f757f7fe700 1 --2- 172.21.15.87:0/1864692158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75800603b0 0x7f75801135f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:47:51.195 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.179+0000 7f757ffff700 1 --2- 172.21.15.87:0/1864692158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7580065540 0x7f75800c31e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f757800ca90 tx=0x7f757800cda0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:47:51.195 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.179+0000 7f755f7fe700 1 -- 172.21.15.87:0/1864692158 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7578003120 con 0x7f7580065540 2020-11-20T11:47:51.195 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.180+0000 7f755f7fe700 1 -- 172.21.15.87:0/1864692158 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757800a870 con 0x7f7580065540 2020-11-20T11:47:51.195 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.180+0000 7f7585d7e700 1 -- 172.21.15.87:0/1864692158 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75800bc050 con 0x7f7580065540 2020-11-20T11:47:51.196 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.180+0000 7f755f7fe700 1 -- 172.21.15.87:0/1864692158 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757800abf0 con 0x7f7580065540 2020-11-20T11:47:51.196 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.180+0000 7f7585d7e700 1 -- 172.21.15.87:0/1864692158 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75800bc830 con 0x7f7580065540 2020-11-20T11:47:51.196 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.180+0000 7f755f7fe700 1 -- 172.21.15.87:0/1864692158 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f7578019030 con 0x7f7580065540 2020-11-20T11:47:51.196 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.180+0000 7f755f7fe700 1 -- 172.21.15.87:0/1864692158 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7f757801cd80 con 0x7f7580065540 2020-11-20T11:47:51.196 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.180+0000 7f7585d7e700 1 -- 172.21.15.87:0/1864692158 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75800699a0 con 0x7f7580065540 2020-11-20T11:47:51.196 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.182+0000 7f755f7fe700 1 -- 172.21.15.87:0/1864692158 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f7578021060 con 0x7f7580065540 2020-11-20T11:47:51.262 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.259+0000 7f7585d7e700 1 -- 172.21.15.87:0/1864692158 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2d15f1db-e580-4715-9728-8fe5dd7e34d2", "id": 5} v 0) v1 -- 0x7f75800bc9c0 con 0x7f7580065540 2020-11-20T11:47:51.266 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.263+0000 7f755f7fe700 1 -- 172.21.15.87:0/1864692158 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2d15f1db-e580-4715-9728-8fe5dd7e34d2", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7578017070 con 0x7f7580065540 2020-11-20T11:47:51.266 INFO:teuthology.orchestra.run.smithi087.stdout:5 2020-11-20T11:47:51.267 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.263+0000 7f7585d7e700 1 -- 172.21.15.87:0/1864692158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7580065540 msgr2=0x7f75800c31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:51.267 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.264+0000 7f7585d7e700 1 --2- 172.21.15.87:0/1864692158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7580065540 0x7f75800c31e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f757800ca90 tx=0x7f757800cda0).stop 2020-11-20T11:47:51.268 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.264+0000 7f7585d7e700 1 -- 172.21.15.87:0/1864692158 shutdown_connections 2020-11-20T11:47:51.268 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.264+0000 7f7585d7e700 1 --2- 172.21.15.87:0/1864692158 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7580065540 0x7f75800c31e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:51.268 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.264+0000 7f7585d7e700 1 --2- 172.21.15.87:0/1864692158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75800603b0 0x7f75801135f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:51.268 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.264+0000 7f7585d7e700 1 --2- 172.21.15.87:0/1864692158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7580060d00 0x7f75801646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:51.268 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.264+0000 7f7585d7e700 1 -- 172.21.15.87:0/1864692158 >> 172.21.15.87:0/1864692158 conn(0x7f75800c46a0 msgr2=0x7f75800c25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:47:51.269 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.264+0000 7f7585d7e700 1 -- 172.21.15.87:0/1864692158 shutdown_connections 2020-11-20T11:47:51.269 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.264+0000 7f7585d7e700 1 -- 172.21.15.87:0/1864692158 wait complete. 2020-11-20T11:47:51.278 INFO:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new a659da2b-bdce-42ac-8b30-b8c69b4c7041 6 2020-11-20T11:47:51.421 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.418+0000 7fd1712b4700 1 Processor -- start 2020-11-20T11:47:51.421 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.418+0000 7fd1712b4700 1 -- start start 2020-11-20T11:47:51.423 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.418+0000 7fd1712b4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd16c0652a0 0x7fd16c061d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:51.424 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.418+0000 7fd1712b4700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd16c151110 con 0x7fd16c060750 2020-11-20T11:47:51.424 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.418+0000 7fd1712b4700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd16c065700 con 0x7fd16c060370 2020-11-20T11:47:51.424 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.418+0000 7fd1712b4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd16c062230 con 0x7fd16c0652a0 2020-11-20T11:47:51.424 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.419+0000 7fd16b7fe700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fd16c060750 0x7fd16c061630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:46520/0 (socket says 172.21.15.87:46520) 2020-11-20T11:47:51.424 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.419+0000 7fd16b7fe700 1 -- 172.21.15.87:0/1755894121 learned_addr learned my addr 172.21.15.87:0/1755894121 (peer_addr_for_me v1:172.21.15.87:0/0) 2020-11-20T11:47:51.425 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.419+0000 7fd170ab3700 1 --2- 172.21.15.87:0/1755894121 >> v2:172.21.15.146:3300/0 conn(0x7fd16c0652a0 0x7fd16c061d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:51.425 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.419+0000 7fd16affd700 1 -- 172.21.15.87:0/1755894121 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1653778624 0 0) 0x7fd16c151110 con 0x7fd16c060750 2020-11-20T11:47:51.425 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.419+0000 7fd16affd700 1 -- 172.21.15.87:0/1755894121 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd158003280 con 0x7fd16c060750 2020-11-20T11:47:51.425 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.419+0000 7fd16affd700 1 -- 172.21.15.87:0/1755894121 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3944348017 0 0) 0x7fd16c065700 con 0x7fd16c060370 2020-11-20T11:47:51.426 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.419+0000 7fd16affd700 1 -- 172.21.15.87:0/1755894121 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd16c151110 con 0x7fd16c060370 2020-11-20T11:47:51.426 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.419+0000 7fd170ab3700 1 -- 172.21.15.87:0/1755894121 >> v1:172.21.15.146:6789/0 conn(0x7fd16c060370 legacy=0x7fd16c064b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:51.426 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.419+0000 7fd170ab3700 1 -- 172.21.15.87:0/1755894121 >> v1:172.21.15.87:6789/0 conn(0x7fd16c060750 legacy=0x7fd16c061630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:51.426 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.419+0000 7fd170ab3700 1 -- 172.21.15.87:0/1755894121 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd16c151340 con 0x7fd16c0652a0 2020-11-20T11:47:51.427 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.419+0000 7fd170ab3700 1 --2- 172.21.15.87:0/1755894121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd16c0652a0 0x7fd16c061d40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fd164009ce0 tx=0x7fd164009220).ready entity=mon.1 client_cookie=bee301a8d77ac6d8 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:47:51.427 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.419+0000 7fd16affd700 1 -- 172.21.15.87:0/1755894121 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16400ba20 con 0x7fd16c0652a0 2020-11-20T11:47:51.427 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.419+0000 7fd16affd700 1 -- 172.21.15.87:0/1755894121 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd16400bb80 con 0x7fd16c0652a0 2020-11-20T11:47:51.427 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.419+0000 7fd16affd700 1 -- 172.21.15.87:0/1755894121 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd164011400 con 0x7fd16c0652a0 2020-11-20T11:47:51.427 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.420+0000 7fd1712b4700 1 -- 172.21.15.87:0/1755894121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd16c0652a0 msgr2=0x7fd16c061d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:51.428 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.420+0000 7fd1712b4700 1 --2- 172.21.15.87:0/1755894121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd16c0652a0 0x7fd16c061d40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fd164009ce0 tx=0x7fd164009220).stop 2020-11-20T11:47:51.428 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.420+0000 7fd1712b4700 1 -- 172.21.15.87:0/1755894121 shutdown_connections 2020-11-20T11:47:51.428 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.420+0000 7fd1712b4700 1 --2- 172.21.15.87:0/1755894121 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd16c0652a0 0x7fd16c061d40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:51.430 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.420+0000 7fd1712b4700 1 -- 172.21.15.87:0/1755894121 >> 172.21.15.87:0/1755894121 conn(0x7fd16c0ba9a0 msgr2=0x7fd16c0badb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:47:51.430 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.420+0000 7fd1712b4700 1 -- 172.21.15.87:0/1755894121 shutdown_connections 2020-11-20T11:47:51.430 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.420+0000 7fd1712b4700 1 -- 172.21.15.87:0/1755894121 wait complete. 2020-11-20T11:47:51.430 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.421+0000 7fd1712b4700 1 Processor -- start 2020-11-20T11:47:51.430 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.421+0000 7fd1712b4700 1 -- start start 2020-11-20T11:47:51.431 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.422+0000 7fd1712b4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd16c060370 0x7fd16c113080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:51.431 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.422+0000 7fd1712b4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd16c060750 0x7fd16c160d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:51.431 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.422+0000 7fd1712b4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd16c0652a0 0x7fd16c0c13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:51.431 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.422+0000 7fd1712b4700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c113570 con 0x7fd16c0652a0 2020-11-20T11:47:51.431 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.422+0000 7fd1712b4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c0bc040 con 0x7fd16c060370 2020-11-20T11:47:51.432 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.422+0000 7fd1712b4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c161230 con 0x7fd16c060750 2020-11-20T11:47:51.432 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.422+0000 7fd170ab3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd16c0652a0 0x7fd16c0c13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:51.434 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.422+0000 7fd170ab3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd16c0652a0 0x7fd16c0c13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42576/0 (socket says 172.21.15.87:42576) 2020-11-20T11:47:51.434 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.422+0000 7fd170ab3700 1 -- 172.21.15.87:0/1657328445 learned_addr learned my addr 172.21.15.87:0/1657328445 (peer_addr_for_me v2:172.21.15.87:0/0) 2020-11-20T11:47:51.434 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.422+0000 7fd16bfff700 1 --2- 172.21.15.87:0/1657328445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd16c060370 0x7fd16c113080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:51.435 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.422+0000 7fd16b7fe700 1 --2- 172.21.15.87:0/1657328445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd16c060750 0x7fd16c160d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:51.435 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.422+0000 7fd170ab3700 1 -- 172.21.15.87:0/1657328445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd16c060750 msgr2=0x7fd16c160d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:51.435 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.422+0000 7fd170ab3700 1 --2- 172.21.15.87:0/1657328445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd16c060750 0x7fd16c160d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:51.435 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.422+0000 7fd170ab3700 1 -- 172.21.15.87:0/1657328445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd16c060370 msgr2=0x7fd16c113080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:51.435 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.422+0000 7fd170ab3700 1 --2- 172.21.15.87:0/1657328445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd16c060370 0x7fd16c113080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:51.436 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.422+0000 7fd170ab3700 1 -- 172.21.15.87:0/1657328445 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd16c0bc270 con 0x7fd16c0652a0 2020-11-20T11:47:51.436 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.422+0000 7fd16bfff700 1 --2- 172.21.15.87:0/1657328445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd16c060370 0x7fd16c113080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:47:51.436 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.423+0000 7fd170ab3700 1 --2- 172.21.15.87:0/1657328445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd16c0652a0 0x7fd16c0c13d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fd16c067420 tx=0x7fd164016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:47:51.436 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.423+0000 7fd14bfff700 1 -- 172.21.15.87:0/1657328445 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16400ba20 con 0x7fd16c0652a0 2020-11-20T11:47:51.436 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.423+0000 7fd14bfff700 1 -- 172.21.15.87:0/1657328445 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd164010a50 con 0x7fd16c0652a0 2020-11-20T11:47:51.437 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.423+0000 7fd14bfff700 1 -- 172.21.15.87:0/1657328445 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd164010dd0 con 0x7fd16c0652a0 2020-11-20T11:47:51.437 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.423+0000 7fd1712b4700 1 -- 172.21.15.87:0/1657328445 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd16c0bc510 con 0x7fd16c0652a0 2020-11-20T11:47:51.437 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.423+0000 7fd1712b4700 1 -- 172.21.15.87:0/1657328445 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd16c0bca50 con 0x7fd16c0652a0 2020-11-20T11:47:51.437 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.423+0000 7fd14bfff700 1 -- 172.21.15.87:0/1657328445 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fd164017070 con 0x7fd16c0652a0 2020-11-20T11:47:51.437 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.423+0000 7fd14bfff700 1 -- 172.21.15.87:0/1657328445 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7fd164027a80 con 0x7fd16c0652a0 2020-11-20T11:47:51.438 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.424+0000 7fd1712b4700 1 -- 172.21.15.87:0/1657328445 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd16c151fa0 con 0x7fd16c0652a0 2020-11-20T11:47:51.438 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.426+0000 7fd14bfff700 1 -- 172.21.15.87:0/1657328445 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7fd164015020 con 0x7fd16c0652a0 2020-11-20T11:47:51.507 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.504+0000 7fd1712b4700 1 -- 172.21.15.87:0/1657328445 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a659da2b-bdce-42ac-8b30-b8c69b4c7041", "id": 6} v 0) v1 -- 0x7fd16c05ca80 con 0x7fd16c0652a0 2020-11-20T11:47:51.509 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.506+0000 7fd14bfff700 1 -- 172.21.15.87:0/1657328445 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a659da2b-bdce-42ac-8b30-b8c69b4c7041", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd164027d20 con 0x7fd16c0652a0 2020-11-20T11:47:51.510 INFO:teuthology.orchestra.run.smithi087.stdout:6 2020-11-20T11:47:51.511 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.507+0000 7fd1712b4700 1 -- 172.21.15.87:0/1657328445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd16c0652a0 msgr2=0x7fd16c0c13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:51.511 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.507+0000 7fd1712b4700 1 --2- 172.21.15.87:0/1657328445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd16c0652a0 0x7fd16c0c13d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fd16c067420 tx=0x7fd164016000).stop 2020-11-20T11:47:51.511 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.507+0000 7fd1712b4700 1 -- 172.21.15.87:0/1657328445 shutdown_connections 2020-11-20T11:47:51.511 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.507+0000 7fd1712b4700 1 --2- 172.21.15.87:0/1657328445 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd16c0652a0 0x7fd16c0c13d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:51.512 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.507+0000 7fd1712b4700 1 --2- 172.21.15.87:0/1657328445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd16c060370 0x7fd16c113080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:51.512 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.507+0000 7fd1712b4700 1 --2- 172.21.15.87:0/1657328445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd16c060750 0x7fd16c160d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:51.512 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.507+0000 7fd1712b4700 1 -- 172.21.15.87:0/1657328445 >> 172.21.15.87:0/1657328445 conn(0x7fd16c0ba9a0 msgr2=0x7fd16c0bb630 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:47:51.512 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.507+0000 7fd1712b4700 1 -- 172.21.15.87:0/1657328445 shutdown_connections 2020-11-20T11:47:51.512 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.507+0000 7fd1712b4700 1 -- 172.21.15.87:0/1657328445 wait complete. 2020-11-20T11:47:51.522 INFO:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new d6e41ac5-bab7-49e2-a17a-ef794bcc4a09 7 2020-11-20T11:47:51.645 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.642+0000 7f63a5152700 1 Processor -- start 2020-11-20T11:47:51.646 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.642+0000 7f63a5152700 1 -- start start 2020-11-20T11:47:51.650 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.642+0000 7f63a5152700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f63a01525e0 0x7f63a00bdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:51.650 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.642+0000 7f63a5152700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63a0066e70 con 0x7f63a00bdad0 2020-11-20T11:47:51.650 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.642+0000 7f63a5152700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63a0067110 con 0x7f63a014fbe0 2020-11-20T11:47:51.651 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.642+0000 7f63a5152700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63a00becb0 con 0x7f63a01525e0 2020-11-20T11:47:51.651 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.643+0000 7f639e59c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f63a01525e0 0x7f63a00bdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:51.651 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.643+0000 7f639ed9d700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f63a00bdad0 0x7f63a00be5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:46532/0 (socket says 172.21.15.87:46532) 2020-11-20T11:47:51.651 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.643+0000 7f639ed9d700 1 -- 172.21.15.87:0/2655118812 learned_addr learned my addr 172.21.15.87:0/2655118812 (peer_addr_for_me v1:172.21.15.87:0/0) 2020-11-20T11:47:51.651 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.643+0000 7f639e59c700 1 -- 172.21.15.87:0/2655118812 >> v1:172.21.15.192:6789/0 conn(0x7f63a014fbe0 legacy=0x7f63a0066420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:51.652 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.643+0000 7f639e59c700 1 -- 172.21.15.87:0/2655118812 >> v1:172.21.15.87:6789/0 conn(0x7f63a00bdad0 legacy=0x7f63a00be5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:51.652 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.643+0000 7f639dd9b700 1 -- 172.21.15.87:0/2655118812 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2183702468 0 0) 0x7f63a0066e70 con 0x7f63a00bdad0 2020-11-20T11:47:51.652 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.643+0000 7f639e59c700 1 -- 172.21.15.87:0/2655118812 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a014f200 con 0x7f63a01525e0 2020-11-20T11:47:51.652 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.643+0000 7f639e59c700 1 --2- 172.21.15.87:0/2655118812 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63a01525e0 0x7f63a00bdeb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f6390006fd0 tx=0x7f6390006e30).ready entity=mon.0 client_cookie=83d914cc3266b9c1 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:47:51.652 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.643+0000 7f639dd9b700 1 -- 172.21.15.87:0/2655118812 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6390009870 con 0x7f63a01525e0 2020-11-20T11:47:51.653 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.643+0000 7f639dd9b700 1 -- 172.21.15.87:0/2655118812 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6390000e90 con 0x7f63a01525e0 2020-11-20T11:47:51.653 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.643+0000 7f639dd9b700 1 -- 172.21.15.87:0/2655118812 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6390009be0 con 0x7f63a01525e0 2020-11-20T11:47:51.653 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.643+0000 7f63a5152700 1 -- 172.21.15.87:0/2655118812 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63a01525e0 msgr2=0x7f63a00bdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:51.653 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.643+0000 7f63a5152700 1 --2- 172.21.15.87:0/2655118812 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63a01525e0 0x7f63a00bdeb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f6390006fd0 tx=0x7f6390006e30).stop 2020-11-20T11:47:51.653 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.643+0000 7f63a5152700 1 -- 172.21.15.87:0/2655118812 shutdown_connections 2020-11-20T11:47:51.654 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.643+0000 7f63a5152700 1 --2- 172.21.15.87:0/2655118812 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63a01525e0 0x7f63a00bdeb0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:51.654 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.643+0000 7f63a5152700 1 -- 172.21.15.87:0/2655118812 >> 172.21.15.87:0/2655118812 conn(0x7f63a00601b0 msgr2=0x7f63a00605c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:47:51.654 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.644+0000 7f63a5152700 1 -- 172.21.15.87:0/2655118812 shutdown_connections 2020-11-20T11:47:51.654 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.644+0000 7f63a5152700 1 -- 172.21.15.87:0/2655118812 wait complete. 2020-11-20T11:47:51.655 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.645+0000 7f63a5152700 1 Processor -- start 2020-11-20T11:47:51.655 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.645+0000 7f63a5152700 1 -- start start 2020-11-20T11:47:51.655 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.645+0000 7f63a5152700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63a00bdad0 0x7f63a015e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:51.655 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.645+0000 7f63a5152700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63a014fbe0 0x7f63a014b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:51.657 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.645+0000 7f63a5152700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63a01525e0 0x7f63a00c0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:51.658 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.645+0000 7f63a5152700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a00c2b70 con 0x7f63a00bdad0 2020-11-20T11:47:51.658 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.645+0000 7f63a5152700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a00c19b0 con 0x7f63a01525e0 2020-11-20T11:47:51.659 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.645+0000 7f63a5152700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a00c1c50 con 0x7f63a014fbe0 2020-11-20T11:47:51.659 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.646+0000 7f639ed9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63a00bdad0 0x7f63a015e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:51.659 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.646+0000 7f639ed9d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63a00bdad0 0x7f63a015e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42584/0 (socket says 172.21.15.87:42584) 2020-11-20T11:47:51.659 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.646+0000 7f639ed9d700 1 -- 172.21.15.87:0/3927488491 learned_addr learned my addr 172.21.15.87:0/3927488491 (peer_addr_for_me v2:172.21.15.87:0/0) 2020-11-20T11:47:51.659 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.646+0000 7f639e59c700 1 --2- 172.21.15.87:0/3927488491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63a014fbe0 0x7f63a014b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:51.660 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.646+0000 7f639f59e700 1 --2- 172.21.15.87:0/3927488491 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63a01525e0 0x7f63a00c0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:51.660 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.646+0000 7f639ed9d700 1 -- 172.21.15.87:0/3927488491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63a014fbe0 msgr2=0x7f63a014b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:51.660 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.646+0000 7f639ed9d700 1 --2- 172.21.15.87:0/3927488491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63a014fbe0 0x7f63a014b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:51.660 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.646+0000 7f639ed9d700 1 -- 172.21.15.87:0/3927488491 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63a01525e0 msgr2=0x7f63a00c0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:51.660 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.646+0000 7f639ed9d700 1 --2- 172.21.15.87:0/3927488491 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63a01525e0 0x7f63a00c0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:51.661 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.646+0000 7f639ed9d700 1 -- 172.21.15.87:0/3927488491 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a00c1ef0 con 0x7f63a00bdad0 2020-11-20T11:47:51.661 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.646+0000 7f639f59e700 1 --2- 172.21.15.87:0/3927488491 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63a01525e0 0x7f63a00c0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:47:51.661 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.646+0000 7f639ed9d700 1 --2- 172.21.15.87:0/3927488491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63a00bdad0 0x7f63a015e360 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f638800c760 tx=0x7f63880018a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:47:51.661 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.646+0000 7f6396ffd700 1 -- 172.21.15.87:0/3927488491 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63880072e0 con 0x7f63a00bdad0 2020-11-20T11:47:51.661 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.646+0000 7f6396ffd700 1 -- 172.21.15.87:0/3927488491 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6388005500 con 0x7f63a00bdad0 2020-11-20T11:47:51.662 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.646+0000 7f63a5152700 1 -- 172.21.15.87:0/3927488491 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63a00c2190 con 0x7f63a00bdad0 2020-11-20T11:47:51.662 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.646+0000 7f6396ffd700 1 -- 172.21.15.87:0/3927488491 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6388005880 con 0x7f63a00bdad0 2020-11-20T11:47:51.662 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.646+0000 7f63a5152700 1 -- 172.21.15.87:0/3927488491 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a00c26d0 con 0x7f63a00bdad0 2020-11-20T11:47:51.662 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.646+0000 7f6396ffd700 1 -- 172.21.15.87:0/3927488491 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f6388010070 con 0x7f63a00bdad0 2020-11-20T11:47:51.663 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.646+0000 7f6396ffd700 1 -- 172.21.15.87:0/3927488491 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7f6388013e00 con 0x7f63a00bdad0 2020-11-20T11:47:51.663 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.647+0000 7f63a5152700 1 -- 172.21.15.87:0/3927488491 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63a005ca80 con 0x7f63a00bdad0 2020-11-20T11:47:51.664 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.651+0000 7f6396ffd700 1 -- 172.21.15.87:0/3927488491 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f6388013770 con 0x7f63a00bdad0 2020-11-20T11:47:51.732 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.728+0000 7f63a5152700 1 -- 172.21.15.87:0/3927488491 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d6e41ac5-bab7-49e2-a17a-ef794bcc4a09", "id": 7} v 0) v1 -- 0x7f63a005c2e0 con 0x7f63a00bdad0 2020-11-20T11:47:51.738 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.732+0000 7f6396ffd700 1 -- 172.21.15.87:0/3927488491 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d6e41ac5-bab7-49e2-a17a-ef794bcc4a09", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6388013910 con 0x7f63a00bdad0 2020-11-20T11:47:51.739 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.732+0000 7f63a5152700 1 -- 172.21.15.87:0/3927488491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63a00bdad0 msgr2=0x7f63a015e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:51.739 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.732+0000 7f63a5152700 1 --2- 172.21.15.87:0/3927488491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63a00bdad0 0x7f63a015e360 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f638800c760 tx=0x7f63880018a0).stop 2020-11-20T11:47:51.740 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.733+0000 7f63a5152700 1 -- 172.21.15.87:0/3927488491 shutdown_connections 2020-11-20T11:47:51.741 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.733+0000 7f63a5152700 1 --2- 172.21.15.87:0/3927488491 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63a01525e0 0x7f63a00c0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:51.742 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.733+0000 7f63a5152700 1 --2- 172.21.15.87:0/3927488491 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f63a00bdad0 0x7f63a015e360 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:51.742 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.733+0000 7f63a5152700 1 --2- 172.21.15.87:0/3927488491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f63a014fbe0 0x7f63a014b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:51.742 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.733+0000 7f63a5152700 1 -- 172.21.15.87:0/3927488491 >> 172.21.15.87:0/3927488491 conn(0x7f63a00601b0 msgr2=0x7f63a0152a80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:47:51.743 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.733+0000 7f63a5152700 1 -- 172.21.15.87:0/3927488491 shutdown_connections 2020-11-20T11:47:51.743 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.733+0000 7f63a5152700 1 -- 172.21.15.87:0/3927488491 wait complete. 2020-11-20T11:47:51.743 INFO:teuthology.orchestra.run.smithi087.stdout:7 2020-11-20T11:47:51.747 INFO:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new c4907993-7513-4162-974f-07dcb0a260a7 8 2020-11-20T11:47:51.865 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.862+0000 7f60b4760700 1 Processor -- start 2020-11-20T11:47:51.866 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.862+0000 7f60b4760700 1 -- start start 2020-11-20T11:47:51.868 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.863+0000 7f60b4760700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f60ac062be0 0x7f60ac0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:51.868 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.863+0000 7f60b4760700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f60ac14dfb0 0x7f60ac14e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:51.868 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.863+0000 7f60b4760700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60ac0be960 con 0x7f60ac062800 2020-11-20T11:47:51.869 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.863+0000 7f60b4760700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60ac0bec00 con 0x7f60ac14dfb0 2020-11-20T11:47:51.869 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.863+0000 7f60b4760700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60ac0beea0 con 0x7f60ac062be0 2020-11-20T11:47:51.869 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.863+0000 7f60b2cfd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f60ac14dfb0 0x7f60ac14e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:51.869 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.863+0000 7f60b24fc700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f60ac062800 0x7f60ac0639e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:46544/0 (socket says 172.21.15.87:46544) 2020-11-20T11:47:51.869 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.863+0000 7f60b24fc700 1 -- 172.21.15.87:0/1016650030 learned_addr learned my addr 172.21.15.87:0/1016650030 (peer_addr_for_me v1:172.21.15.87:0/0) 2020-11-20T11:47:51.870 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.863+0000 7f60b1cfb700 1 --2- 172.21.15.87:0/1016650030 >> v2:172.21.15.192:3300/0 conn(0x7f60ac062be0 0x7f60ac0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:51.870 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.864+0000 7f60b2cfd700 1 -- 172.21.15.87:0/1016650030 >> v2:172.21.15.192:3300/0 conn(0x7f60ac062be0 msgr2=0x7f60ac0640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:47:51.870 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.864+0000 7f60b2cfd700 1 --2- 172.21.15.87:0/1016650030 >> v2:172.21.15.192:3300/0 conn(0x7f60ac062be0 0x7f60ac0640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:51.870 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.864+0000 7f60b2cfd700 1 -- 172.21.15.87:0/1016650030 >> v1:172.21.15.87:6789/0 conn(0x7f60ac062800 legacy=0x7f60ac0639e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:51.870 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.864+0000 7f60b2cfd700 1 -- 172.21.15.87:0/1016650030 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ac0bf140 con 0x7f60ac14dfb0 2020-11-20T11:47:51.871 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.864+0000 7f60b14fa700 1 -- 172.21.15.87:0/1016650030 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3547670405 0 0) 0x7f60ac0be960 con 0x7f60ac062800 2020-11-20T11:47:51.871 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.864+0000 7f60b2cfd700 1 --2- 172.21.15.87:0/1016650030 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60ac14dfb0 0x7f60ac14e440 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f60ac060ce0 tx=0x7f60a4009220).ready entity=mon.0 client_cookie=b6a7ea03b94c79b5 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:47:51.871 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.864+0000 7f60b14fa700 1 -- 172.21.15.87:0/1016650030 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a400ba00 con 0x7f60ac14dfb0 2020-11-20T11:47:51.871 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.864+0000 7f60b14fa700 1 -- 172.21.15.87:0/1016650030 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a400bb60 con 0x7f60ac14dfb0 2020-11-20T11:47:51.871 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.864+0000 7f60b14fa700 1 -- 172.21.15.87:0/1016650030 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a4011400 con 0x7f60ac14dfb0 2020-11-20T11:47:51.872 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.865+0000 7f60b4760700 1 -- 172.21.15.87:0/1016650030 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60ac14dfb0 msgr2=0x7f60ac14e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:51.872 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.865+0000 7f60b4760700 1 --2- 172.21.15.87:0/1016650030 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60ac14dfb0 0x7f60ac14e440 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f60ac060ce0 tx=0x7f60a4009220).stop 2020-11-20T11:47:51.872 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.865+0000 7f60b4760700 1 -- 172.21.15.87:0/1016650030 shutdown_connections 2020-11-20T11:47:51.872 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.865+0000 7f60b4760700 1 --2- 172.21.15.87:0/1016650030 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60ac14dfb0 0x7f60ac14e440 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:51.872 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.865+0000 7f60b4760700 1 --2- 172.21.15.87:0/1016650030 >> v2:172.21.15.192:3300/0 conn(0x7f60ac062be0 0x7f60ac0640f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:51.873 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.865+0000 7f60b4760700 1 -- 172.21.15.87:0/1016650030 >> 172.21.15.87:0/1016650030 conn(0x7f60ac0c4910 msgr2=0x7f60ac0c08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:47:51.873 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.865+0000 7f60b4760700 1 -- 172.21.15.87:0/1016650030 shutdown_connections 2020-11-20T11:47:51.873 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.865+0000 7f60b4760700 1 -- 172.21.15.87:0/1016650030 wait complete. 2020-11-20T11:47:51.875 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.866+0000 7f60b4760700 1 Processor -- start 2020-11-20T11:47:51.875 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.866+0000 7f60b4760700 1 -- start start 2020-11-20T11:47:51.876 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.867+0000 7f60b4760700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60ac062800 0x7f60ac160b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:51.876 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.867+0000 7f60b4760700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60ac062be0 0x7f60ac115aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:51.876 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.867+0000 7f60b4760700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60ac14dfb0 0x7f60ac064460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:51.876 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.867+0000 7f60b4760700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac161020 con 0x7f60ac14dfb0 2020-11-20T11:47:51.876 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.867+0000 7f60b4760700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac1637c0 con 0x7f60ac062800 2020-11-20T11:47:51.877 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.867+0000 7f60b4760700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac163a60 con 0x7f60ac062be0 2020-11-20T11:47:51.877 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.867+0000 7f60b2cfd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60ac14dfb0 0x7f60ac064460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:51.877 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.867+0000 7f60b1cfb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60ac062be0 0x7f60ac115aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:51.877 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.867+0000 7f60b2cfd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60ac14dfb0 0x7f60ac064460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42600/0 (socket says 172.21.15.87:42600) 2020-11-20T11:47:51.878 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.867+0000 7f60b2cfd700 1 -- 172.21.15.87:0/4126791355 learned_addr learned my addr 172.21.15.87:0/4126791355 (peer_addr_for_me v2:172.21.15.87:0/0) 2020-11-20T11:47:51.878 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.867+0000 7f60b24fc700 1 --2- 172.21.15.87:0/4126791355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60ac062800 0x7f60ac160b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:51.878 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.867+0000 7f60b1cfb700 1 -- 172.21.15.87:0/4126791355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60ac062800 msgr2=0x7f60ac160b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:51.878 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.867+0000 7f60b1cfb700 1 --2- 172.21.15.87:0/4126791355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60ac062800 0x7f60ac160b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:51.878 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.867+0000 7f60b1cfb700 1 -- 172.21.15.87:0/4126791355 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60ac14dfb0 msgr2=0x7f60ac064460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:51.879 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.867+0000 7f60b1cfb700 1 --2- 172.21.15.87:0/4126791355 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60ac14dfb0 0x7f60ac064460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:51.879 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.867+0000 7f60b1cfb700 1 -- 172.21.15.87:0/4126791355 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ac163d00 con 0x7f60ac062be0 2020-11-20T11:47:51.879 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.867+0000 7f60b2cfd700 1 --2- 172.21.15.87:0/4126791355 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60ac14dfb0 0x7f60ac064460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:47:51.879 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.867+0000 7f60b1cfb700 1 --2- 172.21.15.87:0/4126791355 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60ac062be0 0x7f60ac115aa0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f60a800eba0 tx=0x7f60a8006e30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:47:51.879 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.867+0000 7f609a7fc700 1 -- 172.21.15.87:0/4126791355 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a800eeb0 con 0x7f60ac062be0 2020-11-20T11:47:51.879 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.867+0000 7f609a7fc700 1 -- 172.21.15.87:0/4126791355 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a800c850 con 0x7f60ac062be0 2020-11-20T11:47:51.880 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.867+0000 7f60b4760700 1 -- 172.21.15.87:0/4126791355 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60ac163fa0 con 0x7f60ac062be0 2020-11-20T11:47:51.880 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.867+0000 7f609a7fc700 1 -- 172.21.15.87:0/4126791355 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a800cbd0 con 0x7f60ac062be0 2020-11-20T11:47:51.880 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.867+0000 7f60b4760700 1 -- 172.21.15.87:0/4126791355 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60ac112de0 con 0x7f60ac062be0 2020-11-20T11:47:51.880 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.868+0000 7f609a7fc700 1 -- 172.21.15.87:0/4126791355 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f60a801c6c0 con 0x7f60ac062be0 2020-11-20T11:47:51.880 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.868+0000 7f609a7fc700 1 -- 172.21.15.87:0/4126791355 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7f60a8012af0 con 0x7f60ac062be0 2020-11-20T11:47:51.881 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.868+0000 7f60b4760700 1 -- 172.21.15.87:0/4126791355 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60ac164400 con 0x7f60ac062be0 2020-11-20T11:47:51.881 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.872+0000 7f609a7fc700 1 -- 172.21.15.87:0/4126791355 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f60a8012dd0 con 0x7f60ac062be0 2020-11-20T11:47:51.952 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.949+0000 7f60b4760700 1 -- 172.21.15.87:0/4126791355 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c4907993-7513-4162-974f-07dcb0a260a7", "id": 8} v 0) v1 -- 0x7f60ac05ca80 con 0x7f60ac062be0 2020-11-20T11:47:51.963 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.953+0000 7f609a7fc700 1 -- 172.21.15.87:0/4126791355 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c4907993-7513-4162-974f-07dcb0a260a7", "id": 8}]=0 v11) v1 ==== 112+0+2 (secure 0 0 0) 0x7f60a802b0b0 con 0x7f60ac062be0 2020-11-20T11:47:51.964 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.954+0000 7f60b4760700 1 -- 172.21.15.87:0/4126791355 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60ac062be0 msgr2=0x7f60ac115aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:51.964 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.954+0000 7f60b4760700 1 --2- 172.21.15.87:0/4126791355 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60ac062be0 0x7f60ac115aa0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f60a800eba0 tx=0x7f60a8006e30).stop 2020-11-20T11:47:51.964 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.954+0000 7f60b4760700 1 -- 172.21.15.87:0/4126791355 shutdown_connections 2020-11-20T11:47:51.964 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.954+0000 7f60b4760700 1 --2- 172.21.15.87:0/4126791355 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f60ac14dfb0 0x7f60ac064460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:51.965 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.954+0000 7f60b4760700 1 --2- 172.21.15.87:0/4126791355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60ac062800 0x7f60ac160b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:51.965 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.954+0000 7f60b4760700 1 --2- 172.21.15.87:0/4126791355 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60ac062be0 0x7f60ac115aa0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:51.965 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.954+0000 7f60b4760700 1 -- 172.21.15.87:0/4126791355 >> 172.21.15.87:0/4126791355 conn(0x7f60ac0c4910 msgr2=0x7f60ac0c2050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:47:51.965 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.954+0000 7f60b4760700 1 -- 172.21.15.87:0/4126791355 shutdown_connections 2020-11-20T11:47:51.965 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:51.954+0000 7f60b4760700 1 -- 172.21.15.87:0/4126791355 wait complete. 2020-11-20T11:47:51.966 INFO:teuthology.orchestra.run.smithi087.stdout:8 2020-11-20T11:47:51.968 INFO:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new 3523676f-c9b8-47ae-86c0-4930dca17831 9 2020-11-20T11:47:52.086 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.082+0000 7fcb79902700 1 Processor -- start 2020-11-20T11:47:52.086 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.082+0000 7fcb79902700 1 -- start start 2020-11-20T11:47:52.088 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.083+0000 7fcb79902700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcb740bfcb0 0x7fcb7414e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:52.088 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.083+0000 7fcb79902700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb740bc640 con 0x7fcb74062be0 2020-11-20T11:47:52.088 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.083+0000 7fcb79902700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb7414ec10 con 0x7fcb74062800 2020-11-20T11:47:52.089 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.083+0000 7fcb79902700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb7414b950 con 0x7fcb740bfcb0 2020-11-20T11:47:52.089 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.083+0000 7fcb6bfff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcb740bfcb0 0x7fcb7414e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:52.089 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.083+0000 7fcb737fe700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fcb74062be0 0x7fcb740bd520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.87:46558/0 (socket says 172.21.15.87:46558) 2020-11-20T11:47:52.089 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.083+0000 7fcb737fe700 1 -- 172.21.15.87:0/1051474139 learned_addr learned my addr 172.21.15.87:0/1051474139 (peer_addr_for_me v1:172.21.15.87:0/0) 2020-11-20T11:47:52.089 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.084+0000 7fcb6bfff700 1 -- 172.21.15.87:0/1051474139 >> v1:172.21.15.192:6789/0 conn(0x7fcb74062800 legacy=0x7fcb7414df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:52.090 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.084+0000 7fcb6bfff700 1 -- 172.21.15.87:0/1051474139 >> v1:172.21.15.87:6789/0 conn(0x7fcb74062be0 legacy=0x7fcb740bd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:52.090 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.084+0000 7fcb6bfff700 1 -- 172.21.15.87:0/1051474139 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb740bc8a0 con 0x7fcb740bfcb0 2020-11-20T11:47:52.090 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.084+0000 7fcb6bfff700 1 --2- 172.21.15.87:0/1051474139 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb740bfcb0 0x7fcb7414e660 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fcb5c006fd0 tx=0x7fcb5c006e30).ready entity=mon.0 client_cookie=4921d8d875c0c9b2 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:47:52.090 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.084+0000 7fcb727fc700 1 -- 172.21.15.87:0/1051474139 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c009870 con 0x7fcb740bfcb0 2020-11-20T11:47:52.091 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.084+0000 7fcb727fc700 1 -- 172.21.15.87:0/1051474139 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5c000e90 con 0x7fcb740bfcb0 2020-11-20T11:47:52.091 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.084+0000 7fcb727fc700 1 -- 172.21.15.87:0/1051474139 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c009be0 con 0x7fcb740bfcb0 2020-11-20T11:47:52.091 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.085+0000 7fcb79902700 1 -- 172.21.15.87:0/1051474139 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb740bfcb0 msgr2=0x7fcb7414e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:52.091 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.085+0000 7fcb79902700 1 --2- 172.21.15.87:0/1051474139 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb740bfcb0 0x7fcb7414e660 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fcb5c006fd0 tx=0x7fcb5c006e30).stop 2020-11-20T11:47:52.091 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.085+0000 7fcb79902700 1 -- 172.21.15.87:0/1051474139 shutdown_connections 2020-11-20T11:47:52.092 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.085+0000 7fcb79902700 1 --2- 172.21.15.87:0/1051474139 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb740bfcb0 0x7fcb7414e660 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:52.092 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.085+0000 7fcb79902700 1 -- 172.21.15.87:0/1051474139 >> 172.21.15.87:0/1051474139 conn(0x7fcb740c4910 msgr2=0x7fcb740c08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:47:52.092 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.085+0000 7fcb79902700 1 -- 172.21.15.87:0/1051474139 shutdown_connections 2020-11-20T11:47:52.092 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.085+0000 7fcb79902700 1 -- 172.21.15.87:0/1051474139 wait complete. 2020-11-20T11:47:52.095 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.086+0000 7fcb79902700 1 Processor -- start 2020-11-20T11:47:52.095 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.086+0000 7fcb79902700 1 -- start start 2020-11-20T11:47:52.095 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.086+0000 7fcb79902700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb74062800 0x7fcb74164650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:52.095 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.086+0000 7fcb79902700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb74062be0 0x7fcb7414bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:52.096 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.086+0000 7fcb79902700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb740bfcb0 0x7fcb741461e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:52.096 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.087+0000 7fcb79902700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb741606d0 con 0x7fcb74062800 2020-11-20T11:47:52.096 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.087+0000 7fcb79902700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb741608b0 con 0x7fcb740bfcb0 2020-11-20T11:47:52.096 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.087+0000 7fcb79902700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb74160b50 con 0x7fcb74062be0 2020-11-20T11:47:52.096 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.087+0000 7fcb72ffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb74062800 0x7fcb74164650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:52.097 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.087+0000 7fcb6bfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb74062be0 0x7fcb7414bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:52.097 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.087+0000 7fcb72ffd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb74062800 0x7fcb74164650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42606/0 (socket says 172.21.15.87:42606) 2020-11-20T11:47:52.097 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.087+0000 7fcb72ffd700 1 -- 172.21.15.87:0/670066839 learned_addr learned my addr 172.21.15.87:0/670066839 (peer_addr_for_me v2:172.21.15.87:0/0) 2020-11-20T11:47:52.097 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.087+0000 7fcb737fe700 1 --2- 172.21.15.87:0/670066839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb740bfcb0 0x7fcb741461e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:52.097 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.087+0000 7fcb72ffd700 1 -- 172.21.15.87:0/670066839 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb74062be0 msgr2=0x7fcb7414bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:52.098 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.087+0000 7fcb72ffd700 1 --2- 172.21.15.87:0/670066839 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb74062be0 0x7fcb7414bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:52.098 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.087+0000 7fcb72ffd700 1 -- 172.21.15.87:0/670066839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb740bfcb0 msgr2=0x7fcb741461e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:52.098 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.087+0000 7fcb72ffd700 1 --2- 172.21.15.87:0/670066839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb740bfcb0 0x7fcb741461e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:52.098 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.087+0000 7fcb72ffd700 1 -- 172.21.15.87:0/670066839 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb74160df0 con 0x7fcb74062800 2020-11-20T11:47:52.098 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.087+0000 7fcb72ffd700 1 --2- 172.21.15.87:0/670066839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb74062800 0x7fcb74164650 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fcb6400c710 tx=0x7fcb64007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:47:52.099 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.087+0000 7fcb6affd700 1 -- 172.21.15.87:0/670066839 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb64001ea0 con 0x7fcb74062800 2020-11-20T11:47:52.099 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.087+0000 7fcb6affd700 1 -- 172.21.15.87:0/670066839 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb64013410 con 0x7fcb74062800 2020-11-20T11:47:52.099 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.087+0000 7fcb79902700 1 -- 172.21.15.87:0/670066839 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb74161090 con 0x7fcb74062800 2020-11-20T11:47:52.099 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.087+0000 7fcb6affd700 1 -- 172.21.15.87:0/670066839 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb640137b0 con 0x7fcb74062800 2020-11-20T11:47:52.099 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.087+0000 7fcb79902700 1 -- 172.21.15.87:0/670066839 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb741615d0 con 0x7fcb74062800 2020-11-20T11:47:52.100 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.087+0000 7fcb6affd700 1 -- 172.21.15.87:0/670066839 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fcb64010030 con 0x7fcb74062800 2020-11-20T11:47:52.100 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.087+0000 7fcb6affd700 1 -- 172.21.15.87:0/670066839 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 1789+0+0 (secure 0 0 0) 0x7fcb6400eb40 con 0x7fcb74062800 2020-11-20T11:47:52.100 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.088+0000 7fcb68ff9700 1 -- 172.21.15.87:0/670066839 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb44004fd0 con 0x7fcb74062800 2020-11-20T11:47:52.100 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.092+0000 7fcb6affd700 1 -- 172.21.15.87:0/670066839 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7fcb6400ee20 con 0x7fcb74062800 2020-11-20T11:47:52.172 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.168+0000 7fcb68ff9700 1 -- 172.21.15.87:0/670066839 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3523676f-c9b8-47ae-86c0-4930dca17831", "id": 9} v 0) v1 -- 0x7fcb44004070 con 0x7fcb74062800 2020-11-20T11:47:52.174 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.171+0000 7fcb6affd700 1 -- 172.21.15.87:0/670066839 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3523676f-c9b8-47ae-86c0-4930dca17831", "id": 9}]=0 v12) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcb6400e3d0 con 0x7fcb74062800 2020-11-20T11:47:52.174 INFO:teuthology.orchestra.run.smithi087.stdout:9 2020-11-20T11:47:52.175 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.172+0000 7fcb68ff9700 1 -- 172.21.15.87:0/670066839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb74062800 msgr2=0x7fcb74164650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:52.175 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.172+0000 7fcb68ff9700 1 --2- 172.21.15.87:0/670066839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb74062800 0x7fcb74164650 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fcb6400c710 tx=0x7fcb64007c40).stop 2020-11-20T11:47:52.176 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.172+0000 7fcb68ff9700 1 -- 172.21.15.87:0/670066839 shutdown_connections 2020-11-20T11:47:52.176 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.172+0000 7fcb68ff9700 1 --2- 172.21.15.87:0/670066839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb740bfcb0 0x7fcb741461e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:52.176 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.172+0000 7fcb68ff9700 1 --2- 172.21.15.87:0/670066839 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcb74062800 0x7fcb74164650 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:52.176 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.172+0000 7fcb68ff9700 1 --2- 172.21.15.87:0/670066839 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb74062be0 0x7fcb7414bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:52.176 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.172+0000 7fcb68ff9700 1 -- 172.21.15.87:0/670066839 >> 172.21.15.87:0/670066839 conn(0x7fcb740c4910 msgr2=0x7fcb7414ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:47:52.177 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.172+0000 7fcb68ff9700 1 -- 172.21.15.87:0/670066839 shutdown_connections 2020-11-20T11:47:52.177 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.172+0000 7fcb68ff9700 1 -- 172.21.15.87:0/670066839 wait complete. 2020-11-20T11:47:52.187 INFO:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new 88d5c251-0bb1-4624-8fa2-7f3b74bd1bf1 10 2020-11-20T11:47:52.300 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.296+0000 7f87e24d1700 1 Processor -- start 2020-11-20T11:47:52.300 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.296+0000 7f87e24d1700 1 -- start start 2020-11-20T11:47:52.302 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.297+0000 7f87e24d1700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f87dc0bdad0 0x7f87dc0bdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:52.303 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.297+0000 7f87e24d1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f87dc14fbe0 0x7f87dc066420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:52.303 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.297+0000 7f87e24d1700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87dc066e70 con 0x7f87dc1525e0 2020-11-20T11:47:52.303 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.297+0000 7f87e24d1700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87dc0becb0 con 0x7f87dc14fbe0 2020-11-20T11:47:52.303 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.297+0000 7f87e24d1700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87dc067110 con 0x7f87dc0bdad0 2020-11-20T11:47:52.303 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.297+0000 7f87e0a6e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f87dc14fbe0 0x7f87dc066420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:52.304 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.297+0000 7f87dbfff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f87dc0bdad0 0x7f87dc0bdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:52.304 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.298+0000 7f87e0a6e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f87dc14fbe0 0x7f87dc066420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.87:35128/0 (socket says 172.21.15.87:35128) 2020-11-20T11:47:52.304 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.298+0000 7f87e0a6e700 1 -- 172.21.15.87:0/3854213361 learned_addr learned my addr 172.21.15.87:0/3854213361 (peer_addr_for_me v2:172.21.15.87:0/0) 2020-11-20T11:47:52.304 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.298+0000 7f87db7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f87dc1525e0 0x7f87dc0be5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.87:39594/0 (socket says 172.21.15.87:39594) 2020-11-20T11:47:52.304 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.298+0000 7f87e0a6e700 1 -- 172.21.15.87:0/3854213361 >> v2:172.21.15.192:3300/0 conn(0x7f87dc0bdad0 msgr2=0x7f87dc0bdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:47:52.305 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.298+0000 7f87e0a6e700 1 --2- 172.21.15.87:0/3854213361 >> v2:172.21.15.192:3300/0 conn(0x7f87dc0bdad0 0x7f87dc0bdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:52.305 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.298+0000 7f87e0a6e700 1 -- 172.21.15.87:0/3854213361 >> v1:172.21.15.146:6789/0 conn(0x7f87dc1525e0 legacy=0x7f87dc0be5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:52.305 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.298+0000 7f87e0a6e700 1 -- 172.21.15.87:0/3854213361 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87dc14f200 con 0x7f87dc14fbe0 2020-11-20T11:47:52.305 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.298+0000 7f87e0a6e700 1 --2- 172.21.15.87:0/3854213361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87dc14fbe0 0x7f87dc066420 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f87dc0c67a0 tx=0x7f87d40092d0).ready entity=mon.1 client_cookie=298fdd88a1f6e66 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:47:52.305 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.298+0000 7f87daffd700 1 -- 172.21.15.87:0/3854213361 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d400bc80 con 0x7f87dc14fbe0 2020-11-20T11:47:52.306 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.298+0000 7f87daffd700 1 -- 172.21.15.87:0/3854213361 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d400bde0 con 0x7f87dc14fbe0 2020-11-20T11:47:52.306 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.298+0000 7f87daffd700 1 -- 172.21.15.87:0/3854213361 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d4011610 con 0x7f87dc14fbe0 2020-11-20T11:47:52.306 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.299+0000 7f87e24d1700 1 -- 172.21.15.87:0/3854213361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87dc14fbe0 msgr2=0x7f87dc066420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:52.307 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.299+0000 7f87e24d1700 1 --2- 172.21.15.87:0/3854213361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87dc14fbe0 0x7f87dc066420 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f87dc0c67a0 tx=0x7f87d40092d0).stop 2020-11-20T11:47:52.307 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.299+0000 7f87e24d1700 1 -- 172.21.15.87:0/3854213361 shutdown_connections 2020-11-20T11:47:52.307 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.299+0000 7f87e24d1700 1 --2- 172.21.15.87:0/3854213361 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87dc14fbe0 0x7f87dc066420 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:52.307 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.299+0000 7f87e24d1700 1 --2- 172.21.15.87:0/3854213361 >> v2:172.21.15.192:3300/0 conn(0x7f87dc0bdad0 0x7f87dc0bdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:52.308 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.299+0000 7f87e24d1700 1 -- 172.21.15.87:0/3854213361 >> 172.21.15.87:0/3854213361 conn(0x7f87dc0601b0 msgr2=0x7f87dc0605c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:47:52.308 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.299+0000 7f87e24d1700 1 -- 172.21.15.87:0/3854213361 shutdown_connections 2020-11-20T11:47:52.309 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.299+0000 7f87e24d1700 1 -- 172.21.15.87:0/3854213361 wait complete. 2020-11-20T11:47:52.311 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.300+0000 7f87e24d1700 1 Processor -- start 2020-11-20T11:47:52.312 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.301+0000 7f87e24d1700 1 -- start start 2020-11-20T11:47:52.312 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.301+0000 7f87e24d1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87dc0bdad0 0x7f87dc151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:52.312 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.301+0000 7f87e24d1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87dc14fbe0 0x7f87dc062e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:52.312 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.301+0000 7f87e24d1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87dc1525e0 0x7f87dc0634a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:52.313 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.301+0000 7f87e24d1700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc161200 con 0x7f87dc14fbe0 2020-11-20T11:47:52.313 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.301+0000 7f87e24d1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc160f60 con 0x7f87dc0bdad0 2020-11-20T11:47:52.313 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.301+0000 7f87e24d1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc150b90 con 0x7f87dc1525e0 2020-11-20T11:47:52.313 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.301+0000 7f87db7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87dc14fbe0 0x7f87dc062e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:52.313 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.301+0000 7f87db7fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87dc14fbe0 0x7f87dc062e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42620/0 (socket says 172.21.15.87:42620) 2020-11-20T11:47:52.314 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.301+0000 7f87db7fe700 1 -- 172.21.15.87:0/386527618 learned_addr learned my addr 172.21.15.87:0/386527618 (peer_addr_for_me v2:172.21.15.87:0/0) 2020-11-20T11:47:52.314 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.301+0000 7f87dbfff700 1 --2- 172.21.15.87:0/386527618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87dc0bdad0 0x7f87dc151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:52.314 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.301+0000 7f87e0a6e700 1 --2- 172.21.15.87:0/386527618 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87dc1525e0 0x7f87dc0634a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:52.314 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.302+0000 7f87db7fe700 1 -- 172.21.15.87:0/386527618 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87dc1525e0 msgr2=0x7f87dc0634a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:52.314 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.302+0000 7f87db7fe700 1 --2- 172.21.15.87:0/386527618 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87dc1525e0 0x7f87dc0634a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:52.315 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.302+0000 7f87db7fe700 1 -- 172.21.15.87:0/386527618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87dc0bdad0 msgr2=0x7f87dc151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:52.315 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.302+0000 7f87db7fe700 1 --2- 172.21.15.87:0/386527618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87dc0bdad0 0x7f87dc151810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:52.315 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.302+0000 7f87db7fe700 1 -- 172.21.15.87:0/386527618 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87dc150e30 con 0x7f87dc14fbe0 2020-11-20T11:47:52.315 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.302+0000 7f87db7fe700 1 --2- 172.21.15.87:0/386527618 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87dc14fbe0 0x7f87dc062e00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f87d000c710 tx=0x7f87d0007ca0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:47:52.315 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.302+0000 7f87bbfff700 1 -- 172.21.15.87:0/386527618 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d00072e0 con 0x7f87dc14fbe0 2020-11-20T11:47:52.316 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.303+0000 7f87bbfff700 1 -- 172.21.15.87:0/386527618 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d0005570 con 0x7f87dc14fbe0 2020-11-20T11:47:52.316 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.303+0000 7f87e24d1700 1 -- 172.21.15.87:0/386527618 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87dc1510d0 con 0x7f87dc14fbe0 2020-11-20T11:47:52.316 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.303+0000 7f87bbfff700 1 -- 172.21.15.87:0/386527618 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d0005910 con 0x7f87dc14fbe0 2020-11-20T11:47:52.316 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.303+0000 7f87e24d1700 1 -- 172.21.15.87:0/386527618 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87dc063990 con 0x7f87dc14fbe0 2020-11-20T11:47:52.317 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.303+0000 7f87bbfff700 1 -- 172.21.15.87:0/386527618 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 2) v1 ==== 33694+0+0 (secure 0 0 0) 0x7f87d0010070 con 0x7f87dc14fbe0 2020-11-20T11:47:52.317 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.303+0000 7f87e24d1700 1 -- 172.21.15.87:0/386527618 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87dc151530 con 0x7f87dc14fbe0 2020-11-20T11:47:52.317 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.303+0000 7f87bbfff700 1 -- 172.21.15.87:0/386527618 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 1904+0+0 (secure 0 0 0) 0x7f87d003bee0 con 0x7f87dc14fbe0 2020-11-20T11:47:52.317 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.305+0000 7f87bbfff700 1 -- 172.21.15.87:0/386527618 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f87d001bb80 con 0x7f87dc14fbe0 2020-11-20T11:47:52.388 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.385+0000 7f87e24d1700 1 -- 172.21.15.87:0/386527618 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "88d5c251-0bb1-4624-8fa2-7f3b74bd1bf1", "id": 10} v 0) v1 -- 0x7f87dc05ca80 con 0x7f87dc14fbe0 2020-11-20T11:47:52.391 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.388+0000 7f87bbfff700 1 -- 172.21.15.87:0/386527618 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "88d5c251-0bb1-4624-8fa2-7f3b74bd1bf1", "id": 10}]=0 v13) v1 ==== 113+0+3 (secure 0 0 0) 0x7f87d000e290 con 0x7f87dc14fbe0 2020-11-20T11:47:52.392 INFO:teuthology.orchestra.run.smithi087.stdout:10 2020-11-20T11:47:52.393 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.389+0000 7f87e24d1700 1 -- 172.21.15.87:0/386527618 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87dc14fbe0 msgr2=0x7f87dc062e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:52.393 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.389+0000 7f87e24d1700 1 --2- 172.21.15.87:0/386527618 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87dc14fbe0 0x7f87dc062e00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f87d000c710 tx=0x7f87d0007ca0).stop 2020-11-20T11:47:52.393 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.389+0000 7f87e24d1700 1 -- 172.21.15.87:0/386527618 shutdown_connections 2020-11-20T11:47:52.393 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.389+0000 7f87e24d1700 1 --2- 172.21.15.87:0/386527618 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87dc1525e0 0x7f87dc0634a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:52.393 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.389+0000 7f87e24d1700 1 --2- 172.21.15.87:0/386527618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87dc0bdad0 0x7f87dc151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:52.394 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.389+0000 7f87e24d1700 1 --2- 172.21.15.87:0/386527618 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87dc14fbe0 0x7f87dc062e00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:52.394 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.389+0000 7f87e24d1700 1 -- 172.21.15.87:0/386527618 >> 172.21.15.87:0/386527618 conn(0x7f87dc0601b0 msgr2=0x7f87dc0bedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:47:52.394 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.389+0000 7f87e24d1700 1 -- 172.21.15.87:0/386527618 shutdown_connections 2020-11-20T11:47:52.394 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.389+0000 7f87e24d1700 1 -- 172.21.15.87:0/386527618 wait complete. 2020-11-20T11:47:52.408 INFO:teuthology.orchestra.run.smithi087:> sudo ceph --cluster ceph osd new 31f650d6-ba1e-4f29-92ff-6abee04c0f12 11 2020-11-20T11:47:52.524 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.521+0000 7fb68b067700 1 Processor -- start 2020-11-20T11:47:52.525 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.521+0000 7fb68b067700 1 -- start start 2020-11-20T11:47:52.527 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.522+0000 7fb68b067700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb684060370 0x7fb684060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:52.527 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.522+0000 7fb68b067700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb684064c40 0x7fb684151340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:52.528 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.522+0000 7fb68b067700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb684151e80 con 0x7fb684154920 2020-11-20T11:47:52.528 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.522+0000 7fb68b067700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb684152120 con 0x7fb684060370 2020-11-20T11:47:52.528 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.522+0000 7fb68b067700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb684064260 con 0x7fb684064c40 2020-11-20T11:47:52.528 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.522+0000 7fb688e03700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb684060370 0x7fb684060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:52.528 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.522+0000 7fb688e03700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fb684060370 0x7fb684060750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42624/0 (socket says 172.21.15.87:42624) 2020-11-20T11:47:52.529 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.522+0000 7fb688e03700 1 -- 172.21.15.87:0/2793817501 learned_addr learned my addr 172.21.15.87:0/2793817501 (peer_addr_for_me v2:172.21.15.87:0/0) 2020-11-20T11:47:52.529 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.523+0000 7fb689604700 1 --2- 172.21.15.87:0/2793817501 >> v2:172.21.15.192:3300/0 conn(0x7fb684064c40 0x7fb684151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:52.529 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.523+0000 7fb688e03700 1 -- 172.21.15.87:0/2793817501 >> v2:172.21.15.192:3300/0 conn(0x7fb684064c40 msgr2=0x7fb684151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:47:52.529 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.523+0000 7fb688e03700 1 --2- 172.21.15.87:0/2793817501 >> v2:172.21.15.192:3300/0 conn(0x7fb684064c40 0x7fb684151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:52.529 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.523+0000 7fb688e03700 1 -- 172.21.15.87:0/2793817501 >> v1:172.21.15.192:6789/0 conn(0x7fb684154920 legacy=0x7fb6840c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:52.530 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.523+0000 7fb688e03700 1 -- 172.21.15.87:0/2793817501 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb684064500 con 0x7fb684060370 2020-11-20T11:47:52.531 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.523+0000 7fb689604700 1 --2- 172.21.15.87:0/2793817501 >> v2:172.21.15.192:3300/0 conn(0x7fb684064c40 0x7fb684151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:47:52.531 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.523+0000 7fb688e03700 1 --2- 172.21.15.87:0/2793817501 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb684060370 0x7fb684060750 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fb684065700 tx=0x7fb678006ef0).ready entity=mon.0 client_cookie=a32aeda9a209240e server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:47:52.531 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.523+0000 7fb6837fe700 1 -- 172.21.15.87:0/2793817501 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67800b8f0 con 0x7fb684060370 2020-11-20T11:47:52.532 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.523+0000 7fb6837fe700 1 -- 172.21.15.87:0/2793817501 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb678000e90 con 0x7fb684060370 2020-11-20T11:47:52.532 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.523+0000 7fb6837fe700 1 -- 172.21.15.87:0/2793817501 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67800bc60 con 0x7fb684060370 2020-11-20T11:47:52.532 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.523+0000 7fb68b067700 1 -- 172.21.15.87:0/2793817501 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb684060370 msgr2=0x7fb684060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:52.532 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.523+0000 7fb68b067700 1 --2- 172.21.15.87:0/2793817501 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb684060370 0x7fb684060750 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fb684065700 tx=0x7fb678006ef0).stop 2020-11-20T11:47:52.533 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.524+0000 7fb68b067700 1 -- 172.21.15.87:0/2793817501 shutdown_connections 2020-11-20T11:47:52.533 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.524+0000 7fb68b067700 1 --2- 172.21.15.87:0/2793817501 >> v2:172.21.15.192:3300/0 conn(0x7fb684064c40 0x7fb684151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:52.533 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.524+0000 7fb68b067700 1 --2- 172.21.15.87:0/2793817501 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb684060370 0x7fb684060750 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:52.534 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.524+0000 7fb68b067700 1 -- 172.21.15.87:0/2793817501 >> 172.21.15.87:0/2793817501 conn(0x7fb684062100 msgr2=0x7fb6840c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:47:52.534 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.524+0000 7fb68b067700 1 -- 172.21.15.87:0/2793817501 shutdown_connections 2020-11-20T11:47:52.534 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.524+0000 7fb68b067700 1 -- 172.21.15.87:0/2793817501 wait complete. 2020-11-20T11:47:52.536 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.525+0000 7fb68b067700 1 Processor -- start 2020-11-20T11:47:52.537 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.525+0000 7fb68b067700 1 -- start start 2020-11-20T11:47:52.537 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.526+0000 7fb68b067700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb684060370 0x7fb6840c2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:52.537 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.526+0000 7fb68b067700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb684064c40 0x7fb6840c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:52.537 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.526+0000 7fb68b067700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb684154920 0x7fb6840c0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:52.538 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.526+0000 7fb68b067700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6840c33b0 con 0x7fb684064c40 2020-11-20T11:47:52.538 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.526+0000 7fb68b067700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6840c7db0 con 0x7fb684060370 2020-11-20T11:47:52.538 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.526+0000 7fb68b067700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6840c60a0 con 0x7fb684154920 2020-11-20T11:47:52.538 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.526+0000 7fb683fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb684064c40 0x7fb6840c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:52.538 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.526+0000 7fb683fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb684064c40 0x7fb6840c78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.87:42634/0 (socket says 172.21.15.87:42634) 2020-11-20T11:47:52.539 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.526+0000 7fb683fff700 1 -- 172.21.15.87:0/3667881272 learned_addr learned my addr 172.21.15.87:0/3667881272 (peer_addr_for_me v2:172.21.15.87:0/0) 2020-11-20T11:47:52.539 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.526+0000 7fb689604700 1 --2- 172.21.15.87:0/3667881272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb684154920 0x7fb6840c0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:52.539 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.526+0000 7fb688e03700 1 --2- 172.21.15.87:0/3667881272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb684060370 0x7fb6840c2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:52.539 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.526+0000 7fb683fff700 1 -- 172.21.15.87:0/3667881272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb684154920 msgr2=0x7fb6840c0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:52.540 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.526+0000 7fb683fff700 1 --2- 172.21.15.87:0/3667881272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb684154920 0x7fb6840c0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:52.541 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.526+0000 7fb683fff700 1 -- 172.21.15.87:0/3667881272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb684060370 msgr2=0x7fb6840c2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:52.541 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.526+0000 7fb683fff700 1 --2- 172.21.15.87:0/3667881272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb684060370 0x7fb6840c2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:52.541 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.526+0000 7fb683fff700 1 -- 172.21.15.87:0/3667881272 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6840c0ee0 con 0x7fb684064c40 2020-11-20T11:47:52.541 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.526+0000 7fb683fff700 1 --2- 172.21.15.87:0/3667881272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb684064c40 0x7fb6840c78c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fb67000c710 tx=0x7fb670007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:47:52.542 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.526+0000 7fb680ff9700 1 -- 172.21.15.87:0/3667881272 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67000e4a0 con 0x7fb684064c40 2020-11-20T11:47:52.542 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.526+0000 7fb680ff9700 1 -- 172.21.15.87:0/3667881272 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb670001e90 con 0x7fb684064c40 2020-11-20T11:47:52.542 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.526+0000 7fb68b067700 1 -- 172.21.15.87:0/3667881272 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6840c1180 con 0x7fb684064c40 2020-11-20T11:47:52.542 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.526+0000 7fb680ff9700 1 -- 172.21.15.87:0/3667881272 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67000e830 con 0x7fb684064c40 2020-11-20T11:47:52.542 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.526+0000 7fb68b067700 1 -- 172.21.15.87:0/3667881272 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6840c16c0 con 0x7fb684064c40 2020-11-20T11:47:52.543 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.527+0000 7fb680ff9700 1 -- 172.21.15.87:0/3667881272 <== mon.0 v2:172.21.15.87:3300/0 4 ==== mgrmap(e 2) v1 ==== 33694+0+0 (secure 0 0 0) 0x7fb670010030 con 0x7fb684064c40 2020-11-20T11:47:52.543 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.527+0000 7fb680ff9700 1 -- 172.21.15.87:0/3667881272 <== mon.0 v2:172.21.15.87:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2395+0+0 (secure 0 0 0) 0x7fb67003c820 con 0x7fb684064c40 2020-11-20T11:47:52.543 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.527+0000 7fb68b067700 1 -- 172.21.15.87:0/3667881272 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6840c1880 con 0x7fb684064c40 2020-11-20T11:47:52.543 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.529+0000 7fb680ff9700 1 -- 172.21.15.87:0/3667881272 <== mon.0 v2:172.21.15.87:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7fb67001a300 con 0x7fb684064c40 2020-11-20T11:47:52.606 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.603+0000 7fb68b067700 1 -- 172.21.15.87:0/3667881272 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_command({"prefix": "osd new", "uuid": "31f650d6-ba1e-4f29-92ff-6abee04c0f12", "id": 11} v 0) v1 -- 0x7fb6840699a0 con 0x7fb684064c40 2020-11-20T11:47:52.609 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.605+0000 7fb680ff9700 1 -- 172.21.15.87:0/3667881272 <== mon.0 v2:172.21.15.87:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "31f650d6-ba1e-4f29-92ff-6abee04c0f12", "id": 11}]=0 v14) v1 ==== 113+0+3 (secure 0 0 0) 0x7fb6700380b0 con 0x7fb684064c40 2020-11-20T11:47:52.610 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.606+0000 7fb68b067700 1 -- 172.21.15.87:0/3667881272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb684064c40 msgr2=0x7fb6840c78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:52.610 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.606+0000 7fb68b067700 1 --2- 172.21.15.87:0/3667881272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb684064c40 0x7fb6840c78c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fb67000c710 tx=0x7fb670007c20).stop 2020-11-20T11:47:52.610 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.606+0000 7fb68b067700 1 -- 172.21.15.87:0/3667881272 shutdown_connections 2020-11-20T11:47:52.610 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.606+0000 7fb68b067700 1 --2- 172.21.15.87:0/3667881272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb684154920 0x7fb6840c0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:52.611 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.606+0000 7fb68b067700 1 --2- 172.21.15.87:0/3667881272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb684060370 0x7fb6840c2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:52.611 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.606+0000 7fb68b067700 1 --2- 172.21.15.87:0/3667881272 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb684064c40 0x7fb6840c78c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:52.611 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.606+0000 7fb68b067700 1 -- 172.21.15.87:0/3667881272 >> 172.21.15.87:0/3667881272 conn(0x7fb684062100 msgr2=0x7fb6840c4820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:47:52.611 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.606+0000 7fb68b067700 1 -- 172.21.15.87:0/3667881272 shutdown_connections 2020-11-20T11:47:52.611 INFO:teuthology.orchestra.run.smithi087.stderr:2020-11-20T11:47:52.606+0000 7fb68b067700 1 -- 172.21.15.87:0/3667881272 wait complete. 2020-11-20T11:47:52.612 INFO:teuthology.orchestra.run.smithi087.stdout:11 2020-11-20T11:47:52.620 INFO:tasks.ceph.osd.0:Restarting daemon 2020-11-20T11:47:52.621 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2020-11-20T11:47:52.627 INFO:tasks.ceph.osd.0:Started 2020-11-20T11:47:52.627 INFO:tasks.ceph.osd.3:Restarting daemon 2020-11-20T11:47:52.628 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2020-11-20T11:47:52.633 INFO:tasks.ceph.osd.3:Started 2020-11-20T11:47:52.633 INFO:tasks.ceph.osd.6:Restarting daemon 2020-11-20T11:47:52.634 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2020-11-20T11:47:52.640 INFO:tasks.ceph.osd.6:Started 2020-11-20T11:47:52.640 INFO:tasks.ceph.osd.9:Restarting daemon 2020-11-20T11:47:52.640 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 9 2020-11-20T11:47:52.646 INFO:tasks.ceph.osd.9:Started 2020-11-20T11:47:52.647 INFO:tasks.ceph.osd.1:Restarting daemon 2020-11-20T11:47:52.647 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2020-11-20T11:47:52.651 INFO:tasks.ceph.osd.1:Started 2020-11-20T11:47:52.651 INFO:tasks.ceph.osd.4:Restarting daemon 2020-11-20T11:47:52.652 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2020-11-20T11:47:52.654 INFO:tasks.ceph.osd.4:Started 2020-11-20T11:47:52.655 INFO:tasks.ceph.osd.7:Restarting daemon 2020-11-20T11:47:52.655 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2020-11-20T11:47:52.658 INFO:tasks.ceph.osd.7:Started 2020-11-20T11:47:52.658 INFO:tasks.ceph.osd.10:Restarting daemon 2020-11-20T11:47:52.659 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 10 2020-11-20T11:47:52.661 INFO:tasks.ceph.osd.10:Started 2020-11-20T11:47:52.662 INFO:tasks.ceph.osd.2:Restarting daemon 2020-11-20T11:47:52.662 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2020-11-20T11:47:52.665 INFO:tasks.ceph.osd.2:Started 2020-11-20T11:47:52.665 INFO:tasks.ceph.osd.5:Restarting daemon 2020-11-20T11:47:52.666 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2020-11-20T11:47:52.669 INFO:tasks.ceph.osd.5:Started 2020-11-20T11:47:52.669 INFO:tasks.ceph.osd.8:Restarting daemon 2020-11-20T11:47:52.670 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 8 2020-11-20T11:47:52.673 INFO:tasks.ceph.osd.8:Started 2020-11-20T11:47:52.673 INFO:tasks.ceph.osd.11:Restarting daemon 2020-11-20T11:47:52.674 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 11 2020-11-20T11:47:52.677 INFO:tasks.ceph.osd.11:Started 2020-11-20T11:47:52.677 INFO:tasks.ceph:Waiting for OSDs to come up 2020-11-20T11:47:53.219 INFO:tasks.ceph.osd.3.smithi192.stderr:2020-11-20T11:47:53.216+0000 7fc0c7bbbf40 -1 Falling back to public interface 2020-11-20T11:47:53.227 INFO:tasks.ceph.osd.6.smithi192.stderr:2020-11-20T11:47:53.224+0000 7fe03786cf40 -1 Falling back to public interface 2020-11-20T11:47:53.235 INFO:tasks.ceph.osd.9.smithi192.stderr:2020-11-20T11:47:53.232+0000 7f7cc7d18f40 -1 Falling back to public interface 2020-11-20T11:47:53.242 INFO:tasks.ceph.osd.1.smithi146.stderr:2020-11-20T11:47:53.239+0000 7fbf2882ef40 -1 Falling back to public interface 2020-11-20T11:47:53.243 INFO:tasks.ceph.osd.0.smithi192.stderr:2020-11-20T11:47:53.240+0000 7f79b959af40 -1 Falling back to public interface 2020-11-20T11:47:53.244 INFO:tasks.ceph.osd.4.smithi146.stderr:2020-11-20T11:47:53.241+0000 7fb1e704ef40 -1 Falling back to public interface 2020-11-20T11:47:53.251 INFO:tasks.ceph.osd.7.smithi146.stderr:2020-11-20T11:47:53.247+0000 7f7999fc4f40 -1 Falling back to public interface 2020-11-20T11:47:53.251 INFO:tasks.ceph.osd.10.smithi146.stderr:2020-11-20T11:47:53.247+0000 7f0a5ae65f40 -1 Falling back to public interface 2020-11-20T11:47:53.261 INFO:tasks.ceph.osd.5.smithi087.stderr:2020-11-20T11:47:53.258+0000 7fd93c99ef40 -1 Falling back to public interface 2020-11-20T11:47:53.270 INFO:tasks.ceph.osd.11.smithi087.stderr:2020-11-20T11:47:53.267+0000 7efe0edb5f40 -1 Falling back to public interface 2020-11-20T11:47:53.274 INFO:tasks.ceph.osd.2.smithi087.stderr:2020-11-20T11:47:53.271+0000 7fd547667f40 -1 Falling back to public interface 2020-11-20T11:47:53.281 INFO:tasks.ceph.osd.8.smithi087.stderr:2020-11-20T11:47:53.278+0000 7ff5dc41df40 -1 Falling back to public interface 2020-11-20T11:47:53.887 INFO:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-11-20T11:47:53.986 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.983+0000 7fca553e8700 1 Processor -- start 2020-11-20T11:47:53.986 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.983+0000 7fca553e8700 1 -- start start 2020-11-20T11:47:53.990 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.984+0000 7fca553e8700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca500bdef0 con 0x7fca500667f0 2020-11-20T11:47:53.990 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.984+0000 7fca553e8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca50150ff0 con 0x7fca500c1b60 2020-11-20T11:47:53.990 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.984+0000 7fca553e8700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca50151400 con 0x7fca50066410 2020-11-20T11:47:53.991 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.984+0000 7fca4ffff700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fca50066410 0x7fca5009d450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:50954/0 (socket says 172.21.15.192:50954) 2020-11-20T11:47:53.991 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.984+0000 7fca4ffff700 1 -- 172.21.15.192:0/198451448 learned_addr learned my addr 172.21.15.192:0/198451448 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:47:53.991 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.984+0000 7fca4effd700 1 -- 172.21.15.192:0/198451448 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 604983383 0 0) 0x7fca50151400 con 0x7fca50066410 2020-11-20T11:47:53.991 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.984+0000 7fca4effd700 1 -- 172.21.15.192:0/198451448 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca3c003280 con 0x7fca50066410 2020-11-20T11:47:53.991 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.984+0000 7fca4effd700 1 -- 172.21.15.192:0/198451448 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4204936156 0 0) 0x7fca50150ff0 con 0x7fca500c1b60 2020-11-20T11:47:53.992 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.984+0000 7fca4effd700 1 -- 172.21.15.192:0/198451448 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca50151400 con 0x7fca500c1b60 2020-11-20T11:47:53.992 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.984+0000 7fca4effd700 1 -- 172.21.15.192:0/198451448 <== mon.2 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 863343923 0 0) 0x7fca3c003280 con 0x7fca50066410 2020-11-20T11:47:53.992 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.984+0000 7fca4effd700 1 -- 172.21.15.192:0/198451448 >> v1:172.21.15.146:6789/0 conn(0x7fca500c1b60 legacy=0x7fca501501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:53.992 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.984+0000 7fca4effd700 1 -- 172.21.15.192:0/198451448 >> v1:172.21.15.87:6789/0 conn(0x7fca500667f0 legacy=0x7fca501508e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:53.993 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.984+0000 7fca4effd700 1 -- 172.21.15.192:0/198451448 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca501516a0 con 0x7fca50066410 2020-11-20T11:47:53.993 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.984+0000 7fca4effd700 1 -- 172.21.15.192:0/198451448 <== mon.2 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3985397220 0 0) 0x7fca44001560 con 0x7fca50066410 2020-11-20T11:47:53.993 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.984+0000 7fca4effd700 1 -- 172.21.15.192:0/198451448 >> v1:172.21.15.192:6789/0 conn(0x7fca50066410 legacy=0x7fca5009d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:53.993 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.984+0000 7fca4effd700 1 --2- 172.21.15.192:0/198451448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca3c003900 0x7fca3c003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:53.993 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.984+0000 7fca4effd700 1 --2- 172.21.15.192:0/198451448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca3c004520 0x7fca3c0049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:53.994 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.984+0000 7fca4effd700 1 --2- 172.21.15.192:0/198451448 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca3c004e90 0x7fca3c00b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:53.994 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.984+0000 7fca4effd700 1 -- 172.21.15.192:0/198451448 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c0053c0 con 0x7fca3c004e90 2020-11-20T11:47:53.994 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.984+0000 7fca4effd700 1 -- 172.21.15.192:0/198451448 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c00bc60 con 0x7fca3c003900 2020-11-20T11:47:53.994 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.984+0000 7fca4effd700 1 -- 172.21.15.192:0/198451448 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c00bdf0 con 0x7fca3c004520 2020-11-20T11:47:53.995 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.985+0000 7fca4f7fe700 1 --2- 172.21.15.192:0/198451448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca3c004520 0x7fca3c0049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:53.995 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.985+0000 7fca4ffff700 1 --2- 172.21.15.192:0/198451448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca3c003900 0x7fca3c003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:53.995 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.985+0000 7fca54be7700 1 --2- 172.21.15.192:0/198451448 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca3c004e90 0x7fca3c00b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:53.995 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.985+0000 7fca4ffff700 1 -- 172.21.15.192:0/198451448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca3c004520 msgr2=0x7fca3c0049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:47:53.996 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.985+0000 7fca4ffff700 1 --2- 172.21.15.192:0/198451448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca3c004520 0x7fca3c0049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:53.996 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.985+0000 7fca4ffff700 1 -- 172.21.15.192:0/198451448 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca3c004e90 msgr2=0x7fca3c00b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:47:53.996 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.985+0000 7fca4ffff700 1 --2- 172.21.15.192:0/198451448 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca3c004e90 0x7fca3c00b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:53.997 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.985+0000 7fca4ffff700 1 -- 172.21.15.192:0/198451448 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca3c003280 con 0x7fca3c003900 2020-11-20T11:47:53.997 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.985+0000 7fca54be7700 1 -- 172.21.15.192:0/198451448 reap_dead start 2020-11-20T11:47:53.997 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.985+0000 7fca4f7fe700 1 --2- 172.21.15.192:0/198451448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca3c004520 0x7fca3c0049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:47:53.998 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.985+0000 7fca4ffff700 1 --2- 172.21.15.192:0/198451448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca3c003900 0x7fca3c003ce0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fca4400c1e0 tx=0x7fca50151830).ready entity=mon.1 client_cookie=3930192ca4ca0bf8 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:47:53.998 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.985+0000 7fca4effd700 1 -- 172.21.15.192:0/198451448 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4400cda0 con 0x7fca3c003900 2020-11-20T11:47:53.998 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.985+0000 7fca4effd700 1 -- 172.21.15.192:0/198451448 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca440070d0 con 0x7fca3c003900 2020-11-20T11:47:53.998 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.985+0000 7fca4effd700 1 -- 172.21.15.192:0/198451448 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca44007470 con 0x7fca3c003900 2020-11-20T11:47:53.999 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.986+0000 7fca553e8700 1 -- 172.21.15.192:0/198451448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca3c003900 msgr2=0x7fca3c003ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:53.999 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.986+0000 7fca553e8700 1 --2- 172.21.15.192:0/198451448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca3c003900 0x7fca3c003ce0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fca4400c1e0 tx=0x7fca50151830).stop 2020-11-20T11:47:53.999 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.986+0000 7fca553e8700 1 -- 172.21.15.192:0/198451448 shutdown_connections 2020-11-20T11:47:53.999 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.986+0000 7fca553e8700 1 --2- 172.21.15.192:0/198451448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca3c003900 0x7fca3c003ce0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:54.000 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.986+0000 7fca553e8700 1 -- 172.21.15.192:0/198451448 >> 172.21.15.192:0/198451448 conn(0x7fca500c8330 msgr2=0x7fca500c4300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:47:54.000 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.986+0000 7fca553e8700 1 -- 172.21.15.192:0/198451448 shutdown_connections 2020-11-20T11:47:54.000 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.986+0000 7fca553e8700 1 -- 172.21.15.192:0/198451448 wait complete. 2020-11-20T11:47:54.000 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.987+0000 7fca553e8700 1 Processor -- start 2020-11-20T11:47:54.000 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.987+0000 7fca553e8700 1 -- start start 2020-11-20T11:47:54.003 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.988+0000 7fca553e8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca3c003900 0x7fca500c0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:54.003 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.988+0000 7fca553e8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca50154fd0 0x7fca5009d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:54.003 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.988+0000 7fca553e8700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca5009db00 0x7fca501538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:54.004 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.988+0000 7fca553e8700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca500c0d80 con 0x7fca5009db00 2020-11-20T11:47:54.004 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.988+0000 7fca553e8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca501605d0 con 0x7fca3c003900 2020-11-20T11:47:54.004 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.988+0000 7fca553e8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca50160870 con 0x7fca50154fd0 2020-11-20T11:47:54.004 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.988+0000 7fca4f7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca50154fd0 0x7fca5009d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:54.004 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.988+0000 7fca4f7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca50154fd0 0x7fca5009d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48298/0 (socket says 172.21.15.192:48298) 2020-11-20T11:47:54.005 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.988+0000 7fca4f7fe700 1 -- 172.21.15.192:0/1658885917 learned_addr learned my addr 172.21.15.192:0/1658885917 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:47:54.005 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.988+0000 7fca4ffff700 1 --2- 172.21.15.192:0/1658885917 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca3c003900 0x7fca500c0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:54.005 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.988+0000 7fca54be7700 1 --2- 172.21.15.192:0/1658885917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca5009db00 0x7fca501538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:54.005 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.988+0000 7fca4f7fe700 1 -- 172.21.15.192:0/1658885917 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca3c003900 msgr2=0x7fca500c0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:54.006 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.988+0000 7fca4f7fe700 1 --2- 172.21.15.192:0/1658885917 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca3c003900 0x7fca500c0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:54.006 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.988+0000 7fca4f7fe700 1 -- 172.21.15.192:0/1658885917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca5009db00 msgr2=0x7fca501538e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:54.006 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.988+0000 7fca4f7fe700 1 --2- 172.21.15.192:0/1658885917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca5009db00 0x7fca501538e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:54.007 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.988+0000 7fca4f7fe700 1 -- 172.21.15.192:0/1658885917 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca50160b10 con 0x7fca50154fd0 2020-11-20T11:47:54.007 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.988+0000 7fca54be7700 1 --2- 172.21.15.192:0/1658885917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca5009db00 0x7fca501538e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:47:54.007 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.988+0000 7fca4f7fe700 1 --2- 172.21.15.192:0/1658885917 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca50154fd0 0x7fca5009d610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fca4000faa0 tx=0x7fca40007bb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:47:54.007 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.988+0000 7fca2ffff700 1 -- 172.21.15.192:0/1658885917 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca40007e20 con 0x7fca50154fd0 2020-11-20T11:47:54.007 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.988+0000 7fca2ffff700 1 -- 172.21.15.192:0/1658885917 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4000d850 con 0x7fca50154fd0 2020-11-20T11:47:54.008 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.988+0000 7fca553e8700 1 -- 172.21.15.192:0/1658885917 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca50160db0 con 0x7fca50154fd0 2020-11-20T11:47:54.008 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.988+0000 7fca2ffff700 1 -- 172.21.15.192:0/1658885917 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4000dbf0 con 0x7fca50154fd0 2020-11-20T11:47:54.008 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.988+0000 7fca553e8700 1 -- 172.21.15.192:0/1658885917 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca50164800 con 0x7fca50154fd0 2020-11-20T11:47:54.009 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.989+0000 7fca553e8700 1 -- 172.21.15.192:0/1658885917 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca5005c850 con 0x7fca50154fd0 2020-11-20T11:47:54.009 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.990+0000 7fca2ffff700 1 -- 172.21.15.192:0/1658885917 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 3) v1 ==== 101030+0+0 (secure 0 0 0) 0x7fca4001b030 con 0x7fca50154fd0 2020-11-20T11:47:54.010 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.990+0000 7fca2ffff700 1 --2- 172.21.15.192:0/1658885917 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fca280805c0 0x7fca28082a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:47:54.010 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.990+0000 7fca2ffff700 1 -- 172.21.15.192:0/1658885917 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2534+0+0 (secure 0 0 0) 0x7fca400a0ec0 con 0x7fca50154fd0 2020-11-20T11:47:54.010 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.990+0000 7fca4ffff700 1 --2- 172.21.15.192:0/1658885917 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fca280805c0 0x7fca28082a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:47:54.011 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.991+0000 7fca4ffff700 1 --2- 172.21.15.192:0/1658885917 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fca280805c0 0x7fca28082a80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fca4400cb60 tx=0x7fca44015000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:47:54.011 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:53.994+0000 7fca2ffff700 1 -- 172.21.15.192:0/1658885917 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fca40045fd0 con 0x7fca50154fd0 2020-11-20T11:47:54.105 INFO:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:47:54.107 INFO:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:47:54.112 INFO:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:47:54.142 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:54.139+0000 7fca553e8700 1 -- 172.21.15.192:0/1658885917 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca50161210 con 0x7fca50154fd0 2020-11-20T11:47:54.143 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:54.139+0000 7fca2ffff700 1 -- 172.21.15.192:0/1658885917 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+11483 (secure 0 0 0) 0x7fca4007aad0 con 0x7fca50154fd0 2020-11-20T11:47:54.143 INFO:teuthology.misc.health.smithi192.stdout: 2020-11-20T11:47:54.143 INFO:teuthology.misc.health.smithi192.stdout:{"epoch":14,"fsid":"4871390d-d110-4379-8302-5810d7b54f34","created":"2020-11-20T11:47:49.059675+0000","modified":"2020-11-20T11:47:52.604347+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:47:52.327778+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"77a5e1d9-0fb0-450c-872e-4aee77dede49","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"564330c6-5c45-4ef6-8718-bbfa97848e6e","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"128ddb77-579b-4fa3-a0cb-7465ad959f3f","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4668cfdf-d172-4f30-95b8-ac842108a520","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c4bc8ba5-0d22-49f5-97a6-2ca71e3a8c62","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2d15f1db-e580-4715-9728-8fe5dd7e34d2","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a659da2b-bdce-42ac-8b30-b8c69b4c7041","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d6e41ac5-bab7-49e2-a17a-ef794bcc4a09","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"c4907993-7513-4162-974f-07dcb0a260a7","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"3523676f-c9b8-47ae-86c0-4930dca17831","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"88d5c251-0bb1-4624-8fa2-7f3b74bd1bf1","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"31f650d6-ba1e-4f29-92ff-6abee04c0f12","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:47:54.145 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:54.141+0000 7fca553e8700 1 -- 172.21.15.192:0/1658885917 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fca280805c0 msgr2=0x7fca28082a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:54.145 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:54.141+0000 7fca553e8700 1 --2- 172.21.15.192:0/1658885917 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fca280805c0 0x7fca28082a80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fca4400cb60 tx=0x7fca44015000).stop 2020-11-20T11:47:54.145 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:54.141+0000 7fca553e8700 1 -- 172.21.15.192:0/1658885917 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca50154fd0 msgr2=0x7fca5009d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:47:54.145 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:54.141+0000 7fca553e8700 1 --2- 172.21.15.192:0/1658885917 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca50154fd0 0x7fca5009d610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fca4000faa0 tx=0x7fca40007bb0).stop 2020-11-20T11:47:54.145 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:54.141+0000 7fca553e8700 1 -- 172.21.15.192:0/1658885917 shutdown_connections 2020-11-20T11:47:54.146 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:54.141+0000 7fca553e8700 1 --2- 172.21.15.192:0/1658885917 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fca280805c0 0x7fca28082a80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:54.146 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:54.141+0000 7fca553e8700 1 --2- 172.21.15.192:0/1658885917 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fca5009db00 0x7fca501538e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:54.146 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:54.141+0000 7fca553e8700 1 --2- 172.21.15.192:0/1658885917 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca3c003900 0x7fca500c0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:54.146 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:54.141+0000 7fca553e8700 1 --2- 172.21.15.192:0/1658885917 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca50154fd0 0x7fca5009d610 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:47:54.147 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:54.141+0000 7fca553e8700 1 -- 172.21.15.192:0/1658885917 >> 172.21.15.192:0/1658885917 conn(0x7fca500c8330 msgr2=0x7fca5014d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:47:54.147 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:54.141+0000 7fca553e8700 1 -- 172.21.15.192:0/1658885917 shutdown_connections 2020-11-20T11:47:54.147 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:47:54.141+0000 7fca553e8700 1 -- 172.21.15.192:0/1658885917 wait complete. 2020-11-20T11:47:54.155 DEBUG:teuthology.misc:0 of 12 OSDs are up 2020-11-20T11:47:54.552 INFO:tasks.ceph.osd.3.smithi192.stderr:2020-11-20T11:47:54.549+0000 7fc0c7bbbf40 -1 osd.3 0 log_to_monitors {default=true} 2020-11-20T11:47:54.571 INFO:tasks.ceph.osd.6.smithi192.stderr:2020-11-20T11:47:54.568+0000 7fe03786cf40 -1 osd.6 0 log_to_monitors {default=true} 2020-11-20T11:47:54.573 INFO:tasks.ceph.osd.1.smithi146.stderr:2020-11-20T11:47:54.569+0000 7fbf2882ef40 -1 osd.1 0 log_to_monitors {default=true} 2020-11-20T11:47:54.583 INFO:tasks.ceph.osd.4.smithi146.stderr:2020-11-20T11:47:54.579+0000 7fb1e704ef40 -1 osd.4 0 log_to_monitors {default=true} 2020-11-20T11:47:54.584 INFO:tasks.ceph.osd.9.smithi192.stderr:2020-11-20T11:47:54.581+0000 7f7cc7d18f40 -1 osd.9 0 log_to_monitors {default=true} 2020-11-20T11:47:54.586 INFO:tasks.ceph.osd.0.smithi192.stderr:2020-11-20T11:47:54.583+0000 7f79b959af40 -1 osd.0 0 log_to_monitors {default=true} 2020-11-20T11:47:54.589 INFO:tasks.ceph.osd.5.smithi087.stderr:2020-11-20T11:47:54.587+0000 7fd93c99ef40 -1 osd.5 0 log_to_monitors {default=true} 2020-11-20T11:47:54.601 INFO:tasks.ceph.osd.7.smithi146.stderr:2020-11-20T11:47:54.598+0000 7f7999fc4f40 -1 osd.7 0 log_to_monitors {default=true} 2020-11-20T11:47:54.604 INFO:tasks.ceph.osd.11.smithi087.stderr:2020-11-20T11:47:54.601+0000 7efe0edb5f40 -1 osd.11 0 log_to_monitors {default=true} 2020-11-20T11:47:54.615 INFO:tasks.ceph.osd.10.smithi146.stderr:2020-11-20T11:47:54.611+0000 7f0a5ae65f40 -1 osd.10 0 log_to_monitors {default=true} 2020-11-20T11:47:54.616 INFO:tasks.ceph.osd.2.smithi087.stderr:2020-11-20T11:47:54.614+0000 7fd547667f40 -1 osd.2 0 log_to_monitors {default=true} 2020-11-20T11:47:54.631 INFO:tasks.ceph.osd.8.smithi087.stderr:2020-11-20T11:47:54.628+0000 7ff5dc41df40 -1 osd.8 0 log_to_monitors {default=true} 2020-11-20T11:47:56.318 INFO:tasks.ceph.osd.8.smithi087.stderr:2020-11-20T11:47:56.315+0000 7ff5d2ba6700 -1 osd.8 0 waiting for initial osdmap 2020-11-20T11:47:56.319 INFO:tasks.ceph.osd.6.smithi192.stderr:2020-11-20T11:47:56.316+0000 7fe02dff5700 -1 osd.6 0 waiting for initial osdmap 2020-11-20T11:47:56.323 INFO:tasks.ceph.osd.7.smithi146.stderr:2020-11-20T11:47:56.320+0000 7f799074d700 -1 osd.7 0 waiting for initial osdmap 2020-11-20T11:47:56.323 INFO:tasks.ceph.osd.10.smithi146.stderr:2020-11-20T11:47:56.320+0000 7f0a515ee700 -1 osd.10 0 waiting for initial osdmap 2020-11-20T11:47:56.324 INFO:tasks.ceph.osd.11.smithi087.stderr:2020-11-20T11:47:56.321+0000 7efe0553e700 -1 osd.11 0 waiting for initial osdmap 2020-11-20T11:47:56.324 INFO:tasks.ceph.osd.1.smithi146.stderr:2020-11-20T11:47:56.321+0000 7fbf1efb7700 -1 osd.1 0 waiting for initial osdmap 2020-11-20T11:47:56.325 INFO:tasks.ceph.osd.3.smithi192.stderr:2020-11-20T11:47:56.321+0000 7fc0be344700 -1 osd.3 0 waiting for initial osdmap 2020-11-20T11:47:56.325 INFO:tasks.ceph.osd.9.smithi192.stderr:2020-11-20T11:47:56.322+0000 7f7cbe4a1700 -1 osd.9 0 waiting for initial osdmap 2020-11-20T11:47:56.326 INFO:tasks.ceph.osd.5.smithi087.stderr:2020-11-20T11:47:56.321+0000 7fd933127700 -1 osd.5 0 waiting for initial osdmap 2020-11-20T11:47:56.326 INFO:tasks.ceph.osd.2.smithi087.stderr:2020-11-20T11:47:56.321+0000 7fd53ddf0700 -1 osd.2 0 waiting for initial osdmap 2020-11-20T11:47:56.326 INFO:tasks.ceph.osd.0.smithi192.stderr:2020-11-20T11:47:56.322+0000 7f79afd23700 -1 osd.0 0 waiting for initial osdmap 2020-11-20T11:47:56.327 INFO:tasks.ceph.osd.4.smithi146.stderr:2020-11-20T11:47:56.324+0000 7fb1dd7d7700 -1 osd.4 0 waiting for initial osdmap 2020-11-20T11:48:01.363 INFO:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-11-20T11:48:01.474 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.470+0000 7f7f0b27b700 1 Processor -- start 2020-11-20T11:48:01.474 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.470+0000 7f7f0b27b700 1 -- start start 2020-11-20T11:48:01.479 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.471+0000 7f7f0b27b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7f0409bd40 0x7f7f040bf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:01.480 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.471+0000 7f7f0b27b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7f040662f0 0x7f7f04067060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:01.480 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.471+0000 7f7f0b27b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f04066c10 con 0x7f7f040bf230 2020-11-20T11:48:01.480 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.471+0000 7f7f0b27b700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f04066770 con 0x7f7f0409bd40 2020-11-20T11:48:01.480 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.471+0000 7f7f0b27b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f04066970 con 0x7f7f040662f0 2020-11-20T11:48:01.480 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.471+0000 7f7f09017700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f7f040bf230 0x7f7f0414eb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51272/0 (socket says 172.21.15.192:51272) 2020-11-20T11:48:01.481 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.471+0000 7f7f09017700 1 -- 172.21.15.192:0/3477881318 learned_addr learned my addr 172.21.15.192:0/3477881318 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:01.481 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.472+0000 7f7f09818700 1 --2- 172.21.15.192:0/3477881318 >> v2:172.21.15.146:3300/0 conn(0x7f7f040662f0 0x7f7f04067060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:01.482 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.472+0000 7f7f08816700 1 --2- 172.21.15.192:0/3477881318 >> v2:172.21.15.87:3300/0 conn(0x7f7f0409bd40 0x7f7f040bf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:01.482 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.472+0000 7f7ef3fff700 1 -- 172.21.15.192:0/3477881318 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1618419719 0 0) 0x7f7f04066c10 con 0x7f7f040bf230 2020-11-20T11:48:01.482 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.472+0000 7f7ef3fff700 1 -- 172.21.15.192:0/3477881318 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7eec003280 con 0x7f7f040bf230 2020-11-20T11:48:01.482 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.472+0000 7f7ef3fff700 1 -- 172.21.15.192:0/3477881318 <== mon.2 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2704528614 0 0) 0x7f7eec003280 con 0x7f7f040bf230 2020-11-20T11:48:01.483 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.472+0000 7f7f09818700 1 -- 172.21.15.192:0/3477881318 >> v2:172.21.15.87:3300/0 conn(0x7f7f0409bd40 msgr2=0x7f7f040bf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:01.483 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.472+0000 7f7f09818700 1 --2- 172.21.15.192:0/3477881318 >> v2:172.21.15.87:3300/0 conn(0x7f7f0409bd40 0x7f7f040bf610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:01.483 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.472+0000 7f7f09818700 1 -- 172.21.15.192:0/3477881318 >> v1:172.21.15.192:6789/0 conn(0x7f7f040bf230 legacy=0x7f7f0414eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:01.483 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.472+0000 7f7f09818700 1 -- 172.21.15.192:0/3477881318 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f04063950 con 0x7f7f040662f0 2020-11-20T11:48:01.483 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.472+0000 7f7f09818700 1 --2- 172.21.15.192:0/3477881318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f040662f0 0x7f7f04067060 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f7f040c3560 tx=0x7f7efc009220).ready entity=mon.1 client_cookie=a2b72dc8c563898d server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:01.484 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.472+0000 7f7ef3fff700 1 -- 172.21.15.192:0/3477881318 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f00001520 con 0x7f7f040662f0 2020-11-20T11:48:01.484 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.472+0000 7f7ef3fff700 1 -- 172.21.15.192:0/3477881318 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7efc00b710 con 0x7f7f040662f0 2020-11-20T11:48:01.484 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.472+0000 7f7ef3fff700 1 -- 172.21.15.192:0/3477881318 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc00ba90 con 0x7f7f040662f0 2020-11-20T11:48:01.484 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.473+0000 7f7f0b27b700 1 -- 172.21.15.192:0/3477881318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f040662f0 msgr2=0x7f7f04067060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:01.485 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.473+0000 7f7f0b27b700 1 --2- 172.21.15.192:0/3477881318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f040662f0 0x7f7f04067060 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f7f040c3560 tx=0x7f7efc009220).stop 2020-11-20T11:48:01.485 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.473+0000 7f7f0b27b700 1 -- 172.21.15.192:0/3477881318 shutdown_connections 2020-11-20T11:48:01.485 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.473+0000 7f7f0b27b700 1 --2- 172.21.15.192:0/3477881318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f040662f0 0x7f7f04067060 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:01.486 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.473+0000 7f7f0b27b700 1 --2- 172.21.15.192:0/3477881318 >> v2:172.21.15.87:3300/0 conn(0x7f7f0409bd40 0x7f7f040bf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:01.486 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.473+0000 7f7f0b27b700 1 -- 172.21.15.192:0/3477881318 >> 172.21.15.192:0/3477881318 conn(0x7f7f040c35c0 msgr2=0x7f7f040c39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:01.486 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.473+0000 7f7f0b27b700 1 -- 172.21.15.192:0/3477881318 shutdown_connections 2020-11-20T11:48:01.487 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.473+0000 7f7f0b27b700 1 -- 172.21.15.192:0/3477881318 wait complete. 2020-11-20T11:48:01.487 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.474+0000 7f7f0b27b700 1 Processor -- start 2020-11-20T11:48:01.488 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.474+0000 7f7f0b27b700 1 -- start start 2020-11-20T11:48:01.488 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.475+0000 7f7f0b27b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f040662f0 0x7f7f04162090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:01.488 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.475+0000 7f7f0b27b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f0409bd40 0x7f7f041497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:01.489 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.475+0000 7f7f0b27b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f040bf230 0x7f7f0408f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:01.489 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.475+0000 7f7f0b27b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f040c2be0 con 0x7f7f040662f0 2020-11-20T11:48:01.489 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.475+0000 7f7f0b27b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f04162580 con 0x7f7f040bf230 2020-11-20T11:48:01.489 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.475+0000 7f7f0b27b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f040bdf30 con 0x7f7f0409bd40 2020-11-20T11:48:01.489 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.475+0000 7f7f08816700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f0409bd40 0x7f7f041497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:01.490 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.475+0000 7f7f08816700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f0409bd40 0x7f7f041497a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48612/0 (socket says 172.21.15.192:48612) 2020-11-20T11:48:01.490 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.475+0000 7f7f08816700 1 -- 172.21.15.192:0/1666904625 learned_addr learned my addr 172.21.15.192:0/1666904625 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:01.490 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.475+0000 7f7f09818700 1 --2- 172.21.15.192:0/1666904625 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f040bf230 0x7f7f0408f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:01.490 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.475+0000 7f7f09017700 1 --2- 172.21.15.192:0/1666904625 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f040662f0 0x7f7f04162090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:01.491 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.475+0000 7f7f08816700 1 -- 172.21.15.192:0/1666904625 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f040bf230 msgr2=0x7f7f0408f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:01.491 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.475+0000 7f7f08816700 1 --2- 172.21.15.192:0/1666904625 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f040bf230 0x7f7f0408f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:01.491 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.475+0000 7f7f08816700 1 -- 172.21.15.192:0/1666904625 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f040662f0 msgr2=0x7f7f04162090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:01.491 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.475+0000 7f7f08816700 1 --2- 172.21.15.192:0/1666904625 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f040662f0 0x7f7f04162090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:01.491 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.475+0000 7f7f08816700 1 -- 172.21.15.192:0/1666904625 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f040be1d0 con 0x7f7f0409bd40 2020-11-20T11:48:01.492 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.475+0000 7f7f09017700 1 --2- 172.21.15.192:0/1666904625 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f040662f0 0x7f7f04162090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:48:01.492 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.476+0000 7f7f08816700 1 --2- 172.21.15.192:0/1666904625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f0409bd40 0x7f7f041497a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f7ef400ebd0 tx=0x7f7ef4006e30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:01.492 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.476+0000 7f7ef17fa700 1 -- 172.21.15.192:0/1666904625 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef400c920 con 0x7f7f0409bd40 2020-11-20T11:48:01.492 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.476+0000 7f7ef17fa700 1 -- 172.21.15.192:0/1666904625 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef400ca80 con 0x7f7f0409bd40 2020-11-20T11:48:01.493 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.476+0000 7f7f0b27b700 1 -- 172.21.15.192:0/1666904625 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f040be470 con 0x7f7f0409bd40 2020-11-20T11:48:01.493 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.476+0000 7f7ef17fa700 1 -- 172.21.15.192:0/1666904625 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef400ce00 con 0x7f7f0409bd40 2020-11-20T11:48:01.493 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.476+0000 7f7f0b27b700 1 -- 172.21.15.192:0/1666904625 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f040be9b0 con 0x7f7f0409bd40 2020-11-20T11:48:01.493 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.477+0000 7f7f0b27b700 1 -- 172.21.15.192:0/1666904625 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f04069240 con 0x7f7f0409bd40 2020-11-20T11:48:01.494 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.477+0000 7f7ef17fa700 1 -- 172.21.15.192:0/1666904625 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f7ef4012600 con 0x7f7f0409bd40 2020-11-20T11:48:01.495 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.478+0000 7f7ef17fa700 1 --2- 172.21.15.192:0/1666904625 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f7edc080670 0x7f7edc082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:01.495 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.478+0000 7f7f09017700 1 --2- 172.21.15.192:0/1666904625 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f7edc080670 0x7f7edc082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:01.495 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.478+0000 7f7ef17fa700 1 -- 172.21.15.192:0/1666904625 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6740+0+0 (secure 0 0 0) 0x7f7ef40a2890 con 0x7f7f0409bd40 2020-11-20T11:48:01.495 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.478+0000 7f7f09017700 1 --2- 172.21.15.192:0/1666904625 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f7edc080670 0x7f7edc082b30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f7f00001ed0 tx=0x7f7f00009040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:01.496 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.482+0000 7f7ef17fa700 1 -- 172.21.15.192:0/1666904625 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f7ef4077810 con 0x7f7f0409bd40 2020-11-20T11:48:01.625 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.622+0000 7f7f0b27b700 1 -- 172.21.15.192:0/1666904625 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f0405ca80 con 0x7f7f0409bd40 2020-11-20T11:48:01.626 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.623+0000 7f7ef17fa700 1 -- 172.21.15.192:0/1666904625 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16857 (secure 0 0 0) 0x7f7ef407ae30 con 0x7f7f0409bd40 2020-11-20T11:48:01.626 INFO:teuthology.misc.health.smithi192.stdout: 2020-11-20T11:48:01.626 INFO:teuthology.misc.health.smithi192.stdout:{"epoch":19,"fsid":"4871390d-d110-4379-8302-5810d7b54f34","created":"2020-11-20T11:47:49.059675+0000","modified":"2020-11-20T11:47:59.331433+0000","last_up_change":"2020-11-20T11:47:57.317253+0000","last_in_change":"2020-11-20T11:47:57.317253+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:47:52.327778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"77a5e1d9-0fb0-450c-872e-4aee77dede49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":23242},{"type":"v1","addr":"172.21.15.192:6827","nonce":23242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":23242},{"type":"v1","addr":"172.21.15.192:6829","nonce":23242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":23242},{"type":"v1","addr":"172.21.15.192:6833","nonce":23242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":23242},{"type":"v1","addr":"172.21.15.192:6831","nonce":23242}]},"public_addr":"172.21.15.192:6827/23242","cluster_addr":"172.21.15.192:6829/23242","heartbeat_back_addr":"172.21.15.192:6833/23242","heartbeat_front_addr":"172.21.15.192:6831/23242","state":["exists","up"]},{"osd":1,"uuid":"564330c6-5c45-4ef6-8718-bbfa97848e6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":22856},{"type":"v1","addr":"172.21.15.146:6801","nonce":22856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":22856},{"type":"v1","addr":"172.21.15.146:6803","nonce":22856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":22856},{"type":"v1","addr":"172.21.15.146:6807","nonce":22856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":22856},{"type":"v1","addr":"172.21.15.146:6805","nonce":22856}]},"public_addr":"172.21.15.146:6801/22856","cluster_addr":"172.21.15.146:6803/22856","heartbeat_back_addr":"172.21.15.146:6807/22856","heartbeat_front_addr":"172.21.15.146:6805/22856","state":["exists","up"]},{"osd":2,"uuid":"128ddb77-579b-4fa3-a0cb-7465ad959f3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6815","nonce":23326},{"type":"v1","addr":"172.21.15.87:6817","nonce":23326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":23326},{"type":"v1","addr":"172.21.15.87:6819","nonce":23326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":23326},{"type":"v1","addr":"172.21.15.87:6823","nonce":23326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":23326},{"type":"v1","addr":"172.21.15.87:6821","nonce":23326}]},"public_addr":"172.21.15.87:6817/23326","cluster_addr":"172.21.15.87:6819/23326","heartbeat_back_addr":"172.21.15.87:6823/23326","heartbeat_front_addr":"172.21.15.87:6821/23326","state":["exists","up"]},{"osd":3,"uuid":"4668cfdf-d172-4f30-95b8-ac842108a520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":23243},{"type":"v1","addr":"172.21.15.192:6803","nonce":23243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":23243},{"type":"v1","addr":"172.21.15.192:6805","nonce":23243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":23243},{"type":"v1","addr":"172.21.15.192:6809","nonce":23243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":23243},{"type":"v1","addr":"172.21.15.192:6807","nonce":23243}]},"public_addr":"172.21.15.192:6803/23243","cluster_addr":"172.21.15.192:6805/23243","heartbeat_back_addr":"172.21.15.192:6809/23243","heartbeat_front_addr":"172.21.15.192:6807/23243","state":["exists","up"]},{"osd":4,"uuid":"c4bc8ba5-0d22-49f5-97a6-2ca71e3a8c62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":22857},{"type":"v1","addr":"172.21.15.146:6809","nonce":22857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":22857},{"type":"v1","addr":"172.21.15.146:6811","nonce":22857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":22857},{"type":"v1","addr":"172.21.15.146:6815","nonce":22857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":22857},{"type":"v1","addr":"172.21.15.146:6813","nonce":22857}]},"public_addr":"172.21.15.146:6809/22857","cluster_addr":"172.21.15.146:6811/22857","heartbeat_back_addr":"172.21.15.146:6815/22857","heartbeat_front_addr":"172.21.15.146:6813/22857","state":["exists","up"]},{"osd":5,"uuid":"2d15f1db-e580-4715-9728-8fe5dd7e34d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":23316},{"type":"v1","addr":"172.21.15.87:6801","nonce":23316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":23316},{"type":"v1","addr":"172.21.15.87:6803","nonce":23316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":23316},{"type":"v1","addr":"172.21.15.87:6807","nonce":23316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":23316},{"type":"v1","addr":"172.21.15.87:6805","nonce":23316}]},"public_addr":"172.21.15.87:6801/23316","cluster_addr":"172.21.15.87:6803/23316","heartbeat_back_addr":"172.21.15.87:6807/23316","heartbeat_front_addr":"172.21.15.87:6805/23316","state":["exists","up"]},{"osd":6,"uuid":"a659da2b-bdce-42ac-8b30-b8c69b4c7041","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":23246},{"type":"v1","addr":"172.21.15.192:6811","nonce":23246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":23246},{"type":"v1","addr":"172.21.15.192:6813","nonce":23246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":23246},{"type":"v1","addr":"172.21.15.192:6817","nonce":23246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":23246},{"type":"v1","addr":"172.21.15.192:6815","nonce":23246}]},"public_addr":"172.21.15.192:6811/23246","cluster_addr":"172.21.15.192:6813/23246","heartbeat_back_addr":"172.21.15.192:6817/23246","heartbeat_front_addr":"172.21.15.192:6815/23246","state":["exists","up"]},{"osd":7,"uuid":"d6e41ac5-bab7-49e2-a17a-ef794bcc4a09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":22858},{"type":"v1","addr":"172.21.15.146:6818","nonce":22858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":22858},{"type":"v1","addr":"172.21.15.146:6822","nonce":22858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":22858},{"type":"v1","addr":"172.21.15.146:6830","nonce":22858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":22858},{"type":"v1","addr":"172.21.15.146:6826","nonce":22858}]},"public_addr":"172.21.15.146:6818/22858","cluster_addr":"172.21.15.146:6822/22858","heartbeat_back_addr":"172.21.15.146:6830/22858","heartbeat_front_addr":"172.21.15.146:6826/22858","state":["exists","up"]},{"osd":8,"uuid":"c4907993-7513-4162-974f-07dcb0a260a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":23333},{"type":"v1","addr":"172.21.15.87:6825","nonce":23333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":23333},{"type":"v1","addr":"172.21.15.87:6827","nonce":23333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":23333},{"type":"v1","addr":"172.21.15.87:6831","nonce":23333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":23333},{"type":"v1","addr":"172.21.15.87:6829","nonce":23333}]},"public_addr":"172.21.15.87:6825/23333","cluster_addr":"172.21.15.87:6827/23333","heartbeat_back_addr":"172.21.15.87:6831/23333","heartbeat_front_addr":"172.21.15.87:6829/23333","state":["exists","up"]},{"osd":9,"uuid":"3523676f-c9b8-47ae-86c0-4930dca17831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":23254},{"type":"v1","addr":"172.21.15.192:6819","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":23254},{"type":"v1","addr":"172.21.15.192:6821","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":23254},{"type":"v1","addr":"172.21.15.192:6825","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":23254},{"type":"v1","addr":"172.21.15.192:6823","nonce":23254}]},"public_addr":"172.21.15.192:6819/23254","cluster_addr":"172.21.15.192:6821/23254","heartbeat_back_addr":"172.21.15.192:6825/23254","heartbeat_front_addr":"172.21.15.192:6823/23254","state":["exists","up"]},{"osd":10,"uuid":"88d5c251-0bb1-4624-8fa2-7f3b74bd1bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":22859},{"type":"v1","addr":"172.21.15.146:6819","nonce":22859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6821","nonce":22859},{"type":"v1","addr":"172.21.15.146:6823","nonce":22859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":22859},{"type":"v1","addr":"172.21.15.146:6831","nonce":22859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6825","nonce":22859},{"type":"v1","addr":"172.21.15.146:6827","nonce":22859}]},"public_addr":"172.21.15.146:6819/22859","cluster_addr":"172.21.15.146:6823/22859","heartbeat_back_addr":"172.21.15.146:6831/22859","heartbeat_front_addr":"172.21.15.146:6827/22859","state":["exists","up"]},{"osd":11,"uuid":"31f650d6-ba1e-4f29-92ff-6abee04c0f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":23317},{"type":"v1","addr":"172.21.15.87:6809","nonce":23317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":23317},{"type":"v1","addr":"172.21.15.87:6811","nonce":23317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":23317},{"type":"v1","addr":"172.21.15.87:6816","nonce":23317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":23317},{"type":"v1","addr":"172.21.15.87:6813","nonce":23317}]},"public_addr":"172.21.15.87:6809/23317","cluster_addr":"172.21.15.87:6811/23317","heartbeat_back_addr":"172.21.15.87:6816/23317","heartbeat_front_addr":"172.21.15.87:6813/23317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.538863+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.552293+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.585265+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.505194+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.550032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.558089+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.565622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.587102+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.654330+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.599072+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.645833+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.596236+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:48:01.628 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.624+0000 7f7f0b27b700 1 -- 172.21.15.192:0/1666904625 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f7edc080670 msgr2=0x7f7edc082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:01.628 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.624+0000 7f7f0b27b700 1 --2- 172.21.15.192:0/1666904625 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f7edc080670 0x7f7edc082b30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f7f00001ed0 tx=0x7f7f00009040).stop 2020-11-20T11:48:01.628 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.624+0000 7f7f0b27b700 1 -- 172.21.15.192:0/1666904625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f0409bd40 msgr2=0x7f7f041497a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:01.628 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.624+0000 7f7f0b27b700 1 --2- 172.21.15.192:0/1666904625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f0409bd40 0x7f7f041497a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f7ef400ebd0 tx=0x7f7ef4006e30).stop 2020-11-20T11:48:01.628 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.624+0000 7f7f0b27b700 1 -- 172.21.15.192:0/1666904625 shutdown_connections 2020-11-20T11:48:01.629 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.624+0000 7f7f0b27b700 1 --2- 172.21.15.192:0/1666904625 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f7edc080670 0x7f7edc082b30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:01.629 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.624+0000 7f7f0b27b700 1 --2- 172.21.15.192:0/1666904625 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f040bf230 0x7f7f0408f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:01.629 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.624+0000 7f7f0b27b700 1 --2- 172.21.15.192:0/1666904625 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f040662f0 0x7f7f04162090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:01.629 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.624+0000 7f7f0b27b700 1 --2- 172.21.15.192:0/1666904625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f0409bd40 0x7f7f041497a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:01.630 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.624+0000 7f7f0b27b700 1 -- 172.21.15.192:0/1666904625 >> 172.21.15.192:0/1666904625 conn(0x7f7f040c35c0 msgr2=0x7f7f04067a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:01.630 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.624+0000 7f7f0b27b700 1 -- 172.21.15.192:0/1666904625 shutdown_connections 2020-11-20T11:48:01.630 INFO:teuthology.misc.health.smithi192.stderr:2020-11-20T11:48:01.624+0000 7f7f0b27b700 1 -- 172.21.15.192:0/1666904625 wait complete. 2020-11-20T11:48:01.638 DEBUG:teuthology.misc:12 of 12 OSDs are up 2020-11-20T11:48:01.638 INFO:tasks.ceph:Creating RBD pool 2020-11-20T11:48:01.639 INFO:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd pool create rbd 8 2020-11-20T11:48:01.747 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.743+0000 7f781a853700 1 Processor -- start 2020-11-20T11:48:01.747 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.743+0000 7f781a853700 1 -- start start 2020-11-20T11:48:01.752 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.744+0000 7f781a853700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f78140bf540 0x7f7814151be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:01.752 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.744+0000 7f781a853700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7814152680 con 0x7f78141537d0 2020-11-20T11:48:01.753 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.744+0000 7f781a853700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7814064730 con 0x7f78140bf160 2020-11-20T11:48:01.753 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.744+0000 7f781a853700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78141520d0 con 0x7f78140bf540 2020-11-20T11:48:01.753 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.744+0000 7f7813fff700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f78140bf160 0x7f7814062740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51286/0 (socket says 172.21.15.192:51286) 2020-11-20T11:48:01.753 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.744+0000 7f7813fff700 1 -- 172.21.15.192:0/3228280309 learned_addr learned my addr 172.21.15.192:0/3228280309 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:01.754 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.745+0000 7f78137fe700 1 --2- 172.21.15.192:0/3228280309 >> v2:172.21.15.192:3300/0 conn(0x7f78140bf540 0x7f7814151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:01.754 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.745+0000 7f7812ffd700 1 -- 172.21.15.192:0/3228280309 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3363498124 0 0) 0x7f7814064730 con 0x7f78140bf160 2020-11-20T11:48:01.754 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.745+0000 7f7812ffd700 1 -- 172.21.15.192:0/3228280309 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7800003280 con 0x7f78140bf160 2020-11-20T11:48:01.754 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.745+0000 7f78137fe700 1 -- 172.21.15.192:0/3228280309 >> v1:172.21.15.192:6789/0 conn(0x7f78140bf160 legacy=0x7f7814062740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:01.755 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.745+0000 7f78137fe700 1 -- 172.21.15.192:0/3228280309 >> v1:172.21.15.146:6789/0 conn(0x7f78141537d0 legacy=0x7f7814153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:01.755 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.745+0000 7f78137fe700 1 -- 172.21.15.192:0/3228280309 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78141528b0 con 0x7f78140bf540 2020-11-20T11:48:01.756 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.745+0000 7f78137fe700 1 --2- 172.21.15.192:0/3228280309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78140bf540 0x7f7814151be0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f780800ba30 tx=0x7f7808006e30).ready entity=mon.2 client_cookie=3f3e5d16b1aa71d2 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:01.756 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.745+0000 7f7812ffd700 1 -- 172.21.15.192:0/3228280309 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78080097f0 con 0x7f78140bf540 2020-11-20T11:48:01.756 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.745+0000 7f7812ffd700 1 -- 172.21.15.192:0/3228280309 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7808000e90 con 0x7f78140bf540 2020-11-20T11:48:01.756 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.745+0000 7f7812ffd700 1 -- 172.21.15.192:0/3228280309 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7808009b60 con 0x7f78140bf540 2020-11-20T11:48:01.757 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.745+0000 7f781a853700 1 -- 172.21.15.192:0/3228280309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78140bf540 msgr2=0x7f7814151be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:01.757 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.745+0000 7f781a853700 1 --2- 172.21.15.192:0/3228280309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78140bf540 0x7f7814151be0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f780800ba30 tx=0x7f7808006e30).stop 2020-11-20T11:48:01.757 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.746+0000 7f781a853700 1 -- 172.21.15.192:0/3228280309 shutdown_connections 2020-11-20T11:48:01.757 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.746+0000 7f781a853700 1 --2- 172.21.15.192:0/3228280309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78140bf540 0x7f7814151be0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:01.757 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.746+0000 7f781a853700 1 -- 172.21.15.192:0/3228280309 >> 172.21.15.192:0/3228280309 conn(0x7f78140601b0 msgr2=0x7f78140605c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:01.758 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.746+0000 7f781a853700 1 -- 172.21.15.192:0/3228280309 shutdown_connections 2020-11-20T11:48:01.758 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.746+0000 7f781a853700 1 -- 172.21.15.192:0/3228280309 wait complete. 2020-11-20T11:48:01.758 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.747+0000 7f781a853700 1 Processor -- start 2020-11-20T11:48:01.758 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.747+0000 7f781a853700 1 -- start start 2020-11-20T11:48:01.758 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.747+0000 7f781a853700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78140bf160 0x7f7814154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:01.759 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.748+0000 7f781a853700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78140bf540 0x7f7814110150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:01.759 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.748+0000 7f781a853700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78141537d0 0x7f7814163d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:01.759 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.748+0000 7f781a853700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78140c3720 con 0x7f78140bf540 2020-11-20T11:48:01.759 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.748+0000 7f781a853700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78140c39c0 con 0x7f78141537d0 2020-11-20T11:48:01.759 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.748+0000 7f781a853700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78140c3c60 con 0x7f78140bf160 2020-11-20T11:48:01.760 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.748+0000 7f7813fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78140bf160 0x7f7814154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:01.760 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.748+0000 7f7813fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78140bf160 0x7f7814154ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48624/0 (socket says 172.21.15.192:48624) 2020-11-20T11:48:01.760 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.748+0000 7f7813fff700 1 -- 172.21.15.192:0/2089466911 learned_addr learned my addr 172.21.15.192:0/2089466911 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:01.760 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.748+0000 7f7818df0700 1 --2- 172.21.15.192:0/2089466911 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78141537d0 0x7f7814163d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:01.761 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.748+0000 7f78137fe700 1 --2- 172.21.15.192:0/2089466911 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78140bf540 0x7f7814110150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:01.761 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.748+0000 7f7813fff700 1 -- 172.21.15.192:0/2089466911 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78141537d0 msgr2=0x7f7814163d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:01.761 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.748+0000 7f7813fff700 1 --2- 172.21.15.192:0/2089466911 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78141537d0 0x7f7814163d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:01.761 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.748+0000 7f7813fff700 1 -- 172.21.15.192:0/2089466911 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78140bf540 msgr2=0x7f7814110150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:01.761 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.748+0000 7f7813fff700 1 --2- 172.21.15.192:0/2089466911 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78140bf540 0x7f7814110150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:01.762 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.748+0000 7f7813fff700 1 -- 172.21.15.192:0/2089466911 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78140c3f00 con 0x7f78140bf160 2020-11-20T11:48:01.762 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.748+0000 7f7818df0700 1 --2- 172.21.15.192:0/2089466911 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78141537d0 0x7f7814163d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:48:01.762 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.748+0000 7f7813fff700 1 --2- 172.21.15.192:0/2089466911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78140bf160 0x7f7814154ef0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f780400c6e0 tx=0x7f78040028d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:01.763 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.748+0000 7f77f3fff700 1 -- 172.21.15.192:0/2089466911 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7804007320 con 0x7f78140bf160 2020-11-20T11:48:01.764 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.748+0000 7f77f3fff700 1 -- 172.21.15.192:0/2089466911 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7804005500 con 0x7f78140bf160 2020-11-20T11:48:01.764 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.748+0000 7f781a853700 1 -- 172.21.15.192:0/2089466911 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78140c41a0 con 0x7f78140bf160 2020-11-20T11:48:01.764 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.748+0000 7f77f3fff700 1 -- 172.21.15.192:0/2089466911 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7804005880 con 0x7f78140bf160 2020-11-20T11:48:01.764 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.748+0000 7f781a853700 1 -- 172.21.15.192:0/2089466911 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78141553e0 con 0x7f78140bf160 2020-11-20T11:48:01.765 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.749+0000 7f781a853700 1 -- 172.21.15.192:0/2089466911 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f781405ca80 con 0x7f78140bf160 2020-11-20T11:48:01.766 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.750+0000 7f77f3fff700 1 -- 172.21.15.192:0/2089466911 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f7804010030 con 0x7f78140bf160 2020-11-20T11:48:01.766 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.750+0000 7f77f3fff700 1 --2- 172.21.15.192:0/2089466911 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f77ec0806a0 0x7f77ec082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:01.766 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.750+0000 7f77f3fff700 1 -- 172.21.15.192:0/2089466911 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6740+0+0 (secure 0 0 0) 0x7f78040a2000 con 0x7f78140bf160 2020-11-20T11:48:01.766 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.750+0000 7f78137fe700 1 --2- 172.21.15.192:0/2089466911 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f77ec0806a0 0x7f77ec082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:01.767 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.751+0000 7f78137fe700 1 --2- 172.21.15.192:0/2089466911 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f77ec0806a0 0x7f77ec082b60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f78141558a0 tx=0x7f7808015000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:01.767 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.754+0000 7f77f3fff700 1 -- 172.21.15.192:0/2089466911 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f7804077090 con 0x7f78140bf160 2020-11-20T11:48:01.894 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:01.890+0000 7f781a853700 1 -- 172.21.15.192:0/2089466911 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f78140c2f00 con 0x7f78140bf160 2020-11-20T11:48:02.354 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.351+0000 7f77f3fff700 1 -- 172.21.15.192:0/2089466911 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v20) v1 ==== 109+0+0 (secure 0 0 0) 0x7f780407a6b0 con 0x7f78140bf160 2020-11-20T11:48:02.356 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.353+0000 7f781a853700 1 -- 172.21.15.192:0/2089466911 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f77ec0806a0 msgr2=0x7f77ec082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:02.356 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.353+0000 7f781a853700 1 --2- 172.21.15.192:0/2089466911 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f77ec0806a0 0x7f77ec082b60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f78141558a0 tx=0x7f7808015000).stop 2020-11-20T11:48:02.356 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.353+0000 7f781a853700 1 -- 172.21.15.192:0/2089466911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78140bf160 msgr2=0x7f7814154ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:02.357 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.353+0000 7f781a853700 1 --2- 172.21.15.192:0/2089466911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78140bf160 0x7f7814154ef0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f780400c6e0 tx=0x7f78040028d0).stop 2020-11-20T11:48:02.358 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.353+0000 7f781a853700 1 -- 172.21.15.192:0/2089466911 shutdown_connections 2020-11-20T11:48:02.358 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.353+0000 7f781a853700 1 --2- 172.21.15.192:0/2089466911 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f77ec0806a0 0x7f77ec082b60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:02.358 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.353+0000 7f781a853700 1 --2- 172.21.15.192:0/2089466911 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78141537d0 0x7f7814163d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:02.358 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.353+0000 7f781a853700 1 --2- 172.21.15.192:0/2089466911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78140bf160 0x7f7814154ef0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:02.359 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.353+0000 7f781a853700 1 --2- 172.21.15.192:0/2089466911 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f78140bf540 0x7f7814110150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:02.359 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.353+0000 7f781a853700 1 -- 172.21.15.192:0/2089466911 >> 172.21.15.192:0/2089466911 conn(0x7f78140601b0 msgr2=0x7f7814060590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:02.359 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.353+0000 7f781a853700 1 -- 172.21.15.192:0/2089466911 shutdown_connections 2020-11-20T11:48:02.359 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.353+0000 7f781a853700 1 -- 172.21.15.192:0/2089466911 wait complete. 2020-11-20T11:48:02.359 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'rbd' created 2020-11-20T11:48:02.368 INFO:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2020-11-20T11:48:02.480 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.476+0000 7f4eee80e700 1 Processor -- start 2020-11-20T11:48:02.480 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.477+0000 7f4eee80e700 1 -- start start 2020-11-20T11:48:02.482 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.477+0000 7f4eee80e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4ee8060370 0x7f4ee8060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:02.482 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.477+0000 7f4eee80e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4ee8150060 0x7f4ee8150490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:02.482 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.477+0000 7f4eee80e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ee8061740 con 0x7f4ee8064030 2020-11-20T11:48:02.483 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.477+0000 7f4eee80e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ee80619e0 con 0x7f4ee8150060 2020-11-20T11:48:02.483 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.477+0000 7f4eee80e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ee8061c80 con 0x7f4ee8060370 2020-11-20T11:48:02.483 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.478+0000 7f4eed80c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4ee8060370 0x7f4ee8060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:02.483 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.478+0000 7f4eed80c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4ee8060370 0x7f4ee8060750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48632/0 (socket says 172.21.15.192:48632) 2020-11-20T11:48:02.484 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.478+0000 7f4eed80c700 1 -- 172.21.15.192:0/397976741 learned_addr learned my addr 172.21.15.192:0/397976741 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:02.484 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.478+0000 7f4eee00d700 1 --2- 172.21.15.192:0/397976741 >> v2:172.21.15.146:3300/0 conn(0x7f4ee8150060 0x7f4ee8150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:02.484 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.478+0000 7f4eed80c700 1 -- 172.21.15.192:0/397976741 >> v2:172.21.15.146:3300/0 conn(0x7f4ee8150060 msgr2=0x7f4ee8150490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:02.485 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.478+0000 7f4eed80c700 1 --2- 172.21.15.192:0/397976741 >> v2:172.21.15.146:3300/0 conn(0x7f4ee8150060 0x7f4ee8150490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:02.485 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.478+0000 7f4eed80c700 1 -- 172.21.15.192:0/397976741 >> v1:172.21.15.87:6789/0 conn(0x7f4ee8064030 legacy=0x7f4ee80644a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:02.485 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.478+0000 7f4eed80c700 1 -- 172.21.15.192:0/397976741 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee8061f20 con 0x7f4ee8060370 2020-11-20T11:48:02.485 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.478+0000 7f4eed80c700 1 --2- 172.21.15.192:0/397976741 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ee8060370 0x7f4ee8060750 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f4ee805c6e0 tx=0x7f4ee4006ef0).ready entity=mon.2 client_cookie=4f5213f3edf0f87e server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:02.485 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.478+0000 7f4eec80a700 1 -- 172.21.15.192:0/397976741 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee400b8b0 con 0x7f4ee8060370 2020-11-20T11:48:02.486 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.478+0000 7f4eec80a700 1 -- 172.21.15.192:0/397976741 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee4000e90 con 0x7f4ee8060370 2020-11-20T11:48:02.486 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.478+0000 7f4eec80a700 1 -- 172.21.15.192:0/397976741 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee400bc20 con 0x7f4ee8060370 2020-11-20T11:48:02.486 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.478+0000 7f4eee80e700 1 -- 172.21.15.192:0/397976741 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ee8060370 msgr2=0x7f4ee8060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:02.486 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.478+0000 7f4eee80e700 1 --2- 172.21.15.192:0/397976741 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ee8060370 0x7f4ee8060750 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f4ee805c6e0 tx=0x7f4ee4006ef0).stop 2020-11-20T11:48:02.486 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.479+0000 7f4eee80e700 1 -- 172.21.15.192:0/397976741 shutdown_connections 2020-11-20T11:48:02.487 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.479+0000 7f4eee80e700 1 --2- 172.21.15.192:0/397976741 >> v2:172.21.15.146:3300/0 conn(0x7f4ee8150060 0x7f4ee8150490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:02.487 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.479+0000 7f4eee80e700 1 --2- 172.21.15.192:0/397976741 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ee8060370 0x7f4ee8060750 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:02.487 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.479+0000 7f4eee80e700 1 -- 172.21.15.192:0/397976741 >> 172.21.15.192:0/397976741 conn(0x7f4ee80c3c50 msgr2=0x7f4ee80c4060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:02.487 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.479+0000 7f4eee80e700 1 -- 172.21.15.192:0/397976741 shutdown_connections 2020-11-20T11:48:02.487 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.479+0000 7f4eee80e700 1 -- 172.21.15.192:0/397976741 wait complete. 2020-11-20T11:48:02.490 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.480+0000 7f4eee80e700 1 Processor -- start 2020-11-20T11:48:02.490 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.480+0000 7f4eee80e700 1 -- start start 2020-11-20T11:48:02.491 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.480+0000 7f4eee80e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ee8060370 0x7f4ee8160f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:02.491 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.480+0000 7f4eee80e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ee8064030 0x7f4ee814bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:02.491 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.480+0000 7f4eee80e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ee8150060 0x7f4ee814b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:02.491 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.480+0000 7f4eee80e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee8163aa0 con 0x7f4ee8150060 2020-11-20T11:48:02.491 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.480+0000 7f4eee80e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee8163d40 con 0x7f4ee8064030 2020-11-20T11:48:02.492 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.480+0000 7f4eee80e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee8163fe0 con 0x7f4ee8060370 2020-11-20T11:48:02.492 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.480+0000 7f4eed80c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ee8060370 0x7f4ee8160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:02.492 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.481+0000 7f4eed80c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ee8060370 0x7f4ee8160f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48638/0 (socket says 172.21.15.192:48638) 2020-11-20T11:48:02.492 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.481+0000 7f4eed80c700 1 -- 172.21.15.192:0/1785434398 learned_addr learned my addr 172.21.15.192:0/1785434398 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:02.492 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.481+0000 7f4eed00b700 1 --2- 172.21.15.192:0/1785434398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ee8064030 0x7f4ee814bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:02.493 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.481+0000 7f4eed80c700 1 -- 172.21.15.192:0/1785434398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ee8064030 msgr2=0x7f4ee814bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:02.493 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.481+0000 7f4eed80c700 1 --2- 172.21.15.192:0/1785434398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ee8064030 0x7f4ee814bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:02.493 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.481+0000 7f4eee00d700 1 --2- 172.21.15.192:0/1785434398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ee8150060 0x7f4ee814b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:02.494 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.481+0000 7f4eed80c700 1 -- 172.21.15.192:0/1785434398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ee8150060 msgr2=0x7f4ee814b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:02.494 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.481+0000 7f4eed80c700 1 --2- 172.21.15.192:0/1785434398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ee8150060 0x7f4ee814b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:02.494 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.481+0000 7f4eed80c700 1 -- 172.21.15.192:0/1785434398 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee8164280 con 0x7f4ee8060370 2020-11-20T11:48:02.495 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.481+0000 7f4eed80c700 1 --2- 172.21.15.192:0/1785434398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ee8060370 0x7f4ee8160f90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f4ee400b3c0 tx=0x7f4ee4016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:02.495 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.481+0000 7f4ed5ffb700 1 -- 172.21.15.192:0/1785434398 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee4011e30 con 0x7f4ee8060370 2020-11-20T11:48:02.495 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.481+0000 7f4ed5ffb700 1 -- 172.21.15.192:0/1785434398 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee401d480 con 0x7f4ee8060370 2020-11-20T11:48:02.496 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.481+0000 7f4eee80e700 1 -- 172.21.15.192:0/1785434398 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee8164520 con 0x7f4ee8060370 2020-11-20T11:48:02.496 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.481+0000 7f4ed5ffb700 1 -- 172.21.15.192:0/1785434398 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee401d800 con 0x7f4ee8060370 2020-11-20T11:48:02.496 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.481+0000 7f4eee80e700 1 -- 172.21.15.192:0/1785434398 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee814c450 con 0x7f4ee8060370 2020-11-20T11:48:02.496 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.482+0000 7f4eee80e700 1 -- 172.21.15.192:0/1785434398 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ee814c6d0 con 0x7f4ee8060370 2020-11-20T11:48:02.496 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.483+0000 7f4ed5ffb700 1 -- 172.21.15.192:0/1785434398 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f4ee4017070 con 0x7f4ee8060370 2020-11-20T11:48:02.497 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.483+0000 7f4ed5ffb700 1 --2- 172.21.15.192:0/1785434398 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f4ec0080670 0x7f4ec0082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:02.497 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.483+0000 7f4ed5ffb700 1 -- 172.21.15.192:0/1785434398 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 7082+0+0 (secure 0 0 0) 0x7f4ee40a4450 con 0x7f4ee8060370 2020-11-20T11:48:02.497 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.483+0000 7f4eed00b700 1 --2- 172.21.15.192:0/1785434398 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f4ec0080670 0x7f4ec0082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:02.498 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.484+0000 7f4eed00b700 1 --2- 172.21.15.192:0/1785434398 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f4ec0080670 0x7f4ec0082b30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f4ee80bdbe0 tx=0x7f4ed8009040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:02.498 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.488+0000 7f4ed5ffb700 1 -- 172.21.15.192:0/1785434398 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f4ee4079390 con 0x7f4ee8060370 2020-11-20T11:48:02.631 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:02.629+0000 7f4eee80e700 1 -- 172.21.15.192:0/1785434398 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4ee8164980 con 0x7f4ee8060370 2020-11-20T11:48:03.358 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.356+0000 7f4ed5ffb700 1 -- 172.21.15.192:0/1785434398 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v21) v1 ==== 173+0+0 (secure 0 0 0) 0x7f4ee4015070 con 0x7f4ee8060370 2020-11-20T11:48:03.361 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.358+0000 7f4eee80e700 1 -- 172.21.15.192:0/1785434398 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f4ec0080670 msgr2=0x7f4ec0082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:03.361 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.358+0000 7f4eee80e700 1 --2- 172.21.15.192:0/1785434398 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f4ec0080670 0x7f4ec0082b30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f4ee80bdbe0 tx=0x7f4ed8009040).stop 2020-11-20T11:48:03.361 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.358+0000 7f4eee80e700 1 -- 172.21.15.192:0/1785434398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ee8060370 msgr2=0x7f4ee8160f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:03.361 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.358+0000 7f4eee80e700 1 --2- 172.21.15.192:0/1785434398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ee8060370 0x7f4ee8160f90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f4ee400b3c0 tx=0x7f4ee4016000).stop 2020-11-20T11:48:03.362 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.358+0000 7f4eee80e700 1 -- 172.21.15.192:0/1785434398 shutdown_connections 2020-11-20T11:48:03.362 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.358+0000 7f4eee80e700 1 --2- 172.21.15.192:0/1785434398 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f4ec0080670 0x7f4ec0082b30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:03.362 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.358+0000 7f4eee80e700 1 --2- 172.21.15.192:0/1785434398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4ee8150060 0x7f4ee814b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:03.362 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.358+0000 7f4eee80e700 1 --2- 172.21.15.192:0/1785434398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ee8060370 0x7f4ee8160f90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:03.363 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.358+0000 7f4eee80e700 1 --2- 172.21.15.192:0/1785434398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ee8064030 0x7f4ee814bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:03.363 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.358+0000 7f4eee80e700 1 -- 172.21.15.192:0/1785434398 >> 172.21.15.192:0/1785434398 conn(0x7f4ee80c3c50 msgr2=0x7f4ee814d950 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:03.363 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.359+0000 7f4eee80e700 1 -- 172.21.15.192:0/1785434398 shutdown_connections 2020-11-20T11:48:03.363 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.359+0000 7f4eee80e700 1 -- 172.21.15.192:0/1785434398 wait complete. 2020-11-20T11:48:03.364 INFO:teuthology.orchestra.run.smithi192.stderr:enabled application 'rbd' on pool 'rbd' 2020-11-20T11:48:03.374 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2020-11-20T11:48:03.374 INFO:tasks.ceph.mds.a:Restarting daemon 2020-11-20T11:48:03.375 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-11-20T11:48:03.378 INFO:tasks.ceph.mds.a:Started 2020-11-20T11:48:03.378 INFO:tasks.ceph.mds.b:Restarting daemon 2020-11-20T11:48:03.379 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-11-20T11:48:03.381 INFO:tasks.ceph.mds.b:Started 2020-11-20T11:48:03.382 INFO:tasks.ceph.mds.c:Restarting daemon 2020-11-20T11:48:03.382 INFO:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2020-11-20T11:48:03.385 INFO:tasks.ceph.mds.c:Started 2020-11-20T11:48:03.385 INFO:tasks.ceph:Setting up CephFS filesystem... 2020-11-20T11:48:03.386 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:48:03.452 INFO:tasks.ceph.mds.a.smithi192.stdout:starting mds.a at 2020-11-20T11:48:03.460 INFO:tasks.ceph.mds.b.smithi146.stdout:starting mds.b at 2020-11-20T11:48:03.464 INFO:tasks.ceph.mds.c.smithi087.stdout:starting mds.c at 2020-11-20T11:48:03.509 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.507+0000 7fdb987da700 1 Processor -- start 2020-11-20T11:48:03.510 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.507+0000 7fdb987da700 1 -- start start 2020-11-20T11:48:03.513 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.508+0000 7fdb987da700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb90151e80 con 0x7fdb90060750 2020-11-20T11:48:03.513 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.508+0000 7fdb987da700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb90152120 con 0x7fdb90060370 2020-11-20T11:48:03.513 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.508+0000 7fdb987da700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb90064260 con 0x7fdb90154920 2020-11-20T11:48:03.513 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.508+0000 7fdb95d75700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fdb90154920 0x7fdb90151340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51328/0 (socket says 172.21.15.192:51328) 2020-11-20T11:48:03.514 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.508+0000 7fdb95d75700 1 -- 172.21.15.192:0/2892770512 learned_addr learned my addr 172.21.15.192:0/2892770512 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:03.514 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.508+0000 7fdb95574700 1 -- 172.21.15.192:0/2892770512 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1674294340 0 0) 0x7fdb90064260 con 0x7fdb90154920 2020-11-20T11:48:03.514 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.509+0000 7fdb95574700 1 -- 172.21.15.192:0/2892770512 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb78003280 con 0x7fdb90154920 2020-11-20T11:48:03.514 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.509+0000 7fdb95574700 1 -- 172.21.15.192:0/2892770512 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2024955959 0 0) 0x7fdb90152120 con 0x7fdb90060370 2020-11-20T11:48:03.514 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.509+0000 7fdb95574700 1 -- 172.21.15.192:0/2892770512 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb90064260 con 0x7fdb90060370 2020-11-20T11:48:03.515 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.509+0000 7fdb95574700 1 -- 172.21.15.192:0/2892770512 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3361504094 0 0) 0x7fdb90151e80 con 0x7fdb90060750 2020-11-20T11:48:03.515 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.509+0000 7fdb95574700 1 -- 172.21.15.192:0/2892770512 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb90152120 con 0x7fdb90060750 2020-11-20T11:48:03.515 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.509+0000 7fdb95574700 1 -- 172.21.15.192:0/2892770512 <== mon.2 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3989420153 0 0) 0x7fdb78003280 con 0x7fdb90154920 2020-11-20T11:48:03.515 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.509+0000 7fdb95574700 1 -- 172.21.15.192:0/2892770512 >> v1:172.21.15.146:6789/0 conn(0x7fdb90060370 legacy=0x7fdb900c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:03.515 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.509+0000 7fdb95574700 1 -- 172.21.15.192:0/2892770512 >> v1:172.21.15.87:6789/0 conn(0x7fdb90060750 legacy=0x7fdb9015bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:03.516 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.509+0000 7fdb95574700 1 -- 172.21.15.192:0/2892770512 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb90064500 con 0x7fdb90154920 2020-11-20T11:48:03.516 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.509+0000 7fdb95574700 1 -- 172.21.15.192:0/2892770512 <== mon.2 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3985397220 0 0) 0x7fdb80001520 con 0x7fdb90154920 2020-11-20T11:48:03.516 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.509+0000 7fdb95574700 1 -- 172.21.15.192:0/2892770512 >> v1:172.21.15.192:6789/0 conn(0x7fdb90154920 legacy=0x7fdb90151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:03.516 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.509+0000 7fdb95574700 1 --2- 172.21.15.192:0/2892770512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb78003ae0 0x7fdb78003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:03.516 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.509+0000 7fdb95574700 1 --2- 172.21.15.192:0/2892770512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb78004520 0x7fdb780049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:03.517 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.509+0000 7fdb95574700 1 --2- 172.21.15.192:0/2892770512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb78004ff0 0x7fdb7800b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:03.517 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.509+0000 7fdb95574700 1 -- 172.21.15.192:0/2892770512 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7800bd00 con 0x7fdb78004ff0 2020-11-20T11:48:03.517 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.509+0000 7fdb95574700 1 -- 172.21.15.192:0/2892770512 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7800be70 con 0x7fdb78003ae0 2020-11-20T11:48:03.517 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.509+0000 7fdb95574700 1 -- 172.21.15.192:0/2892770512 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7800c030 con 0x7fdb78004520 2020-11-20T11:48:03.517 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.509+0000 7fdb95d75700 1 --2- 172.21.15.192:0/2892770512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb78004520 0x7fdb780049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:03.518 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.509+0000 7fdb96d77700 1 --2- 172.21.15.192:0/2892770512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb78004ff0 0x7fdb7800b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:03.518 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.509+0000 7fdb96576700 1 --2- 172.21.15.192:0/2892770512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb78003ae0 0x7fdb78003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:03.518 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.509+0000 7fdb95d75700 1 -- 172.21.15.192:0/2892770512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb78003ae0 msgr2=0x7fdb78003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:03.518 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.509+0000 7fdb95d75700 1 --2- 172.21.15.192:0/2892770512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb78003ae0 0x7fdb78003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:03.518 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.509+0000 7fdb95d75700 1 -- 172.21.15.192:0/2892770512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb78004ff0 msgr2=0x7fdb7800b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:03.519 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.509+0000 7fdb95d75700 1 --2- 172.21.15.192:0/2892770512 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb78004ff0 0x7fdb7800b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:03.519 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.509+0000 7fdb95d75700 1 -- 172.21.15.192:0/2892770512 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb78003280 con 0x7fdb78004520 2020-11-20T11:48:03.519 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.509+0000 7fdb96d77700 1 -- 172.21.15.192:0/2892770512 reap_dead start 2020-11-20T11:48:03.519 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.509+0000 7fdb95d75700 1 --2- 172.21.15.192:0/2892770512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb78004520 0x7fdb780049a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fdb8000c440 tx=0x7fdb900643f0).ready entity=mon.2 client_cookie=91a9611bc7a9c70d server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:03.523 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.510+0000 7fdb95574700 1 -- 172.21.15.192:0/2892770512 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb800070d0 con 0x7fdb78004520 2020-11-20T11:48:03.523 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.510+0000 7fdb95574700 1 -- 172.21.15.192:0/2892770512 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb80007230 con 0x7fdb78004520 2020-11-20T11:48:03.523 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.510+0000 7fdb95574700 1 -- 172.21.15.192:0/2892770512 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb80005630 con 0x7fdb78004520 2020-11-20T11:48:03.523 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.510+0000 7fdb987da700 1 -- 172.21.15.192:0/2892770512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb78004520 msgr2=0x7fdb780049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:03.523 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.510+0000 7fdb987da700 1 --2- 172.21.15.192:0/2892770512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb78004520 0x7fdb780049a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fdb8000c440 tx=0x7fdb900643f0).stop 2020-11-20T11:48:03.524 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.510+0000 7fdb987da700 1 -- 172.21.15.192:0/2892770512 shutdown_connections 2020-11-20T11:48:03.524 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.510+0000 7fdb987da700 1 --2- 172.21.15.192:0/2892770512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb78004520 0x7fdb780049a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:03.524 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.510+0000 7fdb987da700 1 -- 172.21.15.192:0/2892770512 >> 172.21.15.192:0/2892770512 conn(0x7fdb90062100 msgr2=0x7fdb900c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:03.524 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.510+0000 7fdb987da700 1 -- 172.21.15.192:0/2892770512 shutdown_connections 2020-11-20T11:48:03.524 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.510+0000 7fdb987da700 1 -- 172.21.15.192:0/2892770512 wait complete. 2020-11-20T11:48:03.527 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.511+0000 7fdb987da700 1 Processor -- start 2020-11-20T11:48:03.527 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.511+0000 7fdb987da700 1 -- start start 2020-11-20T11:48:03.527 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.512+0000 7fdb987da700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb78004520 0x7fdb90161330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:03.528 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.512+0000 7fdb987da700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb9014c430 0x7fdb901584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:03.528 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.512+0000 7fdb987da700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb900c5b20 0x7fdb9014d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:03.528 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.512+0000 7fdb987da700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb900b0bf0 con 0x7fdb78004520 2020-11-20T11:48:03.528 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.512+0000 7fdb987da700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb901589c0 con 0x7fdb900c5b20 2020-11-20T11:48:03.528 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.512+0000 7fdb987da700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb900b06b0 con 0x7fdb9014c430 2020-11-20T11:48:03.529 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.512+0000 7fdb95d75700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb9014c430 0x7fdb901584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:03.529 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.512+0000 7fdb95d75700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb9014c430 0x7fdb901584d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48670/0 (socket says 172.21.15.192:48670) 2020-11-20T11:48:03.529 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.512+0000 7fdb95d75700 1 -- 172.21.15.192:0/2528826760 learned_addr learned my addr 172.21.15.192:0/2528826760 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:03.529 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.512+0000 7fdb96d77700 1 --2- 172.21.15.192:0/2528826760 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb900c5b20 0x7fdb9014d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:03.529 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.512+0000 7fdb96576700 1 --2- 172.21.15.192:0/2528826760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb78004520 0x7fdb90161330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:03.530 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.512+0000 7fdb95d75700 1 -- 172.21.15.192:0/2528826760 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb900c5b20 msgr2=0x7fdb9014d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:03.530 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.512+0000 7fdb95d75700 1 --2- 172.21.15.192:0/2528826760 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb900c5b20 0x7fdb9014d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:03.530 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.512+0000 7fdb95d75700 1 -- 172.21.15.192:0/2528826760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb78004520 msgr2=0x7fdb90161330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:03.530 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.512+0000 7fdb95d75700 1 --2- 172.21.15.192:0/2528826760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb78004520 0x7fdb90161330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:03.531 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.512+0000 7fdb95d75700 1 -- 172.21.15.192:0/2528826760 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb900b0950 con 0x7fdb9014c430 2020-11-20T11:48:03.531 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.512+0000 7fdb95d75700 1 --2- 172.21.15.192:0/2528826760 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb9014c430 0x7fdb901584d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fdb8000ca30 tx=0x7fdb80013000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:03.531 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.513+0000 7fdb7e7fc700 1 -- 172.21.15.192:0/2528826760 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8001a070 con 0x7fdb9014c430 2020-11-20T11:48:03.531 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.513+0000 7fdb7e7fc700 1 -- 172.21.15.192:0/2528826760 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb800073a0 con 0x7fdb9014c430 2020-11-20T11:48:03.531 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.513+0000 7fdb987da700 1 -- 172.21.15.192:0/2528826760 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb90160950 con 0x7fdb9014c430 2020-11-20T11:48:03.532 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.513+0000 7fdb7e7fc700 1 -- 172.21.15.192:0/2528826760 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb80001b20 con 0x7fdb9014c430 2020-11-20T11:48:03.532 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.513+0000 7fdb987da700 1 -- 172.21.15.192:0/2528826760 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb90160e90 con 0x7fdb9014c430 2020-11-20T11:48:03.532 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.514+0000 7fdb987da700 1 -- 172.21.15.192:0/2528826760 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb900699a0 con 0x7fdb9014c430 2020-11-20T11:48:03.532 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.514+0000 7fdb7e7fc700 1 -- 172.21.15.192:0/2528826760 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fdb80026070 con 0x7fdb9014c430 2020-11-20T11:48:03.532 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.515+0000 7fdb7e7fc700 1 --2- 172.21.15.192:0/2528826760 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fdb68080670 0x7fdb68082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:03.532 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.515+0000 7fdb7e7fc700 1 -- 172.21.15.192:0/2528826760 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 7093+0+0 (secure 0 0 0) 0x7fdb800a2ce0 con 0x7fdb9014c430 2020-11-20T11:48:03.533 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.515+0000 7fdb96576700 1 --2- 172.21.15.192:0/2528826760 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fdb68080670 0x7fdb68082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:03.533 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.515+0000 7fdb96576700 1 --2- 172.21.15.192:0/2528826760 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fdb68080670 0x7fdb68082b30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fdb8c000f60 tx=0x7fdb8c009040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:03.533 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.518+0000 7fdb7e7fc700 1 -- 172.21.15.192:0/2528826760 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fdb80077c90 con 0x7fdb9014c430 2020-11-20T11:48:03.660 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.658+0000 7fdb987da700 1 -- 172.21.15.192:0/2528826760 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb90161020 con 0x7fdb9014c430 2020-11-20T11:48:03.661 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.659+0000 7fdb7e7fc700 1 -- 172.21.15.192:0/2528826760 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18391 (secure 0 0 0) 0x7fdb8007b2b0 con 0x7fdb9014c430 2020-11-20T11:48:03.661 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:48:03.662 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":21,"fsid":"4871390d-d110-4379-8302-5810d7b54f34","created":"2020-11-20T11:47:49.059675+0000","modified":"2020-11-20T11:48:03.349294+0000","last_up_change":"2020-11-20T11:47:57.317253+0000","last_in_change":"2020-11-20T11:47:57.317253+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:47:52.327778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:48:01.912951+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"77a5e1d9-0fb0-450c-872e-4aee77dede49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":23242},{"type":"v1","addr":"172.21.15.192:6827","nonce":23242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":23242},{"type":"v1","addr":"172.21.15.192:6829","nonce":23242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":23242},{"type":"v1","addr":"172.21.15.192:6833","nonce":23242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":23242},{"type":"v1","addr":"172.21.15.192:6831","nonce":23242}]},"public_addr":"172.21.15.192:6827/23242","cluster_addr":"172.21.15.192:6829/23242","heartbeat_back_addr":"172.21.15.192:6833/23242","heartbeat_front_addr":"172.21.15.192:6831/23242","state":["exists","up"]},{"osd":1,"uuid":"564330c6-5c45-4ef6-8718-bbfa97848e6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":22856},{"type":"v1","addr":"172.21.15.146:6801","nonce":22856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":22856},{"type":"v1","addr":"172.21.15.146:6803","nonce":22856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":22856},{"type":"v1","addr":"172.21.15.146:6807","nonce":22856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":22856},{"type":"v1","addr":"172.21.15.146:6805","nonce":22856}]},"public_addr":"172.21.15.146:6801/22856","cluster_addr":"172.21.15.146:6803/22856","heartbeat_back_addr":"172.21.15.146:6807/22856","heartbeat_front_addr":"172.21.15.146:6805/22856","state":["exists","up"]},{"osd":2,"uuid":"128ddb77-579b-4fa3-a0cb-7465ad959f3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6815","nonce":23326},{"type":"v1","addr":"172.21.15.87:6817","nonce":23326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":23326},{"type":"v1","addr":"172.21.15.87:6819","nonce":23326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":23326},{"type":"v1","addr":"172.21.15.87:6823","nonce":23326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":23326},{"type":"v1","addr":"172.21.15.87:6821","nonce":23326}]},"public_addr":"172.21.15.87:6817/23326","cluster_addr":"172.21.15.87:6819/23326","heartbeat_back_addr":"172.21.15.87:6823/23326","heartbeat_front_addr":"172.21.15.87:6821/23326","state":["exists","up"]},{"osd":3,"uuid":"4668cfdf-d172-4f30-95b8-ac842108a520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":23243},{"type":"v1","addr":"172.21.15.192:6803","nonce":23243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":23243},{"type":"v1","addr":"172.21.15.192:6805","nonce":23243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":23243},{"type":"v1","addr":"172.21.15.192:6809","nonce":23243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":23243},{"type":"v1","addr":"172.21.15.192:6807","nonce":23243}]},"public_addr":"172.21.15.192:6803/23243","cluster_addr":"172.21.15.192:6805/23243","heartbeat_back_addr":"172.21.15.192:6809/23243","heartbeat_front_addr":"172.21.15.192:6807/23243","state":["exists","up"]},{"osd":4,"uuid":"c4bc8ba5-0d22-49f5-97a6-2ca71e3a8c62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":22857},{"type":"v1","addr":"172.21.15.146:6809","nonce":22857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":22857},{"type":"v1","addr":"172.21.15.146:6811","nonce":22857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":22857},{"type":"v1","addr":"172.21.15.146:6815","nonce":22857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":22857},{"type":"v1","addr":"172.21.15.146:6813","nonce":22857}]},"public_addr":"172.21.15.146:6809/22857","cluster_addr":"172.21.15.146:6811/22857","heartbeat_back_addr":"172.21.15.146:6815/22857","heartbeat_front_addr":"172.21.15.146:6813/22857","state":["exists","up"]},{"osd":5,"uuid":"2d15f1db-e580-4715-9728-8fe5dd7e34d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":23316},{"type":"v1","addr":"172.21.15.87:6801","nonce":23316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":23316},{"type":"v1","addr":"172.21.15.87:6803","nonce":23316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":23316},{"type":"v1","addr":"172.21.15.87:6807","nonce":23316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":23316},{"type":"v1","addr":"172.21.15.87:6805","nonce":23316}]},"public_addr":"172.21.15.87:6801/23316","cluster_addr":"172.21.15.87:6803/23316","heartbeat_back_addr":"172.21.15.87:6807/23316","heartbeat_front_addr":"172.21.15.87:6805/23316","state":["exists","up"]},{"osd":6,"uuid":"a659da2b-bdce-42ac-8b30-b8c69b4c7041","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":23246},{"type":"v1","addr":"172.21.15.192:6811","nonce":23246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":23246},{"type":"v1","addr":"172.21.15.192:6813","nonce":23246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":23246},{"type":"v1","addr":"172.21.15.192:6817","nonce":23246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":23246},{"type":"v1","addr":"172.21.15.192:6815","nonce":23246}]},"public_addr":"172.21.15.192:6811/23246","cluster_addr":"172.21.15.192:6813/23246","heartbeat_back_addr":"172.21.15.192:6817/23246","heartbeat_front_addr":"172.21.15.192:6815/23246","state":["exists","up"]},{"osd":7,"uuid":"d6e41ac5-bab7-49e2-a17a-ef794bcc4a09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":22858},{"type":"v1","addr":"172.21.15.146:6818","nonce":22858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":22858},{"type":"v1","addr":"172.21.15.146:6822","nonce":22858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":22858},{"type":"v1","addr":"172.21.15.146:6830","nonce":22858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":22858},{"type":"v1","addr":"172.21.15.146:6826","nonce":22858}]},"public_addr":"172.21.15.146:6818/22858","cluster_addr":"172.21.15.146:6822/22858","heartbeat_back_addr":"172.21.15.146:6830/22858","heartbeat_front_addr":"172.21.15.146:6826/22858","state":["exists","up"]},{"osd":8,"uuid":"c4907993-7513-4162-974f-07dcb0a260a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":23333},{"type":"v1","addr":"172.21.15.87:6825","nonce":23333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":23333},{"type":"v1","addr":"172.21.15.87:6827","nonce":23333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":23333},{"type":"v1","addr":"172.21.15.87:6831","nonce":23333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":23333},{"type":"v1","addr":"172.21.15.87:6829","nonce":23333}]},"public_addr":"172.21.15.87:6825/23333","cluster_addr":"172.21.15.87:6827/23333","heartbeat_back_addr":"172.21.15.87:6831/23333","heartbeat_front_addr":"172.21.15.87:6829/23333","state":["exists","up"]},{"osd":9,"uuid":"3523676f-c9b8-47ae-86c0-4930dca17831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":23254},{"type":"v1","addr":"172.21.15.192:6819","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":23254},{"type":"v1","addr":"172.21.15.192:6821","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":23254},{"type":"v1","addr":"172.21.15.192:6825","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":23254},{"type":"v1","addr":"172.21.15.192:6823","nonce":23254}]},"public_addr":"172.21.15.192:6819/23254","cluster_addr":"172.21.15.192:6821/23254","heartbeat_back_addr":"172.21.15.192:6825/23254","heartbeat_front_addr":"172.21.15.192:6823/23254","state":["exists","up"]},{"osd":10,"uuid":"88d5c251-0bb1-4624-8fa2-7f3b74bd1bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":22859},{"type":"v1","addr":"172.21.15.146:6819","nonce":22859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6821","nonce":22859},{"type":"v1","addr":"172.21.15.146:6823","nonce":22859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":22859},{"type":"v1","addr":"172.21.15.146:6831","nonce":22859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6825","nonce":22859},{"type":"v1","addr":"172.21.15.146:6827","nonce":22859}]},"public_addr":"172.21.15.146:6819/22859","cluster_addr":"172.21.15.146:6823/22859","heartbeat_back_addr":"172.21.15.146:6831/22859","heartbeat_front_addr":"172.21.15.146:6827/22859","state":["exists","up"]},{"osd":11,"uuid":"31f650d6-ba1e-4f29-92ff-6abee04c0f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":23317},{"type":"v1","addr":"172.21.15.87:6809","nonce":23317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":23317},{"type":"v1","addr":"172.21.15.87:6811","nonce":23317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":23317},{"type":"v1","addr":"172.21.15.87:6816","nonce":23317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":23317},{"type":"v1","addr":"172.21.15.87:6813","nonce":23317}]},"public_addr":"172.21.15.87:6809/23317","cluster_addr":"172.21.15.87:6811/23317","heartbeat_back_addr":"172.21.15.87:6816/23317","heartbeat_front_addr":"172.21.15.87:6813/23317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.538863+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.552293+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.585265+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.505194+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.550032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.558089+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.565622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.587102+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.654330+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.599072+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.645833+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.596236+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:48:03.663 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.660+0000 7fdb987da700 1 -- 172.21.15.192:0/2528826760 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fdb68080670 msgr2=0x7fdb68082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:03.663 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.660+0000 7fdb987da700 1 --2- 172.21.15.192:0/2528826760 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fdb68080670 0x7fdb68082b30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fdb8c000f60 tx=0x7fdb8c009040).stop 2020-11-20T11:48:03.663 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.660+0000 7fdb987da700 1 -- 172.21.15.192:0/2528826760 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb9014c430 msgr2=0x7fdb901584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:03.663 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.660+0000 7fdb987da700 1 --2- 172.21.15.192:0/2528826760 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb9014c430 0x7fdb901584d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fdb8000ca30 tx=0x7fdb80013000).stop 2020-11-20T11:48:03.664 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.660+0000 7fdb987da700 1 -- 172.21.15.192:0/2528826760 shutdown_connections 2020-11-20T11:48:03.664 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.660+0000 7fdb987da700 1 --2- 172.21.15.192:0/2528826760 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fdb68080670 0x7fdb68082b30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:03.664 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.660+0000 7fdb987da700 1 --2- 172.21.15.192:0/2528826760 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb900c5b20 0x7fdb9014d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:03.664 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.660+0000 7fdb987da700 1 --2- 172.21.15.192:0/2528826760 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdb78004520 0x7fdb90161330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:03.664 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.660+0000 7fdb987da700 1 --2- 172.21.15.192:0/2528826760 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb9014c430 0x7fdb901584d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:03.665 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.660+0000 7fdb987da700 1 -- 172.21.15.192:0/2528826760 >> 172.21.15.192:0/2528826760 conn(0x7fdb90062100 msgr2=0x7fdb90154db0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:03.665 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.661+0000 7fdb987da700 1 -- 172.21.15.192:0/2528826760 shutdown_connections 2020-11-20T11:48:03.665 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.661+0000 7fdb987da700 1 -- 172.21.15.192:0/2528826760 wait complete. 2020-11-20T11:48:03.674 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-20T11:47:52.327778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-20T11:48:01.912951+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-11-20T11:48:03.675 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2020-11-20T11:48:03.785 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.783+0000 7f1fdf376700 1 Processor -- start 2020-11-20T11:48:03.786 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.784+0000 7f1fdf376700 1 -- start start 2020-11-20T11:48:03.788 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.784+0000 7f1fdf376700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1fd8060750 0x7f1fd8064c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:03.788 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.784+0000 7f1fdf376700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fd8065130 con 0x7f1fd8060370 2020-11-20T11:48:03.788 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.784+0000 7f1fdf376700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fd8151e80 con 0x7f1fd8154920 2020-11-20T11:48:03.789 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.784+0000 7f1fdf376700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fd8152120 con 0x7f1fd8060750 2020-11-20T11:48:03.789 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.785+0000 7f1fdd913700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1fd8060750 0x7f1fd8064c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:03.789 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.785+0000 7f1fdc911700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f1fd8154920 0x7f1fd8151340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51346/0 (socket says 172.21.15.192:51346) 2020-11-20T11:48:03.789 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.785+0000 7f1fdc911700 1 -- 172.21.15.192:0/2499590257 learned_addr learned my addr 172.21.15.192:0/2499590257 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:03.790 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.785+0000 7f1fdd913700 1 -- 172.21.15.192:0/2499590257 >> v1:172.21.15.192:6789/0 conn(0x7f1fd8154920 legacy=0x7f1fd8151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:03.790 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.785+0000 7f1fdd913700 1 -- 172.21.15.192:0/2499590257 >> v1:172.21.15.146:6789/0 conn(0x7f1fd8060370 legacy=0x7f1fd80c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:03.790 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.785+0000 7f1fdd913700 1 -- 172.21.15.192:0/2499590257 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd8064260 con 0x7f1fd8060750 2020-11-20T11:48:03.790 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.785+0000 7f1fc7fff700 1 -- 172.21.15.192:0/2499590257 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1237748909 0 0) 0x7f1fd8151e80 con 0x7f1fd8154920 2020-11-20T11:48:03.791 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.785+0000 7f1fdd913700 1 --2- 172.21.15.192:0/2499590257 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fd8060750 0x7f1fd8064c40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f1fd0009ce0 tx=0x7f1fd0009220).ready entity=mon.2 client_cookie=d00d5ba5f9c5d5e2 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:03.791 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.785+0000 7f1fc7fff700 1 -- 172.21.15.192:0/2499590257 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd000bc80 con 0x7f1fd8060750 2020-11-20T11:48:03.791 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.785+0000 7f1fc7fff700 1 -- 172.21.15.192:0/2499590257 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd000bde0 con 0x7f1fd8060750 2020-11-20T11:48:03.791 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.785+0000 7f1fc7fff700 1 -- 172.21.15.192:0/2499590257 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd0011610 con 0x7f1fd8060750 2020-11-20T11:48:03.791 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.786+0000 7f1fdf376700 1 -- 172.21.15.192:0/2499590257 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fd8060750 msgr2=0x7f1fd8064c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:03.791 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.786+0000 7f1fdf376700 1 --2- 172.21.15.192:0/2499590257 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fd8060750 0x7f1fd8064c40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f1fd0009ce0 tx=0x7f1fd0009220).stop 2020-11-20T11:48:03.792 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.786+0000 7f1fdf376700 1 -- 172.21.15.192:0/2499590257 shutdown_connections 2020-11-20T11:48:03.792 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.786+0000 7f1fdf376700 1 --2- 172.21.15.192:0/2499590257 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fd8060750 0x7f1fd8064c40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:03.792 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.786+0000 7f1fdf376700 1 -- 172.21.15.192:0/2499590257 >> 172.21.15.192:0/2499590257 conn(0x7f1fd8062100 msgr2=0x7f1fd80c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:03.792 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.786+0000 7f1fdf376700 1 -- 172.21.15.192:0/2499590257 shutdown_connections 2020-11-20T11:48:03.792 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.786+0000 7f1fdf376700 1 -- 172.21.15.192:0/2499590257 wait complete. 2020-11-20T11:48:03.795 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.787+0000 7f1fdf376700 1 Processor -- start 2020-11-20T11:48:03.795 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.787+0000 7f1fdf376700 1 -- start start 2020-11-20T11:48:03.795 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.788+0000 7f1fdf376700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fd8060370 0x7f1fd8158480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:03.796 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.788+0000 7f1fdf376700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fd8060750 0x7f1fd81644a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:03.796 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.788+0000 7f1fdf376700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1fd8154920 0x7f1fd814bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:03.796 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.788+0000 7f1fdf376700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd8157250 con 0x7f1fd8154920 2020-11-20T11:48:03.796 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.788+0000 7f1fdf376700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd8164990 con 0x7f1fd8060750 2020-11-20T11:48:03.796 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.788+0000 7f1fdf376700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd8160500 con 0x7f1fd8060370 2020-11-20T11:48:03.797 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.788+0000 7f1fdd112700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fd8060370 0x7f1fd8158480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:03.797 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.788+0000 7f1fdd112700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fd8060370 0x7f1fd8158480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48682/0 (socket says 172.21.15.192:48682) 2020-11-20T11:48:03.797 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.788+0000 7f1fdd112700 1 -- 172.21.15.192:0/2018629670 learned_addr learned my addr 172.21.15.192:0/2018629670 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:03.797 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.788+0000 7f1fdc911700 1 --2- 172.21.15.192:0/2018629670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fd8060750 0x7f1fd81644a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:03.797 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.788+0000 7f1fdd112700 1 -- 172.21.15.192:0/2018629670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fd8060750 msgr2=0x7f1fd81644a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:03.798 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.788+0000 7f1fdd913700 1 --2- 172.21.15.192:0/2018629670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1fd8154920 0x7f1fd814bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:03.798 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.788+0000 7f1fdd112700 1 --2- 172.21.15.192:0/2018629670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fd8060750 0x7f1fd81644a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:03.798 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.788+0000 7f1fdd112700 1 -- 172.21.15.192:0/2018629670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1fd8154920 msgr2=0x7f1fd814bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:03.798 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.788+0000 7f1fdd112700 1 --2- 172.21.15.192:0/2018629670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1fd8154920 0x7f1fd814bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:03.798 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.788+0000 7f1fdd112700 1 -- 172.21.15.192:0/2018629670 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd80b04c0 con 0x7f1fd8060370 2020-11-20T11:48:03.799 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.788+0000 7f1fdd913700 1 --2- 172.21.15.192:0/2018629670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1fd8154920 0x7f1fd814bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:48:03.799 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.788+0000 7f1fdd112700 1 --2- 172.21.15.192:0/2018629670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fd8060370 0x7f1fd8158480 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f1fc800c710 tx=0x7f1fc8007c90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:03.799 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.788+0000 7f1fc57fa700 1 -- 172.21.15.192:0/2018629670 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc8007020 con 0x7f1fd8060370 2020-11-20T11:48:03.799 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.788+0000 7f1fc57fa700 1 -- 172.21.15.192:0/2018629670 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc8007180 con 0x7f1fd8060370 2020-11-20T11:48:03.800 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.788+0000 7f1fdf376700 1 -- 172.21.15.192:0/2018629670 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fd80b0760 con 0x7f1fd8060370 2020-11-20T11:48:03.800 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.788+0000 7f1fc57fa700 1 -- 172.21.15.192:0/2018629670 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc8006530 con 0x7f1fd8060370 2020-11-20T11:48:03.800 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.788+0000 7f1fdf376700 1 -- 172.21.15.192:0/2018629670 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd8160a00 con 0x7f1fd8060370 2020-11-20T11:48:03.800 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.790+0000 7f1fdf376700 1 -- 172.21.15.192:0/2018629670 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fd80699a0 con 0x7f1fd8060370 2020-11-20T11:48:03.800 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.790+0000 7f1fc57fa700 1 -- 172.21.15.192:0/2018629670 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f1fc8010030 con 0x7f1fd8060370 2020-11-20T11:48:03.801 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.790+0000 7f1fc57fa700 1 --2- 172.21.15.192:0/2018629670 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f1fb0080670 0x7f1fb0082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:03.801 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.791+0000 7f1fc57fa700 1 -- 172.21.15.192:0/2018629670 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f1fc80a1d70 con 0x7f1fd8060370 2020-11-20T11:48:03.801 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.791+0000 7f1fdc911700 1 --2- 172.21.15.192:0/2018629670 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f1fb0080670 0x7f1fb0082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:03.801 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.791+0000 7f1fdc911700 1 --2- 172.21.15.192:0/2018629670 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f1fb0080670 0x7f1fb0082b30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f1fd8158a60 tx=0x7f1fd4007a40).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:03.802 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.794+0000 7f1fc57fa700 1 -- 172.21.15.192:0/2018629670 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f1fc8076b90 con 0x7f1fd8060370 2020-11-20T11:48:03.937 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.935+0000 7f1fdf376700 1 -- 172.21.15.192:0/2018629670 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f1fd805ca80 con 0x7f1fd8060370 2020-11-20T11:48:03.938 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.936+0000 7f1fc57fa700 1 -- 172.21.15.192:0/2018629670 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v21) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1fc807a1b0 con 0x7f1fd8060370 2020-11-20T11:48:03.939 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2020-11-20T11:48:03.939 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.937+0000 7f1fdf376700 1 -- 172.21.15.192:0/2018629670 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f1fb0080670 msgr2=0x7f1fb0082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:03.940 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.937+0000 7f1fdf376700 1 --2- 172.21.15.192:0/2018629670 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f1fb0080670 0x7f1fb0082b30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f1fd8158a60 tx=0x7f1fd4007a40).stop 2020-11-20T11:48:03.940 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.937+0000 7f1fdf376700 1 -- 172.21.15.192:0/2018629670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fd8060370 msgr2=0x7f1fd8158480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:03.940 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.937+0000 7f1fdf376700 1 --2- 172.21.15.192:0/2018629670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fd8060370 0x7f1fd8158480 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f1fc800c710 tx=0x7f1fc8007c90).stop 2020-11-20T11:48:03.940 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.937+0000 7f1fdf376700 1 -- 172.21.15.192:0/2018629670 shutdown_connections 2020-11-20T11:48:03.941 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.937+0000 7f1fdf376700 1 --2- 172.21.15.192:0/2018629670 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f1fb0080670 0x7f1fb0082b30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:03.941 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.937+0000 7f1fdf376700 1 --2- 172.21.15.192:0/2018629670 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1fd8154920 0x7f1fd814bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:03.941 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.937+0000 7f1fdf376700 1 --2- 172.21.15.192:0/2018629670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fd8060370 0x7f1fd8158480 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:03.941 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.937+0000 7f1fdf376700 1 --2- 172.21.15.192:0/2018629670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fd8060750 0x7f1fd81644a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:03.941 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.937+0000 7f1fdf376700 1 -- 172.21.15.192:0/2018629670 >> 172.21.15.192:0/2018629670 conn(0x7f1fd8062100 msgr2=0x7f1fd80c2340 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:03.942 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.937+0000 7f1fdf376700 1 -- 172.21.15.192:0/2018629670 shutdown_connections 2020-11-20T11:48:03.942 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:03.937+0000 7f1fdf376700 1 -- 172.21.15.192:0/2018629670 wait complete. 2020-11-20T11:48:03.951 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-11-20T11:48:04.063 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.061+0000 7f9cffedb700 1 Processor -- start 2020-11-20T11:48:04.064 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.061+0000 7f9cffedb700 1 -- start start 2020-11-20T11:48:04.066 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.062+0000 7f9cffedb700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9cf80bf540 0x7f9cf8151be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:04.066 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.062+0000 7f9cffedb700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cf8152680 con 0x7f9cf80bf160 2020-11-20T11:48:04.066 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.062+0000 7f9cffedb700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cf8064730 con 0x7f9cf81537d0 2020-11-20T11:48:04.067 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.062+0000 7f9cffedb700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cf81520d0 con 0x7f9cf80bf540 2020-11-20T11:48:04.067 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.062+0000 7f9cfe478700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f9cf81537d0 0x7f9cf8153c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51362/0 (socket says 172.21.15.192:51362) 2020-11-20T11:48:04.067 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.062+0000 7f9cfe478700 1 -- 172.21.15.192:0/905642331 learned_addr learned my addr 172.21.15.192:0/905642331 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:04.067 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.062+0000 7f9cfd476700 1 --2- 172.21.15.192:0/905642331 >> v2:172.21.15.146:3300/0 conn(0x7f9cf80bf540 0x7f9cf8151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:04.067 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.062+0000 7f9cfcc75700 1 -- 172.21.15.192:0/905642331 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3286599550 0 0) 0x7f9cf8064730 con 0x7f9cf81537d0 2020-11-20T11:48:04.068 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.062+0000 7f9cfcc75700 1 -- 172.21.15.192:0/905642331 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ce0003280 con 0x7f9cf81537d0 2020-11-20T11:48:04.068 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.063+0000 7f9cfcc75700 1 -- 172.21.15.192:0/905642331 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 792486727 0 0) 0x7f9cf8152680 con 0x7f9cf80bf160 2020-11-20T11:48:04.068 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.063+0000 7f9cfd476700 1 -- 172.21.15.192:0/905642331 >> v1:172.21.15.192:6789/0 conn(0x7f9cf81537d0 legacy=0x7f9cf8153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:04.068 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.063+0000 7f9cfd476700 1 -- 172.21.15.192:0/905642331 >> v1:172.21.15.87:6789/0 conn(0x7f9cf80bf160 legacy=0x7f9cf8062740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:04.069 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.063+0000 7f9cfd476700 1 -- 172.21.15.192:0/905642331 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf81528b0 con 0x7f9cf80bf540 2020-11-20T11:48:04.069 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.063+0000 7f9cfd476700 1 --2- 172.21.15.192:0/905642331 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cf80bf540 0x7f9cf8151be0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f9ce800ba30 tx=0x7f9ce8006e30).ready entity=mon.1 client_cookie=2ca27e148d7da082 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:04.069 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.063+0000 7f9cfcc75700 1 -- 172.21.15.192:0/905642331 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce80097f0 con 0x7f9cf80bf540 2020-11-20T11:48:04.069 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.063+0000 7f9cfcc75700 1 -- 172.21.15.192:0/905642331 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce8000e90 con 0x7f9cf80bf540 2020-11-20T11:48:04.069 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.063+0000 7f9cfcc75700 1 -- 172.21.15.192:0/905642331 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce8009b60 con 0x7f9cf80bf540 2020-11-20T11:48:04.070 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.063+0000 7f9cffedb700 1 -- 172.21.15.192:0/905642331 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cf80bf540 msgr2=0x7f9cf8151be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:04.070 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.063+0000 7f9cffedb700 1 --2- 172.21.15.192:0/905642331 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cf80bf540 0x7f9cf8151be0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f9ce800ba30 tx=0x7f9ce8006e30).stop 2020-11-20T11:48:04.070 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.063+0000 7f9cffedb700 1 -- 172.21.15.192:0/905642331 shutdown_connections 2020-11-20T11:48:04.070 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.063+0000 7f9cffedb700 1 --2- 172.21.15.192:0/905642331 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cf80bf540 0x7f9cf8151be0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:04.071 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.063+0000 7f9cffedb700 1 -- 172.21.15.192:0/905642331 >> 172.21.15.192:0/905642331 conn(0x7f9cf80601b0 msgr2=0x7f9cf80605c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:04.071 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.063+0000 7f9cffedb700 1 -- 172.21.15.192:0/905642331 shutdown_connections 2020-11-20T11:48:04.071 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.063+0000 7f9cffedb700 1 -- 172.21.15.192:0/905642331 wait complete. 2020-11-20T11:48:04.074 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.065+0000 7f9cffedb700 1 Processor -- start 2020-11-20T11:48:04.075 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.065+0000 7f9cffedb700 1 -- start start 2020-11-20T11:48:04.075 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.065+0000 7f9cffedb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cf80bf160 0x7f9cf8160e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:04.075 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.065+0000 7f9cffedb700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cf80bf540 0x7f9cf8150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:04.075 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.065+0000 7f9cffedb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cf81537d0 0x7f9cf81499e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:04.076 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.065+0000 7f9cffedb700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf81647b0 con 0x7f9cf80bf540 2020-11-20T11:48:04.076 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.065+0000 7f9cffedb700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf8164270 con 0x7f9cf81537d0 2020-11-20T11:48:04.076 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.065+0000 7f9cffedb700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf8164510 con 0x7f9cf80bf160 2020-11-20T11:48:04.076 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.065+0000 7f9cfdc77700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cf80bf160 0x7f9cf8160e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:04.077 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.065+0000 7f9cfdc77700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cf80bf160 0x7f9cf8160e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48698/0 (socket says 172.21.15.192:48698) 2020-11-20T11:48:04.077 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.065+0000 7f9cfdc77700 1 -- 172.21.15.192:0/2517034727 learned_addr learned my addr 172.21.15.192:0/2517034727 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:04.077 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.066+0000 7f9cfe478700 1 --2- 172.21.15.192:0/2517034727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cf81537d0 0x7f9cf81499e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:04.077 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.066+0000 7f9cfd476700 1 --2- 172.21.15.192:0/2517034727 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cf80bf540 0x7f9cf8150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:04.078 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.066+0000 7f9cfdc77700 1 -- 172.21.15.192:0/2517034727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cf81537d0 msgr2=0x7f9cf81499e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:04.078 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.066+0000 7f9cfdc77700 1 --2- 172.21.15.192:0/2517034727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cf81537d0 0x7f9cf81499e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:04.078 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.066+0000 7f9cfdc77700 1 -- 172.21.15.192:0/2517034727 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cf80bf540 msgr2=0x7f9cf8150860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:04.078 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.066+0000 7f9cfdc77700 1 --2- 172.21.15.192:0/2517034727 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cf80bf540 0x7f9cf8150860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:04.078 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.066+0000 7f9cfdc77700 1 -- 172.21.15.192:0/2517034727 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf81604a0 con 0x7f9cf80bf160 2020-11-20T11:48:04.079 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.066+0000 7f9cfdc77700 1 --2- 172.21.15.192:0/2517034727 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cf80bf160 0x7f9cf8160e80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f9cf400c6e0 tx=0x7f9cf4007aa0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:04.079 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.066+0000 7f9ce5ffb700 1 -- 172.21.15.192:0/2517034727 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf400e4a0 con 0x7f9cf80bf160 2020-11-20T11:48:04.079 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.066+0000 7f9ce5ffb700 1 -- 172.21.15.192:0/2517034727 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf400e600 con 0x7f9cf80bf160 2020-11-20T11:48:04.079 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.066+0000 7f9cffedb700 1 -- 172.21.15.192:0/2517034727 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf8160740 con 0x7f9cf80bf160 2020-11-20T11:48:04.079 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.066+0000 7f9ce5ffb700 1 -- 172.21.15.192:0/2517034727 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf400e9c0 con 0x7f9cf80bf160 2020-11-20T11:48:04.080 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.066+0000 7f9cffedb700 1 -- 172.21.15.192:0/2517034727 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cf8150d50 con 0x7f9cf80bf160 2020-11-20T11:48:04.080 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.067+0000 7f9cffedb700 1 -- 172.21.15.192:0/2517034727 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cf805ca80 con 0x7f9cf80bf160 2020-11-20T11:48:04.080 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.068+0000 7f9ce5ffb700 1 -- 172.21.15.192:0/2517034727 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f9cf4019030 con 0x7f9cf80bf160 2020-11-20T11:48:04.080 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.068+0000 7f9ce5ffb700 1 --2- 172.21.15.192:0/2517034727 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f9cd0080670 0x7f9cd0082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:04.080 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.068+0000 7f9ce5ffb700 1 -- 172.21.15.192:0/2517034727 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f9cf40a1ad0 con 0x7f9cf80bf160 2020-11-20T11:48:04.081 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.068+0000 7f9cfd476700 1 --2- 172.21.15.192:0/2517034727 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f9cd0080670 0x7f9cd0082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:04.081 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.068+0000 7f9cfd476700 1 --2- 172.21.15.192:0/2517034727 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f9cd0080670 0x7f9cd0082b30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f9ce8006ba0 tx=0x7f9ce8015000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:04.081 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.072+0000 7f9ce5ffb700 1 -- 172.21.15.192:0/2517034727 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f9cf4076a00 con 0x7f9cf80bf160 2020-11-20T11:48:04.214 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.210+0000 7f9cffedb700 1 -- 172.21.15.192:0/2517034727 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9cf805c2e0 con 0x7f9cf80bf160 2020-11-20T11:48:04.214 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.211+0000 7f9ce5ffb700 1 -- 172.21.15.192:0/2517034727 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9cf4007bc0 con 0x7f9cf80bf160 2020-11-20T11:48:04.214 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 8 2020-11-20T11:48:04.215 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.212+0000 7f9cffedb700 1 -- 172.21.15.192:0/2517034727 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f9cd0080670 msgr2=0x7f9cd0082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:04.215 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.212+0000 7f9cffedb700 1 --2- 172.21.15.192:0/2517034727 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f9cd0080670 0x7f9cd0082b30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f9ce8006ba0 tx=0x7f9ce8015000).stop 2020-11-20T11:48:04.216 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.212+0000 7f9cffedb700 1 -- 172.21.15.192:0/2517034727 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cf80bf160 msgr2=0x7f9cf8160e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:04.216 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.212+0000 7f9cffedb700 1 --2- 172.21.15.192:0/2517034727 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cf80bf160 0x7f9cf8160e80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f9cf400c6e0 tx=0x7f9cf4007aa0).stop 2020-11-20T11:48:04.216 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.212+0000 7f9cffedb700 1 -- 172.21.15.192:0/2517034727 shutdown_connections 2020-11-20T11:48:04.216 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.212+0000 7f9cffedb700 1 --2- 172.21.15.192:0/2517034727 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f9cd0080670 0x7f9cd0082b30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:04.217 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.212+0000 7f9cffedb700 1 --2- 172.21.15.192:0/2517034727 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cf81537d0 0x7f9cf81499e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:04.217 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.212+0000 7f9cffedb700 1 --2- 172.21.15.192:0/2517034727 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cf80bf160 0x7f9cf8160e80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:04.218 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.212+0000 7f9cffedb700 1 --2- 172.21.15.192:0/2517034727 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9cf80bf540 0x7f9cf8150860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:04.218 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.212+0000 7f9cffedb700 1 -- 172.21.15.192:0/2517034727 >> 172.21.15.192:0/2517034727 conn(0x7f9cf80601b0 msgr2=0x7f9cf80c2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:04.218 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.212+0000 7f9cffedb700 1 -- 172.21.15.192:0/2517034727 shutdown_connections 2020-11-20T11:48:04.218 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.212+0000 7f9cffedb700 1 -- 172.21.15.192:0/2517034727 wait complete. 2020-11-20T11:48:04.227 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2020-11-20T11:48:04.335 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.332+0000 7f1901268700 1 Processor -- start 2020-11-20T11:48:04.336 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.332+0000 7f1901268700 1 -- start start 2020-11-20T11:48:04.340 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.332+0000 7f1901268700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f18fc0bf160 0x7f18fc0bf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:04.341 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.332+0000 7f1901268700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f18fc1537d0 0x7f18fc153c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:04.341 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.332+0000 7f1901268700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18fc152680 con 0x7f18fc151be0 2020-11-20T11:48:04.341 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.332+0000 7f1901268700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18fc064730 con 0x7f18fc0bf160 2020-11-20T11:48:04.341 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.332+0000 7f1901268700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18fc1528b0 con 0x7f18fc1537d0 2020-11-20T11:48:04.341 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.333+0000 7f18faffd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f18fc0bf160 0x7f18fc0bf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:04.342 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.333+0000 7f18faffd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f18fc0bf160 0x7f18fc0bf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.192:58144/0 (socket says 172.21.15.192:58144) 2020-11-20T11:48:04.342 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.333+0000 7f18fa7fc700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f18fc151be0 0x7f18fc062740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.192:38092/0 (socket says 172.21.15.192:38092) 2020-11-20T11:48:04.342 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.333+0000 7f18faffd700 1 -- 172.21.15.192:0/2295986143 learned_addr learned my addr 172.21.15.192:0/2295986143 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:04.342 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.333+0000 7f18fb7fe700 1 --2- 172.21.15.192:0/2295986143 >> v2:172.21.15.146:3300/0 conn(0x7f18fc1537d0 0x7f18fc153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:04.343 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.333+0000 7f18fb7fe700 1 -- 172.21.15.192:0/2295986143 >> v2:172.21.15.87:3300/0 conn(0x7f18fc0bf160 msgr2=0x7f18fc0bf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:04.343 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.333+0000 7f18fb7fe700 1 --2- 172.21.15.192:0/2295986143 >> v2:172.21.15.87:3300/0 conn(0x7f18fc0bf160 0x7f18fc0bf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:04.343 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.333+0000 7f18fb7fe700 1 -- 172.21.15.192:0/2295986143 >> v1:172.21.15.87:6789/0 conn(0x7f18fc151be0 legacy=0x7f18fc062740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:04.343 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.333+0000 7f18fb7fe700 1 -- 172.21.15.192:0/2295986143 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18fc152b50 con 0x7f18fc1537d0 2020-11-20T11:48:04.343 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.333+0000 7f18fb7fe700 1 --2- 172.21.15.192:0/2295986143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18fc1537d0 0x7f18fc153c40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f18f4009ce0 tx=0x7f18f4009220).ready entity=mon.1 client_cookie=7b8335475832c41b server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:04.344 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.333+0000 7f18f9ffb700 1 -- 172.21.15.192:0/2295986143 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f400ba90 con 0x7f18fc1537d0 2020-11-20T11:48:04.344 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.333+0000 7f18f9ffb700 1 -- 172.21.15.192:0/2295986143 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f400bbf0 con 0x7f18fc1537d0 2020-11-20T11:48:04.344 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.333+0000 7f18f9ffb700 1 -- 172.21.15.192:0/2295986143 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f4011400 con 0x7f18fc1537d0 2020-11-20T11:48:04.344 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.334+0000 7f1901268700 1 -- 172.21.15.192:0/2295986143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18fc1537d0 msgr2=0x7f18fc153c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:04.344 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.334+0000 7f1901268700 1 --2- 172.21.15.192:0/2295986143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18fc1537d0 0x7f18fc153c40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f18f4009ce0 tx=0x7f18f4009220).stop 2020-11-20T11:48:04.345 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.334+0000 7f1901268700 1 -- 172.21.15.192:0/2295986143 shutdown_connections 2020-11-20T11:48:04.345 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.334+0000 7f1901268700 1 --2- 172.21.15.192:0/2295986143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18fc1537d0 0x7f18fc153c40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:04.345 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.334+0000 7f1901268700 1 --2- 172.21.15.192:0/2295986143 >> v2:172.21.15.87:3300/0 conn(0x7f18fc0bf160 0x7f18fc0bf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:04.345 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.334+0000 7f1901268700 1 -- 172.21.15.192:0/2295986143 >> 172.21.15.192:0/2295986143 conn(0x7f18fc0601b0 msgr2=0x7f18fc0605c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:04.345 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.334+0000 7f1901268700 1 -- 172.21.15.192:0/2295986143 shutdown_connections 2020-11-20T11:48:04.346 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.334+0000 7f1901268700 1 -- 172.21.15.192:0/2295986143 wait complete. 2020-11-20T11:48:04.346 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.335+0000 7f1901268700 1 Processor -- start 2020-11-20T11:48:04.346 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.335+0000 7f1901268700 1 -- start start 2020-11-20T11:48:04.346 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.336+0000 7f1901268700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18fc0bf160 0x7f18fc0c1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:04.346 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.336+0000 7f1901268700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18fc151be0 0x7f18fc1639c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:04.347 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.336+0000 7f1901268700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18fc1537d0 0x7f18fc14f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:04.347 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.336+0000 7f1901268700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc14f070 con 0x7f18fc0bf160 2020-11-20T11:48:04.347 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.336+0000 7f1901268700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc155d70 con 0x7f18fc1537d0 2020-11-20T11:48:04.347 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.336+0000 7f1901268700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc164210 con 0x7f18fc151be0 2020-11-20T11:48:04.347 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.336+0000 7f18fa7fc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18fc151be0 0x7f18fc1639c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:04.348 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.336+0000 7f18fa7fc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18fc151be0 0x7f18fc1639c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48710/0 (socket says 172.21.15.192:48710) 2020-11-20T11:48:04.348 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.336+0000 7f18fa7fc700 1 -- 172.21.15.192:0/2327851639 learned_addr learned my addr 172.21.15.192:0/2327851639 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:04.348 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.336+0000 7f18faffd700 1 --2- 172.21.15.192:0/2327851639 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18fc0bf160 0x7f18fc0c1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:04.348 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.336+0000 7f18fb7fe700 1 --2- 172.21.15.192:0/2327851639 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18fc1537d0 0x7f18fc14f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:04.348 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.336+0000 7f18fa7fc700 1 -- 172.21.15.192:0/2327851639 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18fc1537d0 msgr2=0x7f18fc14f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:04.349 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.336+0000 7f18fa7fc700 1 --2- 172.21.15.192:0/2327851639 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18fc1537d0 0x7f18fc14f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:04.349 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.336+0000 7f18fa7fc700 1 -- 172.21.15.192:0/2327851639 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18fc0bf160 msgr2=0x7f18fc0c1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:04.349 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.336+0000 7f18fa7fc700 1 --2- 172.21.15.192:0/2327851639 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18fc0bf160 0x7f18fc0c1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:04.349 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.336+0000 7f18fa7fc700 1 -- 172.21.15.192:0/2327851639 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18fc1644b0 con 0x7f18fc151be0 2020-11-20T11:48:04.349 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.337+0000 7f18fa7fc700 1 --2- 172.21.15.192:0/2327851639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18fc151be0 0x7f18fc1639c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f18ec00c740 tx=0x7f18ec007c40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:04.350 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.337+0000 7f18e2ffd700 1 -- 172.21.15.192:0/2327851639 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec0072e0 con 0x7f18fc151be0 2020-11-20T11:48:04.350 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.337+0000 7f18e2ffd700 1 -- 172.21.15.192:0/2327851639 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ec005570 con 0x7f18fc151be0 2020-11-20T11:48:04.350 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.337+0000 7f18e2ffd700 1 -- 172.21.15.192:0/2327851639 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec0058f0 con 0x7f18fc151be0 2020-11-20T11:48:04.350 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.337+0000 7f1901268700 1 -- 172.21.15.192:0/2327851639 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18fc164750 con 0x7f18fc151be0 2020-11-20T11:48:04.350 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.337+0000 7f1901268700 1 -- 172.21.15.192:0/2327851639 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18fc14f540 con 0x7f18fc151be0 2020-11-20T11:48:04.352 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.338+0000 7f1901268700 1 -- 172.21.15.192:0/2327851639 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18fc05ca80 con 0x7f18fc151be0 2020-11-20T11:48:04.352 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.338+0000 7f18e2ffd700 1 -- 172.21.15.192:0/2327851639 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f18ec010070 con 0x7f18fc151be0 2020-11-20T11:48:04.352 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.339+0000 7f18e2ffd700 1 --2- 172.21.15.192:0/2327851639 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f18d8080670 0x7f18d8082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:04.352 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.339+0000 7f18e2ffd700 1 -- 172.21.15.192:0/2327851639 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f18ec0a1ac0 con 0x7f18fc151be0 2020-11-20T11:48:04.353 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.339+0000 7f18faffd700 1 --2- 172.21.15.192:0/2327851639 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f18d8080670 0x7f18d8082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:04.353 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.339+0000 7f18faffd700 1 --2- 172.21.15.192:0/2327851639 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f18d8080670 0x7f18d8082b30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f18f0006fd0 tx=0x7f18f0006e90).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:04.353 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.342+0000 7f18e2ffd700 1 -- 172.21.15.192:0/2327851639 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f18ec0769f0 con 0x7f18fc151be0 2020-11-20T11:48:04.494 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.490+0000 7f1901268700 1 -- 172.21.15.192:0/2327851639 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f18fc05c2e0 con 0x7f18fc151be0 2020-11-20T11:48:04.494 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.491+0000 7f18e2ffd700 1 -- 172.21.15.192:0/2327851639 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v22) v1 ==== 84+0+143 (secure 0 0 0) 0x7f18ec018070 con 0x7f18fc151be0 2020-11-20T11:48:04.494 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:48:04.495 INFO:teuthology.orchestra.run.smithi192.stdout:[ 2020-11-20T11:48:04.495 INFO:teuthology.orchestra.run.smithi192.stdout: { 2020-11-20T11:48:04.495 INFO:teuthology.orchestra.run.smithi192.stdout: "poolnum": 1, 2020-11-20T11:48:04.495 INFO:teuthology.orchestra.run.smithi192.stdout: "poolname": "device_health_metrics" 2020-11-20T11:48:04.495 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2020-11-20T11:48:04.496 INFO:teuthology.orchestra.run.smithi192.stdout: { 2020-11-20T11:48:04.496 INFO:teuthology.orchestra.run.smithi192.stdout: "poolnum": 2, 2020-11-20T11:48:04.496 INFO:teuthology.orchestra.run.smithi192.stdout: "poolname": "rbd" 2020-11-20T11:48:04.496 INFO:teuthology.orchestra.run.smithi192.stdout: } 2020-11-20T11:48:04.496 INFO:teuthology.orchestra.run.smithi192.stdout:] 2020-11-20T11:48:04.497 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.492+0000 7f1901268700 1 -- 172.21.15.192:0/2327851639 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f18d8080670 msgr2=0x7f18d8082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:04.497 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.492+0000 7f1901268700 1 --2- 172.21.15.192:0/2327851639 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f18d8080670 0x7f18d8082b30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f18f0006fd0 tx=0x7f18f0006e90).stop 2020-11-20T11:48:04.498 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.492+0000 7f1901268700 1 -- 172.21.15.192:0/2327851639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18fc151be0 msgr2=0x7f18fc1639c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:04.498 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.492+0000 7f1901268700 1 --2- 172.21.15.192:0/2327851639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18fc151be0 0x7f18fc1639c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f18ec00c740 tx=0x7f18ec007c40).stop 2020-11-20T11:48:04.498 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.493+0000 7f1901268700 1 -- 172.21.15.192:0/2327851639 shutdown_connections 2020-11-20T11:48:04.498 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.493+0000 7f1901268700 1 --2- 172.21.15.192:0/2327851639 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f18d8080670 0x7f18d8082b30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:04.499 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.493+0000 7f1901268700 1 --2- 172.21.15.192:0/2327851639 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18fc1537d0 0x7f18fc14f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:04.499 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.493+0000 7f1901268700 1 --2- 172.21.15.192:0/2327851639 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f18fc0bf160 0x7f18fc0c1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:04.499 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.493+0000 7f1901268700 1 --2- 172.21.15.192:0/2327851639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18fc151be0 0x7f18fc1639c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:04.499 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.493+0000 7f1901268700 1 -- 172.21.15.192:0/2327851639 >> 172.21.15.192:0/2327851639 conn(0x7f18fc0601b0 msgr2=0x7f18fc0664c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:04.499 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.493+0000 7f1901268700 1 -- 172.21.15.192:0/2327851639 shutdown_connections 2020-11-20T11:48:04.499 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.493+0000 7f1901268700 1 -- 172.21.15.192:0/2327851639 wait complete. 2020-11-20T11:48:04.508 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-11-20T11:48:04.508 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2020-11-20T11:48:04.626 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.622+0000 7ff7b6359700 1 Processor -- start 2020-11-20T11:48:04.626 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.622+0000 7ff7b6359700 1 -- start start 2020-11-20T11:48:04.628 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.623+0000 7ff7b6359700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff7b0060370 0x7ff7b0060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:04.628 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.623+0000 7ff7b6359700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7b00640e0 con 0x7ff7b00bd370 2020-11-20T11:48:04.628 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.623+0000 7ff7b6359700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7b01519c0 con 0x7ff7b00bdf30 2020-11-20T11:48:04.629 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.623+0000 7ff7b6359700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7b0151c60 con 0x7ff7b0060370 2020-11-20T11:48:04.629 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.624+0000 7ff7affff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff7b0060370 0x7ff7b0060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:04.629 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.624+0000 7ff7affff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ff7b0060370 0x7ff7b0060750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.192:58160/0 (socket says 172.21.15.192:58160) 2020-11-20T11:48:04.629 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.624+0000 7ff7b48f6700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ff7b00bd370 0x7ff7b0150770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.192:38104/0 (socket says 172.21.15.192:38104) 2020-11-20T11:48:04.629 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.624+0000 7ff7affff700 1 -- 172.21.15.192:0/3366699548 learned_addr learned my addr 172.21.15.192:0/3366699548 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:04.630 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.624+0000 7ff7affff700 1 -- 172.21.15.192:0/3366699548 >> v1:172.21.15.146:6789/0 conn(0x7ff7b00bdf30 legacy=0x7ff7b00647b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:04.630 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.624+0000 7ff7affff700 1 -- 172.21.15.192:0/3366699548 >> v1:172.21.15.87:6789/0 conn(0x7ff7b00bd370 legacy=0x7ff7b0150770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:04.630 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.624+0000 7ff7affff700 1 -- 172.21.15.192:0/3366699548 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b0151f00 con 0x7ff7b0060370 2020-11-20T11:48:04.630 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.624+0000 7ff7aeffd700 1 -- 172.21.15.192:0/3366699548 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2057963364 0 0) 0x7ff7b01519c0 con 0x7ff7b00bdf30 2020-11-20T11:48:04.630 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.624+0000 7ff7affff700 1 --2- 172.21.15.192:0/3366699548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7b0060370 0x7ff7b0060750 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7ff7a0009a10 tx=0x7ff7a0006ef0).ready entity=mon.0 client_cookie=54e036ef44edcd64 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:04.631 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.624+0000 7ff7aeffd700 1 -- 172.21.15.192:0/3366699548 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a000b8f0 con 0x7ff7b0060370 2020-11-20T11:48:04.631 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.624+0000 7ff7aeffd700 1 -- 172.21.15.192:0/3366699548 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a0000e90 con 0x7ff7b0060370 2020-11-20T11:48:04.631 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.624+0000 7ff7aeffd700 1 -- 172.21.15.192:0/3366699548 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a000bc60 con 0x7ff7b0060370 2020-11-20T11:48:04.631 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.625+0000 7ff7b6359700 1 -- 172.21.15.192:0/3366699548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7b0060370 msgr2=0x7ff7b0060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:04.631 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.625+0000 7ff7b6359700 1 --2- 172.21.15.192:0/3366699548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7b0060370 0x7ff7b0060750 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7ff7a0009a10 tx=0x7ff7a0006ef0).stop 2020-11-20T11:48:04.632 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.625+0000 7ff7b6359700 1 -- 172.21.15.192:0/3366699548 shutdown_connections 2020-11-20T11:48:04.632 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.625+0000 7ff7b6359700 1 --2- 172.21.15.192:0/3366699548 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7b0060370 0x7ff7b0060750 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:04.632 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.625+0000 7ff7b6359700 1 -- 172.21.15.192:0/3366699548 >> 172.21.15.192:0/3366699548 conn(0x7ff7b0062100 msgr2=0x7ff7b00c3590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:04.632 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.625+0000 7ff7b6359700 1 -- 172.21.15.192:0/3366699548 shutdown_connections 2020-11-20T11:48:04.632 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.625+0000 7ff7b6359700 1 -- 172.21.15.192:0/3366699548 wait complete. 2020-11-20T11:48:04.635 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.626+0000 7ff7b6359700 1 Processor -- start 2020-11-20T11:48:04.635 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.626+0000 7ff7b6359700 1 -- start start 2020-11-20T11:48:04.635 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.627+0000 7ff7b6359700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7b0060370 0x7ff7b0164670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:04.635 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.627+0000 7ff7b6359700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7b00bd370 0x7ff7b00b0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:04.636 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.627+0000 7ff7b6359700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7b00bdf30 0x7ff7b00bb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:04.636 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.627+0000 7ff7b6359700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b0164b60 con 0x7ff7b00bd370 2020-11-20T11:48:04.636 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.627+0000 7ff7b6359700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b00b0dc0 con 0x7ff7b0060370 2020-11-20T11:48:04.636 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.627+0000 7ff7b6359700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b00c2c30 con 0x7ff7b00bdf30 2020-11-20T11:48:04.637 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.627+0000 7ff7b48f6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7b00bdf30 0x7ff7b00bb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:04.637 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.627+0000 7ff7b48f6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7b00bdf30 0x7ff7b00bb4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48730/0 (socket says 172.21.15.192:48730) 2020-11-20T11:48:04.637 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.627+0000 7ff7b48f6700 1 -- 172.21.15.192:0/3603459191 learned_addr learned my addr 172.21.15.192:0/3603459191 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:04.637 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.627+0000 7ff7affff700 1 --2- 172.21.15.192:0/3603459191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7b0060370 0x7ff7b0164670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:04.637 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.627+0000 7ff7af7fe700 1 --2- 172.21.15.192:0/3603459191 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7b00bd370 0x7ff7b00b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:04.638 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.627+0000 7ff7b48f6700 1 -- 172.21.15.192:0/3603459191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7b0060370 msgr2=0x7ff7b0164670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:04.638 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.627+0000 7ff7b48f6700 1 --2- 172.21.15.192:0/3603459191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7b0060370 0x7ff7b0164670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:04.638 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.627+0000 7ff7b48f6700 1 -- 172.21.15.192:0/3603459191 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7b00bd370 msgr2=0x7ff7b00b0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:04.638 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.627+0000 7ff7b48f6700 1 --2- 172.21.15.192:0/3603459191 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7b00bd370 0x7ff7b00b0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:04.638 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.627+0000 7ff7b48f6700 1 -- 172.21.15.192:0/3603459191 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b00c2ed0 con 0x7ff7b00bdf30 2020-11-20T11:48:04.639 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.627+0000 7ff7b48f6700 1 --2- 172.21.15.192:0/3603459191 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7b00bdf30 0x7ff7b00bb4c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7ff7a800cac0 tx=0x7ff7a8007f50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:04.639 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.627+0000 7ff78ffff700 1 -- 172.21.15.192:0/3603459191 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a800cea0 con 0x7ff7b00bdf30 2020-11-20T11:48:04.639 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.627+0000 7ff78ffff700 1 -- 172.21.15.192:0/3603459191 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a8005b00 con 0x7ff7b00bdf30 2020-11-20T11:48:04.639 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.627+0000 7ff78ffff700 1 -- 172.21.15.192:0/3603459191 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a8005e80 con 0x7ff7b00bdf30 2020-11-20T11:48:04.639 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.627+0000 7ff7b6359700 1 -- 172.21.15.192:0/3603459191 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b00c3170 con 0x7ff7b00bdf30 2020-11-20T11:48:04.640 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.628+0000 7ff7b6359700 1 -- 172.21.15.192:0/3603459191 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b00c36b0 con 0x7ff7b00bdf30 2020-11-20T11:48:04.640 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.628+0000 7ff7b6359700 1 -- 172.21.15.192:0/3603459191 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7b00699a0 con 0x7ff7b00bdf30 2020-11-20T11:48:04.640 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.629+0000 7ff78ffff700 1 -- 172.21.15.192:0/3603459191 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7ff7a8010030 con 0x7ff7b00bdf30 2020-11-20T11:48:04.640 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.629+0000 7ff78ffff700 1 --2- 172.21.15.192:0/3603459191 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7ff7880806a0 0x7ff788082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:04.640 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.629+0000 7ff78ffff700 1 -- 172.21.15.192:0/3603459191 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 7093+0+0 (secure 0 0 0) 0x7ff7a80a2330 con 0x7ff7b00bdf30 2020-11-20T11:48:04.641 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.629+0000 7ff7affff700 1 --2- 172.21.15.192:0/3603459191 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7ff7880806a0 0x7ff788082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:04.641 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.630+0000 7ff7affff700 1 --2- 172.21.15.192:0/3603459191 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7ff7880806a0 0x7ff788082b60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7ff7a0006c60 tx=0x7ff7a0016000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:04.641 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.633+0000 7ff78ffff700 1 -- 172.21.15.192:0/3603459191 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7ff7a8077260 con 0x7ff7b00bdf30 2020-11-20T11:48:04.775 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:04.772+0000 7ff7b6359700 1 -- 172.21.15.192:0/3603459191 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7ff7b005ca80 con 0x7ff7b00bdf30 2020-11-20T11:48:05.479 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.476+0000 7ff78ffff700 1 -- 172.21.15.192:0/3603459191 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v23) v1 ==== 133+0+0 (secure 0 0 0) 0x7ff7a807a880 con 0x7ff7b00bdf30 2020-11-20T11:48:05.482 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.479+0000 7ff7b6359700 1 -- 172.21.15.192:0/3603459191 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7ff7880806a0 msgr2=0x7ff788082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:05.482 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.479+0000 7ff7b6359700 1 --2- 172.21.15.192:0/3603459191 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7ff7880806a0 0x7ff788082b60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7ff7a0006c60 tx=0x7ff7a0016000).stop 2020-11-20T11:48:05.483 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.479+0000 7ff7b6359700 1 -- 172.21.15.192:0/3603459191 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7b00bdf30 msgr2=0x7ff7b00bb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:05.483 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.479+0000 7ff7b6359700 1 --2- 172.21.15.192:0/3603459191 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7b00bdf30 0x7ff7b00bb4c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7ff7a800cac0 tx=0x7ff7a8007f50).stop 2020-11-20T11:48:05.483 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.479+0000 7ff7b6359700 1 -- 172.21.15.192:0/3603459191 shutdown_connections 2020-11-20T11:48:05.483 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.479+0000 7ff7b6359700 1 --2- 172.21.15.192:0/3603459191 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7ff7880806a0 0x7ff788082b60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:05.483 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.479+0000 7ff7b6359700 1 --2- 172.21.15.192:0/3603459191 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7b00bdf30 0x7ff7b00bb4c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:05.484 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.479+0000 7ff7b6359700 1 --2- 172.21.15.192:0/3603459191 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7b0060370 0x7ff7b0164670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:05.484 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.479+0000 7ff7b6359700 1 --2- 172.21.15.192:0/3603459191 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff7b00bd370 0x7ff7b00b0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:05.484 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.479+0000 7ff7b6359700 1 -- 172.21.15.192:0/3603459191 >> 172.21.15.192:0/3603459191 conn(0x7ff7b0062100 msgr2=0x7ff7b0151090 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:05.484 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.479+0000 7ff7b6359700 1 -- 172.21.15.192:0/3603459191 shutdown_connections 2020-11-20T11:48:05.484 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.479+0000 7ff7b6359700 1 -- 172.21.15.192:0/3603459191 wait complete. 2020-11-20T11:48:05.485 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_metadata' created 2020-11-20T11:48:05.496 INFO:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2020-11-20T11:48:05.496 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data m=2 k=2 crush-failure-domain=osd 2020-11-20T11:48:05.616 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.613+0000 7f0b8b98e700 1 Processor -- start 2020-11-20T11:48:05.617 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.613+0000 7f0b8b98e700 1 -- start start 2020-11-20T11:48:05.620 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.614+0000 7f0b8b98e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0b84150e60 0x7f0b840c31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:05.620 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.614+0000 7f0b8b98e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b841514c0 con 0x7f0b840622e0 2020-11-20T11:48:05.620 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.614+0000 7f0b8b98e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b84155800 con 0x7f0b84061f00 2020-11-20T11:48:05.621 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.614+0000 7f0b8b98e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b84151720 con 0x7f0b84150e60 2020-11-20T11:48:05.621 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.614+0000 7f0b8972a700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f0b84061f00 0x7f0b84150750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51402/0 (socket says 172.21.15.192:51402) 2020-11-20T11:48:05.621 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.614+0000 7f0b8972a700 1 -- 172.21.15.192:0/1194210686 learned_addr learned my addr 172.21.15.192:0/1194210686 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:05.621 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.614+0000 7f0b89f2b700 1 --2- 172.21.15.192:0/1194210686 >> v2:172.21.15.87:3300/0 conn(0x7f0b84150e60 0x7f0b840c31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:05.621 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.615+0000 7f0b73fff700 1 -- 172.21.15.192:0/1194210686 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2718245509 0 0) 0x7f0b84155800 con 0x7f0b84061f00 2020-11-20T11:48:05.622 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.615+0000 7f0b73fff700 1 -- 172.21.15.192:0/1194210686 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b6c003280 con 0x7f0b84061f00 2020-11-20T11:48:05.622 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.615+0000 7f0b73fff700 1 -- 172.21.15.192:0/1194210686 <== mon.2 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1696463208 0 0) 0x7f0b6c003280 con 0x7f0b84061f00 2020-11-20T11:48:05.622 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.615+0000 7f0b73fff700 1 -- 172.21.15.192:0/1194210686 >> v2:172.21.15.87:3300/0 conn(0x7f0b84150e60 msgr2=0x7f0b840c31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:05.622 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.615+0000 7f0b73fff700 1 --2- 172.21.15.192:0/1194210686 >> v2:172.21.15.87:3300/0 conn(0x7f0b84150e60 0x7f0b840c31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:05.622 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.615+0000 7f0b73fff700 1 -- 172.21.15.192:0/1194210686 >> v1:172.21.15.146:6789/0 conn(0x7f0b840622e0 legacy=0x7f0b840c2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:05.623 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.615+0000 7f0b73fff700 1 -- 172.21.15.192:0/1194210686 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b841519c0 con 0x7f0b84061f00 2020-11-20T11:48:05.623 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.615+0000 7f0b73fff700 1 -- 172.21.15.192:0/1194210686 <== mon.2 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3985397220 0 0) 0x7f0b7c0018a0 con 0x7f0b84061f00 2020-11-20T11:48:05.623 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.615+0000 7f0b89f2b700 1 --2- 172.21.15.192:0/1194210686 >> v2:172.21.15.87:3300/0 conn(0x7f0b84150e60 0x7f0b840c31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:48:05.623 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.615+0000 7f0b73fff700 1 -- 172.21.15.192:0/1194210686 >> v1:172.21.15.192:6789/0 conn(0x7f0b84061f00 legacy=0x7f0b84150750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:05.624 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.615+0000 7f0b73fff700 1 --2- 172.21.15.192:0/1194210686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b6c0037c0 0x7f0b6c003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:05.624 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.615+0000 7f0b73fff700 1 --2- 172.21.15.192:0/1194210686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b6c004520 0x7f0b6c0049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:05.624 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.615+0000 7f0b73fff700 1 --2- 172.21.15.192:0/1194210686 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b6c004e90 0x7f0b6c00b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:05.624 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.615+0000 7f0b73fff700 1 -- 172.21.15.192:0/1194210686 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b84151720 con 0x7f0b6c004e90 2020-11-20T11:48:05.624 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.615+0000 7f0b73fff700 1 -- 172.21.15.192:0/1194210686 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c005340 con 0x7f0b6c004520 2020-11-20T11:48:05.625 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.615+0000 7f0b73fff700 1 -- 172.21.15.192:0/1194210686 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c00bc60 con 0x7f0b6c0037c0 2020-11-20T11:48:05.625 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.615+0000 7f0b8972a700 1 --2- 172.21.15.192:0/1194210686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b6c0037c0 0x7f0b6c003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:05.625 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.615+0000 7f0b88f29700 1 --2- 172.21.15.192:0/1194210686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b6c004520 0x7f0b6c0049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:05.625 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.615+0000 7f0b89f2b700 1 --2- 172.21.15.192:0/1194210686 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b6c004e90 0x7f0b6c00b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:05.625 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.615+0000 7f0b8972a700 1 -- 172.21.15.192:0/1194210686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b6c004520 msgr2=0x7f0b6c0049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:05.626 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.615+0000 7f0b8972a700 1 --2- 172.21.15.192:0/1194210686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b6c004520 0x7f0b6c0049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:05.626 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.615+0000 7f0b8972a700 1 -- 172.21.15.192:0/1194210686 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b6c004e90 msgr2=0x7f0b6c00b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:05.626 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.615+0000 7f0b8972a700 1 --2- 172.21.15.192:0/1194210686 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b6c004e90 0x7f0b6c00b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:05.626 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.615+0000 7f0b89f2b700 1 -- 172.21.15.192:0/1194210686 reap_dead start 2020-11-20T11:48:05.626 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.615+0000 7f0b8972a700 1 -- 172.21.15.192:0/1194210686 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6c003280 con 0x7f0b6c0037c0 2020-11-20T11:48:05.627 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.615+0000 7f0b88f29700 1 --2- 172.21.15.192:0/1194210686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b6c004520 0x7f0b6c0049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:48:05.627 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.615+0000 7f0b8972a700 1 --2- 172.21.15.192:0/1194210686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b6c0037c0 0x7f0b6c003be0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f0b7c00c840 tx=0x7f0b84151b50).ready entity=mon.2 client_cookie=a21898397103deef server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:05.627 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.615+0000 7f0b73fff700 1 -- 172.21.15.192:0/1194210686 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c007b90 con 0x7f0b6c0037c0 2020-11-20T11:48:05.627 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.615+0000 7f0b73fff700 1 -- 172.21.15.192:0/1194210686 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7c005bc0 con 0x7f0b6c0037c0 2020-11-20T11:48:05.627 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.615+0000 7f0b73fff700 1 -- 172.21.15.192:0/1194210686 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c007110 con 0x7f0b6c0037c0 2020-11-20T11:48:05.628 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.616+0000 7f0b8b98e700 1 -- 172.21.15.192:0/1194210686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b6c0037c0 msgr2=0x7f0b6c003be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:05.628 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.616+0000 7f0b8b98e700 1 --2- 172.21.15.192:0/1194210686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b6c0037c0 0x7f0b6c003be0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f0b7c00c840 tx=0x7f0b84151b50).stop 2020-11-20T11:48:05.628 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.616+0000 7f0b8b98e700 1 -- 172.21.15.192:0/1194210686 shutdown_connections 2020-11-20T11:48:05.628 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.616+0000 7f0b8b98e700 1 --2- 172.21.15.192:0/1194210686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b6c0037c0 0x7f0b6c003be0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:05.628 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.616+0000 7f0b8b98e700 1 -- 172.21.15.192:0/1194210686 >> 172.21.15.192:0/1194210686 conn(0x7f0b840c4e80 msgr2=0x7f0b84061630 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:05.629 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.616+0000 7f0b8b98e700 1 -- 172.21.15.192:0/1194210686 shutdown_connections 2020-11-20T11:48:05.629 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.616+0000 7f0b8b98e700 1 -- 172.21.15.192:0/1194210686 wait complete. 2020-11-20T11:48:05.631 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.617+0000 7f0b8b98e700 1 Processor -- start 2020-11-20T11:48:05.632 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.617+0000 7f0b8b98e700 1 -- start start 2020-11-20T11:48:05.632 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.618+0000 7f0b8b98e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b6c0037c0 0x7f0b84155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:05.632 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.619+0000 7f0b8b98e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b84164ca0 0x7f0b8414deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:05.632 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.619+0000 7f0b8b98e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b8414e3a0 0x7f0b84156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:05.632 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.619+0000 7f0b8b98e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b84164090 con 0x7f0b6c0037c0 2020-11-20T11:48:05.633 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.619+0000 7f0b8b98e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b84153eb0 con 0x7f0b8414e3a0 2020-11-20T11:48:05.633 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.619+0000 7f0b8b98e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b84154150 con 0x7f0b84164ca0 2020-11-20T11:48:05.633 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.619+0000 7f0b8972a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b6c0037c0 0x7f0b84155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:05.633 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.619+0000 7f0b88f29700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b84164ca0 0x7f0b8414deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:05.633 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.619+0000 7f0b88f29700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b84164ca0 0x7f0b8414deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48748/0 (socket says 172.21.15.192:48748) 2020-11-20T11:48:05.634 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.619+0000 7f0b8972a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b6c0037c0 0x7f0b84155110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.192:58186/0 (socket says 172.21.15.192:58186) 2020-11-20T11:48:05.634 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.619+0000 7f0b88f29700 1 -- 172.21.15.192:0/2975886309 learned_addr learned my addr 172.21.15.192:0/2975886309 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:05.634 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.619+0000 7f0b89f2b700 1 --2- 172.21.15.192:0/2975886309 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b8414e3a0 0x7f0b84156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:05.634 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.619+0000 7f0b88f29700 1 -- 172.21.15.192:0/2975886309 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b8414e3a0 msgr2=0x7f0b84156000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:05.634 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.619+0000 7f0b88f29700 1 --2- 172.21.15.192:0/2975886309 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b8414e3a0 0x7f0b84156000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:05.635 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.619+0000 7f0b88f29700 1 -- 172.21.15.192:0/2975886309 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b6c0037c0 msgr2=0x7f0b84155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:05.635 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.619+0000 7f0b88f29700 1 --2- 172.21.15.192:0/2975886309 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b6c0037c0 0x7f0b84155110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:05.635 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.619+0000 7f0b88f29700 1 -- 172.21.15.192:0/2975886309 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b841642c0 con 0x7f0b84164ca0 2020-11-20T11:48:05.635 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.619+0000 7f0b88f29700 1 --2- 172.21.15.192:0/2975886309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b84164ca0 0x7f0b8414deb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f0b7400e790 tx=0x7f0b74009040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:05.635 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.619+0000 7f0b717fa700 1 -- 172.21.15.192:0/2975886309 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b74010520 con 0x7f0b84164ca0 2020-11-20T11:48:05.636 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.619+0000 7f0b717fa700 1 -- 172.21.15.192:0/2975886309 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b74010680 con 0x7f0b84164ca0 2020-11-20T11:48:05.636 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.619+0000 7f0b717fa700 1 -- 172.21.15.192:0/2975886309 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b74010a20 con 0x7f0b84164ca0 2020-11-20T11:48:05.636 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.619+0000 7f0b8b98e700 1 -- 172.21.15.192:0/2975886309 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b84164560 con 0x7f0b84164ca0 2020-11-20T11:48:05.636 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.619+0000 7f0b8b98e700 1 -- 172.21.15.192:0/2975886309 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b8414e920 con 0x7f0b84164ca0 2020-11-20T11:48:05.636 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.620+0000 7f0b8b98e700 1 -- 172.21.15.192:0/2975886309 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b840699a0 con 0x7f0b84164ca0 2020-11-20T11:48:05.637 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.621+0000 7f0b717fa700 1 -- 172.21.15.192:0/2975886309 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f0b74014430 con 0x7f0b84164ca0 2020-11-20T11:48:05.637 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.621+0000 7f0b717fa700 1 --2- 172.21.15.192:0/2975886309 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f0b5c080670 0x7f0b5c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:05.637 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.621+0000 7f0b717fa700 1 -- 172.21.15.192:0/2975886309 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 7447+0+0 (secure 0 0 0) 0x7f0b740a27b0 con 0x7f0b84164ca0 2020-11-20T11:48:05.637 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.621+0000 7f0b8972a700 1 --2- 172.21.15.192:0/2975886309 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f0b5c080670 0x7f0b5c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:05.637 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.622+0000 7f0b8972a700 1 --2- 172.21.15.192:0/2975886309 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f0b5c080670 0x7f0b5c082b30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f0b7c00c840 tx=0x7f0b7c014000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:05.638 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.625+0000 7f0b717fa700 1 -- 172.21.15.192:0/2975886309 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f0b74077520 con 0x7f0b84164ca0 2020-11-20T11:48:05.777 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:05.774+0000 7f0b8b98e700 1 -- 172.21.15.192:0/2975886309 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f0b8405ca80 con 0x7f0b84164ca0 2020-11-20T11:48:06.482 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.479+0000 7f0b717fa700 1 -- 172.21.15.192:0/2975886309 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v24) v1 ==== 154+0+0 (secure 0 0 0) 0x7f0b7407ab40 con 0x7f0b84164ca0 2020-11-20T11:48:06.485 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.482+0000 7f0b8b98e700 1 -- 172.21.15.192:0/2975886309 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f0b5c080670 msgr2=0x7f0b5c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:06.485 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.482+0000 7f0b8b98e700 1 --2- 172.21.15.192:0/2975886309 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f0b5c080670 0x7f0b5c082b30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f0b7c00c840 tx=0x7f0b7c014000).stop 2020-11-20T11:48:06.486 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.482+0000 7f0b8b98e700 1 -- 172.21.15.192:0/2975886309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b84164ca0 msgr2=0x7f0b8414deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:06.486 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.482+0000 7f0b8b98e700 1 --2- 172.21.15.192:0/2975886309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b84164ca0 0x7f0b8414deb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f0b7400e790 tx=0x7f0b74009040).stop 2020-11-20T11:48:06.486 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.482+0000 7f0b8b98e700 1 -- 172.21.15.192:0/2975886309 shutdown_connections 2020-11-20T11:48:06.486 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.482+0000 7f0b8b98e700 1 --2- 172.21.15.192:0/2975886309 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f0b5c080670 0x7f0b5c082b30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:06.486 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.482+0000 7f0b8b98e700 1 --2- 172.21.15.192:0/2975886309 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b8414e3a0 0x7f0b84156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:06.487 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.482+0000 7f0b8b98e700 1 --2- 172.21.15.192:0/2975886309 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0b6c0037c0 0x7f0b84155110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:06.487 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.482+0000 7f0b8b98e700 1 --2- 172.21.15.192:0/2975886309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b84164ca0 0x7f0b8414deb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:06.487 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.482+0000 7f0b8b98e700 1 -- 172.21.15.192:0/2975886309 >> 172.21.15.192:0/2975886309 conn(0x7f0b840c4e80 msgr2=0x7f0b8414d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:06.487 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.482+0000 7f0b8b98e700 1 -- 172.21.15.192:0/2975886309 shutdown_connections 2020-11-20T11:48:06.487 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.482+0000 7f0b8b98e700 1 -- 172.21.15.192:0/2975886309 wait complete. 2020-11-20T11:48:06.499 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 erasure cephfs_data 2020-11-20T11:48:06.620 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.617+0000 7fa4fa562700 1 Processor -- start 2020-11-20T11:48:06.621 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.617+0000 7fa4fa562700 1 -- start start 2020-11-20T11:48:06.623 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.618+0000 7fa4fa562700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa4f4060750 0x7fa4f4064c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:06.623 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.618+0000 7fa4fa562700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4f4065130 con 0x7fa4f4154920 2020-11-20T11:48:06.624 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.618+0000 7fa4fa562700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4f4151e80 con 0x7fa4f4060370 2020-11-20T11:48:06.624 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.618+0000 7fa4fa562700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4f4152120 con 0x7fa4f4060750 2020-11-20T11:48:06.624 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.618+0000 7fa4f8aff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa4f4060750 0x7fa4f4064c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:06.624 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.618+0000 7fa4f3fff700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fa4f4060370 0x7fa4f40c2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51422/0 (socket says 172.21.15.192:51422) 2020-11-20T11:48:06.624 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.618+0000 7fa4f3fff700 1 -- 172.21.15.192:0/493203348 learned_addr learned my addr 172.21.15.192:0/493203348 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:06.625 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.618+0000 7fa4f8aff700 1 -- 172.21.15.192:0/493203348 >> v1:172.21.15.192:6789/0 conn(0x7fa4f4060370 legacy=0x7fa4f40c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:06.625 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.618+0000 7fa4f8aff700 1 -- 172.21.15.192:0/493203348 >> v1:172.21.15.146:6789/0 conn(0x7fa4f4154920 legacy=0x7fa4f4151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:06.625 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.618+0000 7fa4f37fe700 1 -- 172.21.15.192:0/493203348 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1292260158 0 0) 0x7fa4f4151e80 con 0x7fa4f4060370 2020-11-20T11:48:06.625 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.618+0000 7fa4f8aff700 1 -- 172.21.15.192:0/493203348 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f4064260 con 0x7fa4f4060750 2020-11-20T11:48:06.625 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.618+0000 7fa4f8aff700 1 --2- 172.21.15.192:0/493203348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4f4060750 0x7fa4f4064c40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fa4ec009ce0 tx=0x7fa4ec009220).ready entity=mon.2 client_cookie=36682ac88801b290 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:06.626 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.619+0000 7fa4f37fe700 1 -- 172.21.15.192:0/493203348 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec00bc80 con 0x7fa4f4060750 2020-11-20T11:48:06.626 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.619+0000 7fa4f37fe700 1 -- 172.21.15.192:0/493203348 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4ec00bde0 con 0x7fa4f4060750 2020-11-20T11:48:06.626 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.619+0000 7fa4f37fe700 1 -- 172.21.15.192:0/493203348 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec011610 con 0x7fa4f4060750 2020-11-20T11:48:06.626 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.619+0000 7fa4fa562700 1 -- 172.21.15.192:0/493203348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4f4060750 msgr2=0x7fa4f4064c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:06.626 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.619+0000 7fa4fa562700 1 --2- 172.21.15.192:0/493203348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4f4060750 0x7fa4f4064c40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fa4ec009ce0 tx=0x7fa4ec009220).stop 2020-11-20T11:48:06.627 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.619+0000 7fa4fa562700 1 -- 172.21.15.192:0/493203348 shutdown_connections 2020-11-20T11:48:06.627 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.619+0000 7fa4fa562700 1 --2- 172.21.15.192:0/493203348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4f4060750 0x7fa4f4064c40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:06.627 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.619+0000 7fa4fa562700 1 -- 172.21.15.192:0/493203348 >> 172.21.15.192:0/493203348 conn(0x7fa4f4062100 msgr2=0x7fa4f40c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:06.627 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.619+0000 7fa4fa562700 1 -- 172.21.15.192:0/493203348 shutdown_connections 2020-11-20T11:48:06.627 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.619+0000 7fa4fa562700 1 -- 172.21.15.192:0/493203348 wait complete. 2020-11-20T11:48:06.628 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.620+0000 7fa4fa562700 1 Processor -- start 2020-11-20T11:48:06.628 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.620+0000 7fa4fa562700 1 -- start start 2020-11-20T11:48:06.632 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.621+0000 7fa4fa562700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4f4060370 0x7fa4f4067b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:06.633 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.621+0000 7fa4fa562700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4f4060750 0x7fa4f40b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:06.633 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.621+0000 7fa4fa562700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4f4154920 0x7fa4f40b12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:06.633 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.621+0000 7fa4fa562700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f4161550 con 0x7fa4f4154920 2020-11-20T11:48:06.634 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.621+0000 7fa4fa562700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f4160ad0 con 0x7fa4f4060750 2020-11-20T11:48:06.634 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.621+0000 7fa4fa562700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f4160d70 con 0x7fa4f4060370 2020-11-20T11:48:06.634 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.621+0000 7fa4f3fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4f4060370 0x7fa4f4067b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:06.634 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.621+0000 7fa4f3fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4f4060370 0x7fa4f4067b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48760/0 (socket says 172.21.15.192:48760) 2020-11-20T11:48:06.634 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.621+0000 7fa4f3fff700 1 -- 172.21.15.192:0/1826091058 learned_addr learned my addr 172.21.15.192:0/1826091058 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:06.635 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.621+0000 7fa4ebfff700 1 --2- 172.21.15.192:0/1826091058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4f4060750 0x7fa4f40b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:06.635 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.621+0000 7fa4f3fff700 1 -- 172.21.15.192:0/1826091058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4f4060750 msgr2=0x7fa4f40b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:06.635 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.621+0000 7fa4f3fff700 1 --2- 172.21.15.192:0/1826091058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4f4060750 0x7fa4f40b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:06.636 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.621+0000 7fa4f3fff700 1 -- 172.21.15.192:0/1826091058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4f4154920 msgr2=0x7fa4f40b12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:06.636 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.621+0000 7fa4f3fff700 1 --2- 172.21.15.192:0/1826091058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4f4154920 0x7fa4f40b12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:48:06.636 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.621+0000 7fa4f3fff700 1 -- 172.21.15.192:0/1826091058 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f4161010 con 0x7fa4f4060370 2020-11-20T11:48:06.636 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.621+0000 7fa4ebfff700 1 --2- 172.21.15.192:0/1826091058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4f4060750 0x7fa4f40b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:48:06.636 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.621+0000 7fa4f3fff700 1 --2- 172.21.15.192:0/1826091058 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4f4060370 0x7fa4f4067b50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fa4e400c760 tx=0x7fa4e4007d20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:06.636 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.622+0000 7fa4f0ff9700 1 -- 172.21.15.192:0/1826091058 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e4007320 con 0x7fa4f4060370 2020-11-20T11:48:06.637 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.622+0000 7fa4f0ff9700 1 -- 172.21.15.192:0/1826091058 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e4007480 con 0x7fa4f4060370 2020-11-20T11:48:06.637 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.622+0000 7fa4fa562700 1 -- 172.21.15.192:0/1826091058 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4f41612b0 con 0x7fa4f4060370 2020-11-20T11:48:06.637 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.622+0000 7fa4f0ff9700 1 -- 172.21.15.192:0/1826091058 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e4005840 con 0x7fa4f4060370 2020-11-20T11:48:06.637 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.622+0000 7fa4fa562700 1 -- 172.21.15.192:0/1826091058 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4f40c0c40 con 0x7fa4f4060370 2020-11-20T11:48:06.638 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.623+0000 7fa4fa562700 1 -- 172.21.15.192:0/1826091058 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4f40699a0 con 0x7fa4f4060370 2020-11-20T11:48:06.638 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.623+0000 7fa4f0ff9700 1 -- 172.21.15.192:0/1826091058 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fa4e4010030 con 0x7fa4f4060370 2020-11-20T11:48:06.638 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.623+0000 7fa4f0ff9700 1 --2- 172.21.15.192:0/1826091058 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fa4d0080670 0x7fa4d0082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:06.638 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.624+0000 7fa4ebfff700 1 --2- 172.21.15.192:0/1826091058 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fa4d0080670 0x7fa4d0082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:06.638 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.624+0000 7fa4f0ff9700 1 -- 172.21.15.192:0/1826091058 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 7703+0+0 (secure 0 0 0) 0x7fa4e40a2410 con 0x7fa4f4060370 2020-11-20T11:48:06.639 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.624+0000 7fa4ebfff700 1 --2- 172.21.15.192:0/1826091058 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fa4d0080670 0x7fa4d0082b30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fa4f40612d0 tx=0x7fa4dc009040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:06.639 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.627+0000 7fa4f0ff9700 1 -- 172.21.15.192:0/1826091058 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fa4e40770e0 con 0x7fa4f4060370 2020-11-20T11:48:06.773 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:06.770+0000 7fa4fa562700 1 -- 172.21.15.192:0/1826091058 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"} v 0) v1 -- 0x7fa4f405ca80 con 0x7fa4f4060370 2020-11-20T11:48:08.494 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.491+0000 7fa4f0ff9700 1 -- 172.21.15.192:0/1826091058 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"}]=0 pool 'cephfs_data' created v26) v1 ==== 188+0+0 (secure 0 0 0) 0x7fa4e407a700 con 0x7fa4f4060370 2020-11-20T11:48:08.497 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.494+0000 7fa4fa562700 1 -- 172.21.15.192:0/1826091058 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fa4d0080670 msgr2=0x7fa4d0082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:08.498 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.494+0000 7fa4fa562700 1 --2- 172.21.15.192:0/1826091058 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fa4d0080670 0x7fa4d0082b30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fa4f40612d0 tx=0x7fa4dc009040).stop 2020-11-20T11:48:08.498 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.494+0000 7fa4fa562700 1 -- 172.21.15.192:0/1826091058 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4f4060370 msgr2=0x7fa4f4067b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:08.498 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.494+0000 7fa4fa562700 1 --2- 172.21.15.192:0/1826091058 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4f4060370 0x7fa4f4067b50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fa4e400c760 tx=0x7fa4e4007d20).stop 2020-11-20T11:48:08.498 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.494+0000 7fa4fa562700 1 -- 172.21.15.192:0/1826091058 shutdown_connections 2020-11-20T11:48:08.498 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.494+0000 7fa4fa562700 1 --2- 172.21.15.192:0/1826091058 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fa4d0080670 0x7fa4d0082b30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:08.499 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.494+0000 7fa4fa562700 1 --2- 172.21.15.192:0/1826091058 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa4f4154920 0x7fa4f40b12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:48:08.499 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.494+0000 7fa4fa562700 1 --2- 172.21.15.192:0/1826091058 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4f4060370 0x7fa4f4067b50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:08.499 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.494+0000 7fa4fa562700 1 --2- 172.21.15.192:0/1826091058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4f4060750 0x7fa4f40b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:08.499 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.494+0000 7fa4fa562700 1 -- 172.21.15.192:0/1826091058 >> 172.21.15.192:0/1826091058 conn(0x7fa4f4062100 msgr2=0x7fa4f40c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:08.499 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.494+0000 7fa4fa562700 1 -- 172.21.15.192:0/1826091058 shutdown_connections 2020-11-20T11:48:08.500 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.494+0000 7fa4fa562700 1 -- 172.21.15.192:0/1826091058 wait complete. 2020-11-20T11:48:08.500 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_data' created 2020-11-20T11:48:08.512 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data allow_ec_overwrites true 2020-11-20T11:48:08.653 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.649+0000 7f4871c0d700 1 Processor -- start 2020-11-20T11:48:08.653 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.650+0000 7f4871c0d700 1 -- start start 2020-11-20T11:48:08.656 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.650+0000 7f4871c0d700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f486c151e80 con 0x7f486c060750 2020-11-20T11:48:08.657 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.650+0000 7f4871c0d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f486c152120 con 0x7f486c060370 2020-11-20T11:48:08.657 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.650+0000 7f4871c0d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f486c064260 con 0x7f486c154920 2020-11-20T11:48:08.657 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.650+0000 7f486affd700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f486c154920 0x7f486c151340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51436/0 (socket says 172.21.15.192:51436) 2020-11-20T11:48:08.657 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.650+0000 7f486affd700 1 -- 172.21.15.192:0/1501567622 learned_addr learned my addr 172.21.15.192:0/1501567622 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:08.658 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.651+0000 7f486a7fc700 1 -- 172.21.15.192:0/1501567622 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 510166577 0 0) 0x7f486c064260 con 0x7f486c154920 2020-11-20T11:48:08.658 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.651+0000 7f486a7fc700 1 -- 172.21.15.192:0/1501567622 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4858003280 con 0x7f486c154920 2020-11-20T11:48:08.658 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.651+0000 7f486a7fc700 1 -- 172.21.15.192:0/1501567622 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1776626088 0 0) 0x7f486c152120 con 0x7f486c060370 2020-11-20T11:48:08.658 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.651+0000 7f486a7fc700 1 -- 172.21.15.192:0/1501567622 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f486c064260 con 0x7f486c060370 2020-11-20T11:48:08.658 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.651+0000 7f486a7fc700 1 -- 172.21.15.192:0/1501567622 <== mon.2 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1682234929 0 0) 0x7f4858003280 con 0x7f486c154920 2020-11-20T11:48:08.659 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.651+0000 7f486a7fc700 1 -- 172.21.15.192:0/1501567622 >> v1:172.21.15.146:6789/0 conn(0x7f486c060370 legacy=0x7f486c0c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:08.659 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.651+0000 7f486a7fc700 1 -- 172.21.15.192:0/1501567622 >> v1:172.21.15.87:6789/0 conn(0x7f486c060750 legacy=0x7f486c15bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:08.659 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.651+0000 7f486a7fc700 1 -- 172.21.15.192:0/1501567622 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f486c064500 con 0x7f486c154920 2020-11-20T11:48:08.659 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.651+0000 7f486a7fc700 1 -- 172.21.15.192:0/1501567622 <== mon.2 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3985397220 0 0) 0x7f4860001520 con 0x7f486c154920 2020-11-20T11:48:08.659 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.651+0000 7f486a7fc700 1 -- 172.21.15.192:0/1501567622 >> v1:172.21.15.192:6789/0 conn(0x7f486c154920 legacy=0x7f486c151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:08.660 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.651+0000 7f486a7fc700 1 --2- 172.21.15.192:0/1501567622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4858003950 0x7f4858003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:08.660 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.651+0000 7f486a7fc700 1 --2- 172.21.15.192:0/1501567622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4858004520 0x7f48580049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:08.660 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.651+0000 7f486a7fc700 1 --2- 172.21.15.192:0/1501567622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4858004e90 0x7f485800b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:08.660 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.651+0000 7f486a7fc700 1 -- 172.21.15.192:0/1501567622 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485800bc60 con 0x7f4858003950 2020-11-20T11:48:08.660 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.651+0000 7f486a7fc700 1 -- 172.21.15.192:0/1501567622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485800bda0 con 0x7f4858004e90 2020-11-20T11:48:08.661 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.651+0000 7f486a7fc700 1 -- 172.21.15.192:0/1501567622 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485800bee0 con 0x7f4858004520 2020-11-20T11:48:08.661 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.651+0000 7f486affd700 1 --2- 172.21.15.192:0/1501567622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4858004520 0x7f48580049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:08.661 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.651+0000 7f486b7fe700 1 --2- 172.21.15.192:0/1501567622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4858003950 0x7f4858003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:08.661 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.651+0000 7f486bfff700 1 --2- 172.21.15.192:0/1501567622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4858004e90 0x7f485800b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:08.661 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.651+0000 7f486affd700 1 -- 172.21.15.192:0/1501567622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4858004e90 msgr2=0x7f485800b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:08.662 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.651+0000 7f486affd700 1 --2- 172.21.15.192:0/1501567622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4858004e90 0x7f485800b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:08.662 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.651+0000 7f486affd700 1 -- 172.21.15.192:0/1501567622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4858003950 msgr2=0x7f4858003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:08.662 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.651+0000 7f486affd700 1 --2- 172.21.15.192:0/1501567622 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4858003950 0x7f4858003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:08.662 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.651+0000 7f486bfff700 1 -- 172.21.15.192:0/1501567622 reap_dead start 2020-11-20T11:48:08.662 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.652+0000 7f486affd700 1 -- 172.21.15.192:0/1501567622 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4858003280 con 0x7f4858004520 2020-11-20T11:48:08.663 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.652+0000 7f486affd700 1 --2- 172.21.15.192:0/1501567622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4858004520 0x7f48580049a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f486000c440 tx=0x7f486c0643f0).ready entity=mon.2 client_cookie=997203ecb2f9d273 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:08.663 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.652+0000 7f486a7fc700 1 -- 172.21.15.192:0/1501567622 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48600070d0 con 0x7f4858004520 2020-11-20T11:48:08.663 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.652+0000 7f486a7fc700 1 -- 172.21.15.192:0/1501567622 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4860007230 con 0x7f4858004520 2020-11-20T11:48:08.663 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.652+0000 7f486a7fc700 1 -- 172.21.15.192:0/1501567622 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4860005630 con 0x7f4858004520 2020-11-20T11:48:08.663 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.652+0000 7f4871c0d700 1 -- 172.21.15.192:0/1501567622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4858004520 msgr2=0x7f48580049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:08.663 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.652+0000 7f4871c0d700 1 --2- 172.21.15.192:0/1501567622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4858004520 0x7f48580049a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f486000c440 tx=0x7f486c0643f0).stop 2020-11-20T11:48:08.664 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.652+0000 7f4871c0d700 1 -- 172.21.15.192:0/1501567622 shutdown_connections 2020-11-20T11:48:08.664 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.652+0000 7f4871c0d700 1 --2- 172.21.15.192:0/1501567622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4858004520 0x7f48580049a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:08.664 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.652+0000 7f4871c0d700 1 -- 172.21.15.192:0/1501567622 >> 172.21.15.192:0/1501567622 conn(0x7f486c062100 msgr2=0x7f486c0c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:08.664 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.652+0000 7f4871c0d700 1 -- 172.21.15.192:0/1501567622 shutdown_connections 2020-11-20T11:48:08.664 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.652+0000 7f4871c0d700 1 -- 172.21.15.192:0/1501567622 wait complete. 2020-11-20T11:48:08.665 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.654+0000 7f4871c0d700 1 Processor -- start 2020-11-20T11:48:08.665 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.654+0000 7f4871c0d700 1 -- start start 2020-11-20T11:48:08.667 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.654+0000 7f4871c0d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4858004520 0x7f486c0c0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:08.668 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.654+0000 7f4871c0d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f486c0c0440 0x7f486c164650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:08.668 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.654+0000 7f4871c0d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f486c0bfad0 0x7f486c14c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:08.668 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.654+0000 7f4871c0d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486c164b40 con 0x7f486c0c0440 2020-11-20T11:48:08.668 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.654+0000 7f4871c0d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486c0b0450 con 0x7f4858004520 2020-11-20T11:48:08.668 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.654+0000 7f4871c0d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486c0b06f0 con 0x7f486c0bfad0 2020-11-20T11:48:08.669 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.654+0000 7f486bfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f486c0bfad0 0x7f486c14c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:08.669 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.654+0000 7f486bfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f486c0bfad0 0x7f486c14c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48782/0 (socket says 172.21.15.192:48782) 2020-11-20T11:48:08.669 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.654+0000 7f486bfff700 1 -- 172.21.15.192:0/2760177775 learned_addr learned my addr 172.21.15.192:0/2760177775 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:08.669 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.655+0000 7f486b7fe700 1 --2- 172.21.15.192:0/2760177775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4858004520 0x7f486c0c0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:08.669 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.655+0000 7f486affd700 1 --2- 172.21.15.192:0/2760177775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f486c0c0440 0x7f486c164650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:08.670 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.655+0000 7f486bfff700 1 -- 172.21.15.192:0/2760177775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4858004520 msgr2=0x7f486c0c0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:08.670 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.655+0000 7f486bfff700 1 --2- 172.21.15.192:0/2760177775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4858004520 0x7f486c0c0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:08.670 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.655+0000 7f486bfff700 1 -- 172.21.15.192:0/2760177775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f486c0c0440 msgr2=0x7f486c164650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:08.670 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.655+0000 7f486bfff700 1 --2- 172.21.15.192:0/2760177775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f486c0c0440 0x7f486c164650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:08.670 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.655+0000 7f486bfff700 1 -- 172.21.15.192:0/2760177775 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f486c0c17a0 con 0x7f486c0bfad0 2020-11-20T11:48:08.671 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.655+0000 7f486affd700 1 --2- 172.21.15.192:0/2760177775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f486c0c0440 0x7f486c164650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:48:08.671 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.655+0000 7f486bfff700 1 --2- 172.21.15.192:0/2760177775 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f486c0bfad0 0x7f486c14c090 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f486c0625c0 tx=0x7f4864007f50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:08.671 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.655+0000 7f484b7fe700 1 -- 172.21.15.192:0/2760177775 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4864004140 con 0x7f486c0bfad0 2020-11-20T11:48:08.671 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.655+0000 7f484b7fe700 1 -- 172.21.15.192:0/2760177775 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4864006ac0 con 0x7f486c0bfad0 2020-11-20T11:48:08.672 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.655+0000 7f484b7fe700 1 -- 172.21.15.192:0/2760177775 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4864006e60 con 0x7f486c0bfad0 2020-11-20T11:48:08.672 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.655+0000 7f4871c0d700 1 -- 172.21.15.192:0/2760177775 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f486c0c1a40 con 0x7f486c0bfad0 2020-11-20T11:48:08.672 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.655+0000 7f4871c0d700 1 -- 172.21.15.192:0/2760177775 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f486c0bff50 con 0x7f486c0bfad0 2020-11-20T11:48:08.672 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.656+0000 7f4871c0d700 1 -- 172.21.15.192:0/2760177775 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f486c0c0230 con 0x7f486c0bfad0 2020-11-20T11:48:08.673 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.657+0000 7f484b7fe700 1 -- 172.21.15.192:0/2760177775 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f486401e070 con 0x7f486c0bfad0 2020-11-20T11:48:08.673 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.657+0000 7f484b7fe700 1 --2- 172.21.15.192:0/2760177775 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f48440806a0 0x7f4844082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:08.673 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.657+0000 7f484b7fe700 1 -- 172.21.15.192:0/2760177775 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 8155+0+0 (secure 0 0 0) 0x7f48640a1e00 con 0x7f486c0bfad0 2020-11-20T11:48:08.673 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.657+0000 7f486b7fe700 1 --2- 172.21.15.192:0/2760177775 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f48440806a0 0x7f4844082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:08.674 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.657+0000 7f486b7fe700 1 --2- 172.21.15.192:0/2760177775 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f48440806a0 0x7f4844082b60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f485c000c00 tx=0x7f485c007bb0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:08.674 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.660+0000 7f484b7fe700 1 -- 172.21.15.192:0/2760177775 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f486c0c0230 con 0x7f486c0bfad0 2020-11-20T11:48:08.803 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:08.800+0000 7f4871c0d700 1 -- 172.21.15.192:0/2760177775 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f486c0c0230 con 0x7f486c0bfad0 2020-11-20T11:48:09.495 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.492+0000 7f484b7fe700 1 -- 172.21.15.192:0/2760177775 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v27) v1 ==== 166+0+0 (secure 0 0 0) 0x7f486c0c0230 con 0x7f486c0bfad0 2020-11-20T11:48:09.497 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.494+0000 7f4871c0d700 1 -- 172.21.15.192:0/2760177775 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f48440806a0 msgr2=0x7f4844082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:09.497 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.494+0000 7f4871c0d700 1 --2- 172.21.15.192:0/2760177775 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f48440806a0 0x7f4844082b60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f485c000c00 tx=0x7f485c007bb0).stop 2020-11-20T11:48:09.497 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.494+0000 7f4871c0d700 1 -- 172.21.15.192:0/2760177775 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f486c0bfad0 msgr2=0x7f486c14c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:09.498 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.494+0000 7f4871c0d700 1 --2- 172.21.15.192:0/2760177775 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f486c0bfad0 0x7f486c14c090 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f486c0625c0 tx=0x7f4864007f50).stop 2020-11-20T11:48:09.499 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.494+0000 7f4871c0d700 1 -- 172.21.15.192:0/2760177775 shutdown_connections 2020-11-20T11:48:09.499 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.494+0000 7f4871c0d700 1 --2- 172.21.15.192:0/2760177775 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f48440806a0 0x7f4844082b60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:09.499 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.494+0000 7f4871c0d700 1 --2- 172.21.15.192:0/2760177775 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f486c0bfad0 0x7f486c14c090 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:09.499 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.494+0000 7f4871c0d700 1 --2- 172.21.15.192:0/2760177775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4858004520 0x7f486c0c0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:09.499 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.494+0000 7f4871c0d700 1 --2- 172.21.15.192:0/2760177775 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f486c0c0440 0x7f486c164650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:09.500 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.494+0000 7f4871c0d700 1 -- 172.21.15.192:0/2760177775 >> 172.21.15.192:0/2760177775 conn(0x7f486c062100 msgr2=0x7f486c152750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:09.500 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.494+0000 7f4871c0d700 1 -- 172.21.15.192:0/2760177775 shutdown_connections 2020-11-20T11:48:09.500 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.494+0000 7f4871c0d700 1 -- 172.21.15.192:0/2760177775 wait complete. 2020-11-20T11:48:09.500 INFO:teuthology.orchestra.run.smithi192.stderr:set pool 4 allow_ec_overwrites to true 2020-11-20T11:48:09.512 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2020-11-20T11:48:09.635 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.632+0000 7f7f55aab700 1 Processor -- start 2020-11-20T11:48:09.636 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.632+0000 7f7f55aab700 1 -- start start 2020-11-20T11:48:09.638 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.633+0000 7f7f55aab700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7f50154920 0x7f7f50060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:09.638 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.633+0000 7f7f55aab700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7f50064c40 0x7f7f50151340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:09.638 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.633+0000 7f7f55aab700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f50151e80 con 0x7f7f50060370 2020-11-20T11:48:09.639 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.633+0000 7f7f55aab700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f50152120 con 0x7f7f50064c40 2020-11-20T11:48:09.639 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.633+0000 7f7f55aab700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f50064260 con 0x7f7f50154920 2020-11-20T11:48:09.639 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.633+0000 7f7f4effd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7f50154920 0x7f7f50060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:09.639 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.633+0000 7f7f4effd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7f50154920 0x7f7f50060750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.192:52878/0 (socket says 172.21.15.192:52878) 2020-11-20T11:48:09.640 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.633+0000 7f7f4f7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7f50060370 0x7f7f500c2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.192:60746/0 (socket says 172.21.15.192:60746) 2020-11-20T11:48:09.640 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.633+0000 7f7f4effd700 1 -- 172.21.15.192:0/643949887 learned_addr learned my addr 172.21.15.192:0/643949887 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:09.640 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.633+0000 7f7f4ffff700 1 --2- 172.21.15.192:0/643949887 >> v2:172.21.15.87:3300/0 conn(0x7f7f50064c40 0x7f7f50151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:09.640 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.634+0000 7f7f4effd700 1 -- 172.21.15.192:0/643949887 >> v2:172.21.15.87:3300/0 conn(0x7f7f50064c40 msgr2=0x7f7f50151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:09.640 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.634+0000 7f7f4effd700 1 --2- 172.21.15.192:0/643949887 >> v2:172.21.15.87:3300/0 conn(0x7f7f50064c40 0x7f7f50151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:09.641 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.634+0000 7f7f4effd700 1 -- 172.21.15.192:0/643949887 >> v1:172.21.15.146:6789/0 conn(0x7f7f50060370 legacy=0x7f7f500c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:09.643 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.634+0000 7f7f4e7fc700 1 -- 172.21.15.192:0/643949887 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2982372404 0 0) 0x7f7f50151e80 con 0x7f7f50060370 2020-11-20T11:48:09.644 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.634+0000 7f7f4effd700 1 -- 172.21.15.192:0/643949887 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f50064500 con 0x7f7f50154920 2020-11-20T11:48:09.645 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.634+0000 7f7f4ffff700 1 --2- 172.21.15.192:0/643949887 >> v2:172.21.15.87:3300/0 conn(0x7f7f50064c40 0x7f7f50151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:48:09.647 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.634+0000 7f7f4effd700 1 --2- 172.21.15.192:0/643949887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f50154920 0x7f7f50060750 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f7f50060f60 tx=0x7f7f44006ef0).ready entity=mon.1 client_cookie=92acf7b168c1cfce server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:09.647 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.634+0000 7f7f4e7fc700 1 -- 172.21.15.192:0/643949887 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4400b8f0 con 0x7f7f50154920 2020-11-20T11:48:09.647 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.634+0000 7f7f4e7fc700 1 -- 172.21.15.192:0/643949887 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f44000e90 con 0x7f7f50154920 2020-11-20T11:48:09.647 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.634+0000 7f7f4e7fc700 1 -- 172.21.15.192:0/643949887 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4400bc60 con 0x7f7f50154920 2020-11-20T11:48:09.648 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.634+0000 7f7f55aab700 1 -- 172.21.15.192:0/643949887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f50154920 msgr2=0x7f7f50060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:09.648 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.634+0000 7f7f55aab700 1 --2- 172.21.15.192:0/643949887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f50154920 0x7f7f50060750 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f7f50060f60 tx=0x7f7f44006ef0).stop 2020-11-20T11:48:09.648 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.634+0000 7f7f55aab700 1 -- 172.21.15.192:0/643949887 shutdown_connections 2020-11-20T11:48:09.648 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.634+0000 7f7f55aab700 1 --2- 172.21.15.192:0/643949887 >> v2:172.21.15.87:3300/0 conn(0x7f7f50064c40 0x7f7f50151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:09.648 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.634+0000 7f7f55aab700 1 --2- 172.21.15.192:0/643949887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f50154920 0x7f7f50060750 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:09.649 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.634+0000 7f7f55aab700 1 -- 172.21.15.192:0/643949887 >> 172.21.15.192:0/643949887 conn(0x7f7f50062100 msgr2=0x7f7f500c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:09.651 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.635+0000 7f7f55aab700 1 -- 172.21.15.192:0/643949887 shutdown_connections 2020-11-20T11:48:09.651 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.635+0000 7f7f55aab700 1 -- 172.21.15.192:0/643949887 wait complete. 2020-11-20T11:48:09.652 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.636+0000 7f7f55aab700 1 Processor -- start 2020-11-20T11:48:09.652 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.636+0000 7f7f55aab700 1 -- start start 2020-11-20T11:48:09.652 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.637+0000 7f7f55aab700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f50060370 0x7f7f501645f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:09.652 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.637+0000 7f7f55aab700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f50064c40 0x7f7f50158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:09.652 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.637+0000 7f7f55aab700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f50154920 0x7f7f500b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:09.653 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.637+0000 7f7f55aab700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f50164ae0 con 0x7f7f50154920 2020-11-20T11:48:09.653 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.637+0000 7f7f55aab700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f500bf860 con 0x7f7f50064c40 2020-11-20T11:48:09.653 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.637+0000 7f7f55aab700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f500bfa90 con 0x7f7f50060370 2020-11-20T11:48:09.654 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.637+0000 7f7f4f7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f50060370 0x7f7f501645f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:09.654 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.637+0000 7f7f4f7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f50060370 0x7f7f501645f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48796/0 (socket says 172.21.15.192:48796) 2020-11-20T11:48:09.654 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.637+0000 7f7f4f7fe700 1 -- 172.21.15.192:0/1239687066 learned_addr learned my addr 172.21.15.192:0/1239687066 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:09.654 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.637+0000 7f7f4ffff700 1 --2- 172.21.15.192:0/1239687066 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f50154920 0x7f7f500b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:09.654 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.637+0000 7f7f4effd700 1 --2- 172.21.15.192:0/1239687066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f50064c40 0x7f7f50158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:09.655 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.637+0000 7f7f4f7fe700 1 -- 172.21.15.192:0/1239687066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f50064c40 msgr2=0x7f7f50158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:09.655 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.637+0000 7f7f4f7fe700 1 --2- 172.21.15.192:0/1239687066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f50064c40 0x7f7f50158190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:09.655 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.637+0000 7f7f4f7fe700 1 -- 172.21.15.192:0/1239687066 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f50154920 msgr2=0x7f7f500b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:09.655 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.637+0000 7f7f4f7fe700 1 --2- 172.21.15.192:0/1239687066 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f50154920 0x7f7f500b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:09.655 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.637+0000 7f7f4f7fe700 1 -- 172.21.15.192:0/1239687066 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f500bfd30 con 0x7f7f50060370 2020-11-20T11:48:09.656 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.637+0000 7f7f4f7fe700 1 --2- 172.21.15.192:0/1239687066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f50060370 0x7f7f501645f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f7f4000c710 tx=0x7f7f40007cc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:09.656 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.637+0000 7f7f2f7fe700 1 -- 172.21.15.192:0/1239687066 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f400072e0 con 0x7f7f50060370 2020-11-20T11:48:09.656 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.637+0000 7f7f2f7fe700 1 -- 172.21.15.192:0/1239687066 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f40007440 con 0x7f7f50060370 2020-11-20T11:48:09.656 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.637+0000 7f7f55aab700 1 -- 172.21.15.192:0/1239687066 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f500bffd0 con 0x7f7f50060370 2020-11-20T11:48:09.656 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.637+0000 7f7f2f7fe700 1 -- 172.21.15.192:0/1239687066 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f400057a0 con 0x7f7f50060370 2020-11-20T11:48:09.656 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.637+0000 7f7f55aab700 1 -- 172.21.15.192:0/1239687066 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f500c09b0 con 0x7f7f50060370 2020-11-20T11:48:09.657 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.638+0000 7f7f55aab700 1 -- 172.21.15.192:0/1239687066 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f500699a0 con 0x7f7f50060370 2020-11-20T11:48:09.657 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.639+0000 7f7f2f7fe700 1 -- 172.21.15.192:0/1239687066 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f7f4001a060 con 0x7f7f50060370 2020-11-20T11:48:09.658 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.639+0000 7f7f2f7fe700 1 --2- 172.21.15.192:0/1239687066 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f7f28080670 0x7f7f28082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:09.658 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.639+0000 7f7f2f7fe700 1 -- 172.21.15.192:0/1239687066 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 8155+0+0 (secure 0 0 0) 0x7f7f400a1cb0 con 0x7f7f50060370 2020-11-20T11:48:09.658 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.639+0000 7f7f4effd700 1 --2- 172.21.15.192:0/1239687066 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f7f28080670 0x7f7f28082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:09.658 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.640+0000 7f7f4effd700 1 --2- 172.21.15.192:0/1239687066 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f7f28080670 0x7f7f28082b30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f7f50060f60 tx=0x7f7f44016000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:09.658 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.643+0000 7f7f2f7fe700 1 -- 172.21.15.192:0/1239687066 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f7f400767c0 con 0x7f7f50060370 2020-11-20T11:48:09.833 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.830+0000 7f7f55aab700 1 -- 172.21.15.192:0/1239687066 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f7f5005ca80 con 0x7f7f50060370 2020-11-20T11:48:09.839 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.835+0000 7f7f2f7fe700 1 -- 172.21.15.192:0/1239687066 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 187+0+0 (secure 0 0 0) 0x7f7f40018030 con 0x7f7f50060370 2020-11-20T11:48:09.843 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.839+0000 7f7f55aab700 1 -- 172.21.15.192:0/1239687066 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f7f28080670 msgr2=0x7f7f28082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:09.843 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.839+0000 7f7f55aab700 1 --2- 172.21.15.192:0/1239687066 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f7f28080670 0x7f7f28082b30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f7f50060f60 tx=0x7f7f44016000).stop 2020-11-20T11:48:09.844 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.839+0000 7f7f55aab700 1 -- 172.21.15.192:0/1239687066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f50060370 msgr2=0x7f7f501645f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:09.844 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.839+0000 7f7f55aab700 1 --2- 172.21.15.192:0/1239687066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f50060370 0x7f7f501645f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f7f4000c710 tx=0x7f7f40007cc0).stop 2020-11-20T11:48:09.844 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.839+0000 7f7f55aab700 1 -- 172.21.15.192:0/1239687066 shutdown_connections 2020-11-20T11:48:09.845 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.839+0000 7f7f55aab700 1 --2- 172.21.15.192:0/1239687066 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f7f28080670 0x7f7f28082b30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:09.845 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.839+0000 7f7f55aab700 1 --2- 172.21.15.192:0/1239687066 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7f50154920 0x7f7f500b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:09.846 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.839+0000 7f7f55aab700 1 --2- 172.21.15.192:0/1239687066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f50060370 0x7f7f501645f0 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0x7f7f4000c710 tx=0x7f7f40007cc0).stop 2020-11-20T11:48:09.846 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.839+0000 7f7f55aab700 1 --2- 172.21.15.192:0/1239687066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f50064c40 0x7f7f50158190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:09.846 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.839+0000 7f7f55aab700 1 -- 172.21.15.192:0/1239687066 >> 172.21.15.192:0/1239687066 conn(0x7f7f50062100 msgr2=0x7f7f500c49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:09.847 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.839+0000 7f7f55aab700 1 -- 172.21.15.192:0/1239687066 shutdown_connections 2020-11-20T11:48:09.848 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.839+0000 7f7f55aab700 1 -- 172.21.15.192:0/1239687066 wait complete. 2020-11-20T11:48:09.848 INFO:teuthology.orchestra.run.smithi192.stderr:new fs with metadata pool 3 and data pool 4 2020-11-20T11:48:09.856 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:48:09.971 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.962+0000 7f8813f06700 1 Processor -- start 2020-11-20T11:48:09.972 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.963+0000 7f8813f06700 1 -- start start 2020-11-20T11:48:09.972 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.963+0000 7f8813f06700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f880c060750 0x7f880c064c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:09.972 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.963+0000 7f8813f06700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f880c065130 con 0x7f880c060370 2020-11-20T11:48:09.972 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.963+0000 7f8813f06700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f880c151e80 con 0x7f880c154920 2020-11-20T11:48:09.973 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.963+0000 7f8813f06700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f880c152120 con 0x7f880c060750 2020-11-20T11:48:09.973 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.964+0000 7f88114a1700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f880c154920 0x7f880c151340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51476/0 (socket says 172.21.15.192:51476) 2020-11-20T11:48:09.973 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.964+0000 7f88114a1700 1 -- 172.21.15.192:0/177764663 learned_addr learned my addr 172.21.15.192:0/177764663 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:09.973 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.964+0000 7f88124a3700 1 --2- 172.21.15.192:0/177764663 >> v2:172.21.15.87:3300/0 conn(0x7f880c060750 0x7f880c064c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:09.973 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.964+0000 7f8810ca0700 1 -- 172.21.15.192:0/177764663 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3402079965 0 0) 0x7f880c151e80 con 0x7f880c154920 2020-11-20T11:48:09.974 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.964+0000 7f8810ca0700 1 -- 172.21.15.192:0/177764663 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87f4003280 con 0x7f880c154920 2020-11-20T11:48:09.974 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.964+0000 7f8810ca0700 1 -- 172.21.15.192:0/177764663 <== mon.2 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 193809070 0 0) 0x7f87f4003280 con 0x7f880c154920 2020-11-20T11:48:09.974 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.964+0000 7f8810ca0700 1 -- 172.21.15.192:0/177764663 >> v2:172.21.15.87:3300/0 conn(0x7f880c060750 msgr2=0x7f880c064c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:09.974 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.964+0000 7f8810ca0700 1 --2- 172.21.15.192:0/177764663 >> v2:172.21.15.87:3300/0 conn(0x7f880c060750 0x7f880c064c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:09.974 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.964+0000 7f8810ca0700 1 -- 172.21.15.192:0/177764663 >> v1:172.21.15.87:6789/0 conn(0x7f880c060370 legacy=0x7f880c0c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:09.975 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.964+0000 7f8810ca0700 1 -- 172.21.15.192:0/177764663 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880c064260 con 0x7f880c154920 2020-11-20T11:48:09.975 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.964+0000 7f8810ca0700 1 -- 172.21.15.192:0/177764663 <== mon.2 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3985397220 0 0) 0x7f87fc001520 con 0x7f880c154920 2020-11-20T11:48:09.975 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.964+0000 7f8810ca0700 1 -- 172.21.15.192:0/177764663 >> v1:172.21.15.192:6789/0 conn(0x7f880c154920 legacy=0x7f880c151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:09.975 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.964+0000 7f8810ca0700 1 --2- 172.21.15.192:0/177764663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87f40037c0 0x7f87f4003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:09.975 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.964+0000 7f8810ca0700 1 --2- 172.21.15.192:0/177764663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87f4004520 0x7f87f40049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:09.976 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.964+0000 7f8810ca0700 1 --2- 172.21.15.192:0/177764663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87f4004e90 0x7f87f400b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:09.976 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.964+0000 7f8810ca0700 1 -- 172.21.15.192:0/177764663 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880c152120 con 0x7f87f4004520 2020-11-20T11:48:09.976 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.964+0000 7f8810ca0700 1 -- 172.21.15.192:0/177764663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f4005340 con 0x7f87f40037c0 2020-11-20T11:48:09.976 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.964+0000 7f8810ca0700 1 -- 172.21.15.192:0/177764663 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f400bc60 con 0x7f87f4004e90 2020-11-20T11:48:09.976 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.964+0000 7f88124a3700 1 --2- 172.21.15.192:0/177764663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87f4004e90 0x7f87f400b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:09.977 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.964+0000 7f88114a1700 1 --2- 172.21.15.192:0/177764663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87f4004520 0x7f87f40049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:09.977 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.964+0000 7f88124a3700 1 -- 172.21.15.192:0/177764663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87f40037c0 msgr2=0x7f87f4003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:09.977 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.964+0000 7f88124a3700 1 --2- 172.21.15.192:0/177764663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f87f40037c0 0x7f87f4003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T11:48:09.977 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.964+0000 7f88124a3700 1 -- 172.21.15.192:0/177764663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87f4004520 msgr2=0x7f87f40049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:09.977 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.964+0000 7f88124a3700 1 --2- 172.21.15.192:0/177764663 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87f4004520 0x7f87f40049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:09.978 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.965+0000 7f88124a3700 1 -- 172.21.15.192:0/177764663 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f4003280 con 0x7f87f4004e90 2020-11-20T11:48:09.978 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.965+0000 7f88124a3700 1 -- 172.21.15.192:0/177764663 reap_dead start 2020-11-20T11:48:09.978 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.965+0000 7f88124a3700 1 --2- 172.21.15.192:0/177764663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87f4004e90 0x7f87f400b770 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f8804009ef0 tx=0x7f8804009220).ready entity=mon.2 client_cookie=68ec204028c3c65e server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:09.978 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.965+0000 7f8810ca0700 1 -- 172.21.15.192:0/177764663 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8804009610 con 0x7f87f4004e90 2020-11-20T11:48:09.978 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.965+0000 7f8810ca0700 1 -- 172.21.15.192:0/177764663 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880400ed30 con 0x7f87f4004e90 2020-11-20T11:48:09.979 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.965+0000 7f8810ca0700 1 -- 172.21.15.192:0/177764663 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8804012640 con 0x7f87f4004e90 2020-11-20T11:48:09.979 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.965+0000 7f8813f06700 1 -- 172.21.15.192:0/177764663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87f4004e90 msgr2=0x7f87f400b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:09.979 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.965+0000 7f8813f06700 1 --2- 172.21.15.192:0/177764663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87f4004e90 0x7f87f400b770 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f8804009ef0 tx=0x7f8804009220).stop 2020-11-20T11:48:09.979 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.965+0000 7f8813f06700 1 -- 172.21.15.192:0/177764663 shutdown_connections 2020-11-20T11:48:09.979 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.965+0000 7f8813f06700 1 --2- 172.21.15.192:0/177764663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87f4004e90 0x7f87f400b770 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:09.980 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.965+0000 7f8813f06700 1 -- 172.21.15.192:0/177764663 >> 172.21.15.192:0/177764663 conn(0x7f880c062100 msgr2=0x7f880c0c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:09.980 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.965+0000 7f8813f06700 1 -- 172.21.15.192:0/177764663 shutdown_connections 2020-11-20T11:48:09.980 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.965+0000 7f8813f06700 1 -- 172.21.15.192:0/177764663 wait complete. 2020-11-20T11:48:09.980 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.966+0000 7f8813f06700 1 Processor -- start 2020-11-20T11:48:09.980 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.966+0000 7f8813f06700 1 -- start start 2020-11-20T11:48:09.981 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.967+0000 7f8813f06700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87f4004e90 0x7f880c161290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:09.981 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.967+0000 7f8813f06700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f880c0b1110 0x7f880c0c7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:09.981 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.967+0000 7f8813f06700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f880c0c7c30 0x7f880c0c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:09.981 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.967+0000 7f8813f06700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880c161780 con 0x7f87f4004e90 2020-11-20T11:48:09.981 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.967+0000 7f8813f06700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880c0c5950 con 0x7f880c0c7c30 2020-11-20T11:48:09.982 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.967+0000 7f8813f06700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880c0c5bf0 con 0x7f880c0b1110 2020-11-20T11:48:09.982 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.967+0000 7f88114a1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f880c0b1110 0x7f880c0c7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:09.982 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.967+0000 7f88114a1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f880c0b1110 0x7f880c0c7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48818/0 (socket says 172.21.15.192:48818) 2020-11-20T11:48:09.982 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.967+0000 7f88114a1700 1 -- 172.21.15.192:0/1943372385 learned_addr learned my addr 172.21.15.192:0/1943372385 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:09.982 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.967+0000 7f8811ca2700 1 --2- 172.21.15.192:0/1943372385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87f4004e90 0x7f880c161290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:09.983 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.967+0000 7f88114a1700 1 -- 172.21.15.192:0/1943372385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f880c0c7c30 msgr2=0x7f880c0c6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:09.983 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.967+0000 7f88114a1700 1 --2- 172.21.15.192:0/1943372385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f880c0c7c30 0x7f880c0c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:48:09.983 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.967+0000 7f88114a1700 1 -- 172.21.15.192:0/1943372385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87f4004e90 msgr2=0x7f880c161290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:09.983 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.967+0000 7f88114a1700 1 --2- 172.21.15.192:0/1943372385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87f4004e90 0x7f880c161290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:09.983 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.968+0000 7f88114a1700 1 -- 172.21.15.192:0/1943372385 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880c0c5e90 con 0x7f880c0b1110 2020-11-20T11:48:09.984 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.968+0000 7f8811ca2700 1 --2- 172.21.15.192:0/1943372385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87f4004e90 0x7f880c161290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:48:09.984 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.968+0000 7f88114a1700 1 --2- 172.21.15.192:0/1943372385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f880c0b1110 0x7f880c0c7740 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f87fc004b40 tx=0x7f880c152010).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:09.984 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.968+0000 7f87f9ffb700 1 -- 172.21.15.192:0/1943372385 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc00f960 con 0x7f880c0b1110 2020-11-20T11:48:09.984 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.968+0000 7f87f9ffb700 1 -- 172.21.15.192:0/1943372385 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87fc00fae0 con 0x7f880c0b1110 2020-11-20T11:48:09.984 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.968+0000 7f8813f06700 1 -- 172.21.15.192:0/1943372385 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f880c0c6130 con 0x7f880c0b1110 2020-11-20T11:48:09.985 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.968+0000 7f87f9ffb700 1 -- 172.21.15.192:0/1943372385 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc00fea0 con 0x7f880c0b1110 2020-11-20T11:48:09.985 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.968+0000 7f8813f06700 1 -- 172.21.15.192:0/1943372385 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f880c0c1b00 con 0x7f880c0b1110 2020-11-20T11:48:09.986 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.969+0000 7f8813f06700 1 -- 172.21.15.192:0/1943372385 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f880c0699a0 con 0x7f880c0b1110 2020-11-20T11:48:09.986 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.969+0000 7f87f9ffb700 1 -- 172.21.15.192:0/1943372385 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f87fc01b030 con 0x7f880c0b1110 2020-11-20T11:48:09.986 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.970+0000 7f87f9ffb700 1 --2- 172.21.15.192:0/1943372385 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f87e4080670 0x7f87e4082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:09.986 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.970+0000 7f87f9ffb700 1 -- 172.21.15.192:0/1943372385 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f87fc0a2300 con 0x7f880c0b1110 2020-11-20T11:48:09.987 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.970+0000 7f8811ca2700 1 --2- 172.21.15.192:0/1943372385 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f87e4080670 0x7f87e4082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:09.987 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.970+0000 7f8811ca2700 1 --2- 172.21.15.192:0/1943372385 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f87e4080670 0x7f87e4082b30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f8808000c00 tx=0x7f8808009040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:09.987 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:09.973+0000 7f87f9ffb700 1 -- 172.21.15.192:0/1943372385 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f87fc076c90 con 0x7f880c0b1110 2020-11-20T11:48:10.115 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.112+0000 7f8813f06700 1 -- 172.21.15.192:0/1943372385 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f880c0c6590 con 0x7f880c0b1110 2020-11-20T11:48:10.116 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.113+0000 7f87f9ffb700 1 -- 172.21.15.192:0/1943372385 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21795 (secure 0 0 0) 0x7f87fc07a2b0 con 0x7f880c0b1110 2020-11-20T11:48:10.117 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:48:10.117 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":28,"fsid":"4871390d-d110-4379-8302-5810d7b54f34","created":"2020-11-20T11:47:49.059675+0000","modified":"2020-11-20T11:48:09.832333+0000","last_up_change":"2020-11-20T11:47:57.317253+0000","last_in_change":"2020-11-20T11:47:57.317253+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:47:52.327778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:48:01.912951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:48:04.793810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:48:07.506705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77a5e1d9-0fb0-450c-872e-4aee77dede49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":23242},{"type":"v1","addr":"172.21.15.192:6827","nonce":23242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":23242},{"type":"v1","addr":"172.21.15.192:6829","nonce":23242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":23242},{"type":"v1","addr":"172.21.15.192:6833","nonce":23242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":23242},{"type":"v1","addr":"172.21.15.192:6831","nonce":23242}]},"public_addr":"172.21.15.192:6827/23242","cluster_addr":"172.21.15.192:6829/23242","heartbeat_back_addr":"172.21.15.192:6833/23242","heartbeat_front_addr":"172.21.15.192:6831/23242","state":["exists","up"]},{"osd":1,"uuid":"564330c6-5c45-4ef6-8718-bbfa97848e6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":22856},{"type":"v1","addr":"172.21.15.146:6801","nonce":22856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":22856},{"type":"v1","addr":"172.21.15.146:6803","nonce":22856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":22856},{"type":"v1","addr":"172.21.15.146:6807","nonce":22856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":22856},{"type":"v1","addr":"172.21.15.146:6805","nonce":22856}]},"public_addr":"172.21.15.146:6801/22856","cluster_addr":"172.21.15.146:6803/22856","heartbeat_back_addr":"172.21.15.146:6807/22856","heartbeat_front_addr":"172.21.15.146:6805/22856","state":["exists","up"]},{"osd":2,"uuid":"128ddb77-579b-4fa3-a0cb-7465ad959f3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6815","nonce":23326},{"type":"v1","addr":"172.21.15.87:6817","nonce":23326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":23326},{"type":"v1","addr":"172.21.15.87:6819","nonce":23326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":23326},{"type":"v1","addr":"172.21.15.87:6823","nonce":23326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":23326},{"type":"v1","addr":"172.21.15.87:6821","nonce":23326}]},"public_addr":"172.21.15.87:6817/23326","cluster_addr":"172.21.15.87:6819/23326","heartbeat_back_addr":"172.21.15.87:6823/23326","heartbeat_front_addr":"172.21.15.87:6821/23326","state":["exists","up"]},{"osd":3,"uuid":"4668cfdf-d172-4f30-95b8-ac842108a520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":23243},{"type":"v1","addr":"172.21.15.192:6803","nonce":23243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":23243},{"type":"v1","addr":"172.21.15.192:6805","nonce":23243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":23243},{"type":"v1","addr":"172.21.15.192:6809","nonce":23243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":23243},{"type":"v1","addr":"172.21.15.192:6807","nonce":23243}]},"public_addr":"172.21.15.192:6803/23243","cluster_addr":"172.21.15.192:6805/23243","heartbeat_back_addr":"172.21.15.192:6809/23243","heartbeat_front_addr":"172.21.15.192:6807/23243","state":["exists","up"]},{"osd":4,"uuid":"c4bc8ba5-0d22-49f5-97a6-2ca71e3a8c62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":22857},{"type":"v1","addr":"172.21.15.146:6809","nonce":22857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":22857},{"type":"v1","addr":"172.21.15.146:6811","nonce":22857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":22857},{"type":"v1","addr":"172.21.15.146:6815","nonce":22857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":22857},{"type":"v1","addr":"172.21.15.146:6813","nonce":22857}]},"public_addr":"172.21.15.146:6809/22857","cluster_addr":"172.21.15.146:6811/22857","heartbeat_back_addr":"172.21.15.146:6815/22857","heartbeat_front_addr":"172.21.15.146:6813/22857","state":["exists","up"]},{"osd":5,"uuid":"2d15f1db-e580-4715-9728-8fe5dd7e34d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":23316},{"type":"v1","addr":"172.21.15.87:6801","nonce":23316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":23316},{"type":"v1","addr":"172.21.15.87:6803","nonce":23316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":23316},{"type":"v1","addr":"172.21.15.87:6807","nonce":23316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":23316},{"type":"v1","addr":"172.21.15.87:6805","nonce":23316}]},"public_addr":"172.21.15.87:6801/23316","cluster_addr":"172.21.15.87:6803/23316","heartbeat_back_addr":"172.21.15.87:6807/23316","heartbeat_front_addr":"172.21.15.87:6805/23316","state":["exists","up"]},{"osd":6,"uuid":"a659da2b-bdce-42ac-8b30-b8c69b4c7041","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":23246},{"type":"v1","addr":"172.21.15.192:6811","nonce":23246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":23246},{"type":"v1","addr":"172.21.15.192:6813","nonce":23246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":23246},{"type":"v1","addr":"172.21.15.192:6817","nonce":23246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":23246},{"type":"v1","addr":"172.21.15.192:6815","nonce":23246}]},"public_addr":"172.21.15.192:6811/23246","cluster_addr":"172.21.15.192:6813/23246","heartbeat_back_addr":"172.21.15.192:6817/23246","heartbeat_front_addr":"172.21.15.192:6815/23246","state":["exists","up"]},{"osd":7,"uuid":"d6e41ac5-bab7-49e2-a17a-ef794bcc4a09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":22858},{"type":"v1","addr":"172.21.15.146:6818","nonce":22858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":22858},{"type":"v1","addr":"172.21.15.146:6822","nonce":22858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":22858},{"type":"v1","addr":"172.21.15.146:6830","nonce":22858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":22858},{"type":"v1","addr":"172.21.15.146:6826","nonce":22858}]},"public_addr":"172.21.15.146:6818/22858","cluster_addr":"172.21.15.146:6822/22858","heartbeat_back_addr":"172.21.15.146:6830/22858","heartbeat_front_addr":"172.21.15.146:6826/22858","state":["exists","up"]},{"osd":8,"uuid":"c4907993-7513-4162-974f-07dcb0a260a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":23333},{"type":"v1","addr":"172.21.15.87:6825","nonce":23333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":23333},{"type":"v1","addr":"172.21.15.87:6827","nonce":23333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":23333},{"type":"v1","addr":"172.21.15.87:6831","nonce":23333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":23333},{"type":"v1","addr":"172.21.15.87:6829","nonce":23333}]},"public_addr":"172.21.15.87:6825/23333","cluster_addr":"172.21.15.87:6827/23333","heartbeat_back_addr":"172.21.15.87:6831/23333","heartbeat_front_addr":"172.21.15.87:6829/23333","state":["exists","up"]},{"osd":9,"uuid":"3523676f-c9b8-47ae-86c0-4930dca17831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":23254},{"type":"v1","addr":"172.21.15.192:6819","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":23254},{"type":"v1","addr":"172.21.15.192:6821","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":23254},{"type":"v1","addr":"172.21.15.192:6825","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":23254},{"type":"v1","addr":"172.21.15.192:6823","nonce":23254}]},"public_addr":"172.21.15.192:6819/23254","cluster_addr":"172.21.15.192:6821/23254","heartbeat_back_addr":"172.21.15.192:6825/23254","heartbeat_front_addr":"172.21.15.192:6823/23254","state":["exists","up"]},{"osd":10,"uuid":"88d5c251-0bb1-4624-8fa2-7f3b74bd1bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":22859},{"type":"v1","addr":"172.21.15.146:6819","nonce":22859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6821","nonce":22859},{"type":"v1","addr":"172.21.15.146:6823","nonce":22859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":22859},{"type":"v1","addr":"172.21.15.146:6831","nonce":22859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6825","nonce":22859},{"type":"v1","addr":"172.21.15.146:6827","nonce":22859}]},"public_addr":"172.21.15.146:6819/22859","cluster_addr":"172.21.15.146:6823/22859","heartbeat_back_addr":"172.21.15.146:6831/22859","heartbeat_front_addr":"172.21.15.146:6827/22859","state":["exists","up"]},{"osd":11,"uuid":"31f650d6-ba1e-4f29-92ff-6abee04c0f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":23317},{"type":"v1","addr":"172.21.15.87:6809","nonce":23317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":23317},{"type":"v1","addr":"172.21.15.87:6811","nonce":23317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":23317},{"type":"v1","addr":"172.21.15.87:6816","nonce":23317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":23317},{"type":"v1","addr":"172.21.15.87:6813","nonce":23317}]},"public_addr":"172.21.15.87:6809/23317","cluster_addr":"172.21.15.87:6811/23317","heartbeat_back_addr":"172.21.15.87:6816/23317","heartbeat_front_addr":"172.21.15.87:6813/23317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.538863+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.552293+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.585265+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.505194+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.550032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.558089+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.565622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.587102+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.654330+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.599072+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.645833+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.596236+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:48:10.118 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.115+0000 7f8813f06700 1 -- 172.21.15.192:0/1943372385 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f87e4080670 msgr2=0x7f87e4082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:10.119 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.115+0000 7f8813f06700 1 --2- 172.21.15.192:0/1943372385 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f87e4080670 0x7f87e4082b30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f8808000c00 tx=0x7f8808009040).stop 2020-11-20T11:48:10.119 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.115+0000 7f8813f06700 1 -- 172.21.15.192:0/1943372385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f880c0b1110 msgr2=0x7f880c0c7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:10.119 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.115+0000 7f8813f06700 1 --2- 172.21.15.192:0/1943372385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f880c0b1110 0x7f880c0c7740 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f87fc004b40 tx=0x7f880c152010).stop 2020-11-20T11:48:10.119 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.115+0000 7f8813f06700 1 -- 172.21.15.192:0/1943372385 shutdown_connections 2020-11-20T11:48:10.119 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.115+0000 7f8813f06700 1 --2- 172.21.15.192:0/1943372385 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f87e4080670 0x7f87e4082b30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:10.120 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.115+0000 7f8813f06700 1 --2- 172.21.15.192:0/1943372385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f880c0c7c30 0x7f880c0c6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:48:10.120 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.115+0000 7f8813f06700 1 --2- 172.21.15.192:0/1943372385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f87f4004e90 0x7f880c161290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:10.120 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.115+0000 7f8813f06700 1 --2- 172.21.15.192:0/1943372385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f880c0b1110 0x7f880c0c7740 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:10.120 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.115+0000 7f8813f06700 1 -- 172.21.15.192:0/1943372385 >> 172.21.15.192:0/1943372385 conn(0x7f880c062100 msgr2=0x7f880c153d90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:10.121 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.115+0000 7f8813f06700 1 -- 172.21.15.192:0/1943372385 shutdown_connections 2020-11-20T11:48:10.121 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.115+0000 7f8813f06700 1 -- 172.21.15.192:0/1943372385 wait complete. 2020-11-20T11:48:10.130 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:48:10.238 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.235+0000 7f8f41ebf700 1 Processor -- start 2020-11-20T11:48:10.239 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.235+0000 7f8f41ebf700 1 -- start start 2020-11-20T11:48:10.241 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.236+0000 7f8f41ebf700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8f3c154920 0x7f8f3c060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:10.241 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.236+0000 7f8f41ebf700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8f3c064c40 0x7f8f3c151340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:10.241 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.236+0000 7f8f41ebf700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f3c151e80 con 0x7f8f3c060370 2020-11-20T11:48:10.241 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.236+0000 7f8f41ebf700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f3c152120 con 0x7f8f3c154920 2020-11-20T11:48:10.242 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.236+0000 7f8f41ebf700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f3c064260 con 0x7f8f3c064c40 2020-11-20T11:48:10.242 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.236+0000 7f8f3bfff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8f3c064c40 0x7f8f3c151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:10.242 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.236+0000 7f8f3bfff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8f3c064c40 0x7f8f3c151340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48824/0 (socket says 172.21.15.192:48824) 2020-11-20T11:48:10.242 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.236+0000 7f8f3bfff700 1 -- 172.21.15.192:0/3588600052 learned_addr learned my addr 172.21.15.192:0/3588600052 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:10.242 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.236+0000 7f8f3affd700 1 --2- 172.21.15.192:0/3588600052 >> v2:172.21.15.87:3300/0 conn(0x7f8f3c154920 0x7f8f3c060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:10.243 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.237+0000 7f8f3bfff700 1 -- 172.21.15.192:0/3588600052 >> v2:172.21.15.87:3300/0 conn(0x7f8f3c154920 msgr2=0x7f8f3c060750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:10.243 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.237+0000 7f8f3bfff700 1 --2- 172.21.15.192:0/3588600052 >> v2:172.21.15.87:3300/0 conn(0x7f8f3c154920 0x7f8f3c060750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:10.243 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.237+0000 7f8f3bfff700 1 -- 172.21.15.192:0/3588600052 >> v1:172.21.15.146:6789/0 conn(0x7f8f3c060370 legacy=0x7f8f3c0c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:10.243 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.237+0000 7f8f3bfff700 1 -- 172.21.15.192:0/3588600052 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f3c064500 con 0x7f8f3c064c40 2020-11-20T11:48:10.243 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.237+0000 7f8f3bfff700 1 --2- 172.21.15.192:0/3588600052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f3c064c40 0x7f8f3c151340 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f8f3c065700 tx=0x7f8f340092d0).ready entity=mon.2 client_cookie=66b4691a01f0611c server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:10.244 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.237+0000 7f8f3a7fc700 1 -- 172.21.15.192:0/3588600052 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3400bc40 con 0x7f8f3c064c40 2020-11-20T11:48:10.244 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.237+0000 7f8f3a7fc700 1 -- 172.21.15.192:0/3588600052 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3400bda0 con 0x7f8f3c064c40 2020-11-20T11:48:10.244 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.237+0000 7f8f3a7fc700 1 -- 172.21.15.192:0/3588600052 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f34011610 con 0x7f8f3c064c40 2020-11-20T11:48:10.244 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.237+0000 7f8f41ebf700 1 -- 172.21.15.192:0/3588600052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f3c064c40 msgr2=0x7f8f3c151340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:10.244 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.237+0000 7f8f41ebf700 1 --2- 172.21.15.192:0/3588600052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f3c064c40 0x7f8f3c151340 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f8f3c065700 tx=0x7f8f340092d0).stop 2020-11-20T11:48:10.245 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.237+0000 7f8f41ebf700 1 -- 172.21.15.192:0/3588600052 shutdown_connections 2020-11-20T11:48:10.245 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.237+0000 7f8f41ebf700 1 --2- 172.21.15.192:0/3588600052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f3c064c40 0x7f8f3c151340 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:10.245 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.237+0000 7f8f41ebf700 1 --2- 172.21.15.192:0/3588600052 >> v2:172.21.15.87:3300/0 conn(0x7f8f3c154920 0x7f8f3c060750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:10.245 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.237+0000 7f8f41ebf700 1 -- 172.21.15.192:0/3588600052 >> 172.21.15.192:0/3588600052 conn(0x7f8f3c062100 msgr2=0x7f8f3c0c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:10.245 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.237+0000 7f8f41ebf700 1 -- 172.21.15.192:0/3588600052 shutdown_connections 2020-11-20T11:48:10.246 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.237+0000 7f8f41ebf700 1 -- 172.21.15.192:0/3588600052 wait complete. 2020-11-20T11:48:10.248 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.239+0000 7f8f41ebf700 1 Processor -- start 2020-11-20T11:48:10.249 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.239+0000 7f8f41ebf700 1 -- start start 2020-11-20T11:48:10.249 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.239+0000 7f8f41ebf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f3c060370 0x7f8f3c0c0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:10.249 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.239+0000 7f8f41ebf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f3c064c40 0x7f8f3c14c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:10.249 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.239+0000 7f8f41ebf700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f3c154920 0x7f8f3c14c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:10.250 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.239+0000 7f8f41ebf700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c0bf710 con 0x7f8f3c060370 2020-11-20T11:48:10.250 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.239+0000 7f8f41ebf700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c0b0880 con 0x7f8f3c064c40 2020-11-20T11:48:10.250 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.239+0000 7f8f41ebf700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c161170 con 0x7f8f3c154920 2020-11-20T11:48:10.250 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.239+0000 7f8f3bfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f3c154920 0x7f8f3c14c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:10.250 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.240+0000 7f8f3bfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f3c154920 0x7f8f3c14c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48832/0 (socket says 172.21.15.192:48832) 2020-11-20T11:48:10.251 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.240+0000 7f8f3bfff700 1 -- 172.21.15.192:0/3169106943 learned_addr learned my addr 172.21.15.192:0/3169106943 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:10.251 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.240+0000 7f8f3affd700 1 --2- 172.21.15.192:0/3169106943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f3c064c40 0x7f8f3c14c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:10.251 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.240+0000 7f8f3b7fe700 1 --2- 172.21.15.192:0/3169106943 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f3c060370 0x7f8f3c0c0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:10.251 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.240+0000 7f8f3bfff700 1 -- 172.21.15.192:0/3169106943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f3c064c40 msgr2=0x7f8f3c14c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:10.251 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.240+0000 7f8f3bfff700 1 --2- 172.21.15.192:0/3169106943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f3c064c40 0x7f8f3c14c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:10.252 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.240+0000 7f8f3bfff700 1 -- 172.21.15.192:0/3169106943 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f3c060370 msgr2=0x7f8f3c0c0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:10.252 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.240+0000 7f8f3bfff700 1 --2- 172.21.15.192:0/3169106943 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f3c060370 0x7f8f3c0c0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:10.252 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.240+0000 7f8f3bfff700 1 -- 172.21.15.192:0/3169106943 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f3c161410 con 0x7f8f3c154920 2020-11-20T11:48:10.252 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.240+0000 7f8f3b7fe700 1 --2- 172.21.15.192:0/3169106943 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f3c060370 0x7f8f3c0c0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:48:10.252 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.240+0000 7f8f3bfff700 1 --2- 172.21.15.192:0/3169106943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f3c154920 0x7f8f3c14c690 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f8f34009310 tx=0x7f8f34016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:10.253 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.240+0000 7f8f1b7fe700 1 -- 172.21.15.192:0/3169106943 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f34010700 con 0x7f8f3c154920 2020-11-20T11:48:10.253 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.240+0000 7f8f1b7fe700 1 -- 172.21.15.192:0/3169106943 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f34010860 con 0x7f8f3c154920 2020-11-20T11:48:10.253 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.240+0000 7f8f41ebf700 1 -- 172.21.15.192:0/3169106943 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f3c0bf940 con 0x7f8f3c154920 2020-11-20T11:48:10.253 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.240+0000 7f8f1b7fe700 1 -- 172.21.15.192:0/3169106943 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f34010be0 con 0x7f8f3c154920 2020-11-20T11:48:10.253 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.240+0000 7f8f41ebf700 1 -- 172.21.15.192:0/3169106943 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f3c14cb80 con 0x7f8f3c154920 2020-11-20T11:48:10.254 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.241+0000 7f8f41ebf700 1 -- 172.21.15.192:0/3169106943 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f3c0699a0 con 0x7f8f3c154920 2020-11-20T11:48:10.254 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.242+0000 7f8f1b7fe700 1 -- 172.21.15.192:0/3169106943 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f8f34017070 con 0x7f8f3c154920 2020-11-20T11:48:10.254 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.242+0000 7f8f1b7fe700 1 --2- 172.21.15.192:0/3169106943 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f8f140806a0 0x7f8f14082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:10.254 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.242+0000 7f8f1b7fe700 1 -- 172.21.15.192:0/3169106943 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f8f340a4ae0 con 0x7f8f3c154920 2020-11-20T11:48:10.254 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.242+0000 7f8f3b7fe700 1 --2- 172.21.15.192:0/3169106943 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f8f140806a0 0x7f8f14082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:10.255 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.242+0000 7f8f3b7fe700 1 --2- 172.21.15.192:0/3169106943 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f8f140806a0 0x7f8f14082b60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f8f2c00b740 tx=0x7f8f2c008040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:10.255 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.246+0000 7f8f1b7fe700 1 -- 172.21.15.192:0/3169106943 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f8f340794f0 con 0x7f8f3c154920 2020-11-20T11:48:10.386 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.383+0000 7f8f41ebf700 1 -- 172.21.15.192:0/3169106943 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f3c0bfda0 con 0x7f8f3c154920 2020-11-20T11:48:10.387 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.384+0000 7f8f1b7fe700 1 -- 172.21.15.192:0/3169106943 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21795 (secure 0 0 0) 0x7f8f34015030 con 0x7f8f3c154920 2020-11-20T11:48:10.388 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:48:10.388 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":28,"fsid":"4871390d-d110-4379-8302-5810d7b54f34","created":"2020-11-20T11:47:49.059675+0000","modified":"2020-11-20T11:48:09.832333+0000","last_up_change":"2020-11-20T11:47:57.317253+0000","last_in_change":"2020-11-20T11:47:57.317253+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:47:52.327778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:48:01.912951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:48:04.793810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:48:07.506705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77a5e1d9-0fb0-450c-872e-4aee77dede49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":23242},{"type":"v1","addr":"172.21.15.192:6827","nonce":23242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":23242},{"type":"v1","addr":"172.21.15.192:6829","nonce":23242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":23242},{"type":"v1","addr":"172.21.15.192:6833","nonce":23242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":23242},{"type":"v1","addr":"172.21.15.192:6831","nonce":23242}]},"public_addr":"172.21.15.192:6827/23242","cluster_addr":"172.21.15.192:6829/23242","heartbeat_back_addr":"172.21.15.192:6833/23242","heartbeat_front_addr":"172.21.15.192:6831/23242","state":["exists","up"]},{"osd":1,"uuid":"564330c6-5c45-4ef6-8718-bbfa97848e6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":22856},{"type":"v1","addr":"172.21.15.146:6801","nonce":22856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":22856},{"type":"v1","addr":"172.21.15.146:6803","nonce":22856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":22856},{"type":"v1","addr":"172.21.15.146:6807","nonce":22856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":22856},{"type":"v1","addr":"172.21.15.146:6805","nonce":22856}]},"public_addr":"172.21.15.146:6801/22856","cluster_addr":"172.21.15.146:6803/22856","heartbeat_back_addr":"172.21.15.146:6807/22856","heartbeat_front_addr":"172.21.15.146:6805/22856","state":["exists","up"]},{"osd":2,"uuid":"128ddb77-579b-4fa3-a0cb-7465ad959f3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6815","nonce":23326},{"type":"v1","addr":"172.21.15.87:6817","nonce":23326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":23326},{"type":"v1","addr":"172.21.15.87:6819","nonce":23326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":23326},{"type":"v1","addr":"172.21.15.87:6823","nonce":23326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":23326},{"type":"v1","addr":"172.21.15.87:6821","nonce":23326}]},"public_addr":"172.21.15.87:6817/23326","cluster_addr":"172.21.15.87:6819/23326","heartbeat_back_addr":"172.21.15.87:6823/23326","heartbeat_front_addr":"172.21.15.87:6821/23326","state":["exists","up"]},{"osd":3,"uuid":"4668cfdf-d172-4f30-95b8-ac842108a520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":23243},{"type":"v1","addr":"172.21.15.192:6803","nonce":23243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":23243},{"type":"v1","addr":"172.21.15.192:6805","nonce":23243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":23243},{"type":"v1","addr":"172.21.15.192:6809","nonce":23243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":23243},{"type":"v1","addr":"172.21.15.192:6807","nonce":23243}]},"public_addr":"172.21.15.192:6803/23243","cluster_addr":"172.21.15.192:6805/23243","heartbeat_back_addr":"172.21.15.192:6809/23243","heartbeat_front_addr":"172.21.15.192:6807/23243","state":["exists","up"]},{"osd":4,"uuid":"c4bc8ba5-0d22-49f5-97a6-2ca71e3a8c62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":22857},{"type":"v1","addr":"172.21.15.146:6809","nonce":22857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":22857},{"type":"v1","addr":"172.21.15.146:6811","nonce":22857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":22857},{"type":"v1","addr":"172.21.15.146:6815","nonce":22857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":22857},{"type":"v1","addr":"172.21.15.146:6813","nonce":22857}]},"public_addr":"172.21.15.146:6809/22857","cluster_addr":"172.21.15.146:6811/22857","heartbeat_back_addr":"172.21.15.146:6815/22857","heartbeat_front_addr":"172.21.15.146:6813/22857","state":["exists","up"]},{"osd":5,"uuid":"2d15f1db-e580-4715-9728-8fe5dd7e34d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":23316},{"type":"v1","addr":"172.21.15.87:6801","nonce":23316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":23316},{"type":"v1","addr":"172.21.15.87:6803","nonce":23316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":23316},{"type":"v1","addr":"172.21.15.87:6807","nonce":23316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":23316},{"type":"v1","addr":"172.21.15.87:6805","nonce":23316}]},"public_addr":"172.21.15.87:6801/23316","cluster_addr":"172.21.15.87:6803/23316","heartbeat_back_addr":"172.21.15.87:6807/23316","heartbeat_front_addr":"172.21.15.87:6805/23316","state":["exists","up"]},{"osd":6,"uuid":"a659da2b-bdce-42ac-8b30-b8c69b4c7041","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":23246},{"type":"v1","addr":"172.21.15.192:6811","nonce":23246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":23246},{"type":"v1","addr":"172.21.15.192:6813","nonce":23246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":23246},{"type":"v1","addr":"172.21.15.192:6817","nonce":23246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":23246},{"type":"v1","addr":"172.21.15.192:6815","nonce":23246}]},"public_addr":"172.21.15.192:6811/23246","cluster_addr":"172.21.15.192:6813/23246","heartbeat_back_addr":"172.21.15.192:6817/23246","heartbeat_front_addr":"172.21.15.192:6815/23246","state":["exists","up"]},{"osd":7,"uuid":"d6e41ac5-bab7-49e2-a17a-ef794bcc4a09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":22858},{"type":"v1","addr":"172.21.15.146:6818","nonce":22858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":22858},{"type":"v1","addr":"172.21.15.146:6822","nonce":22858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":22858},{"type":"v1","addr":"172.21.15.146:6830","nonce":22858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":22858},{"type":"v1","addr":"172.21.15.146:6826","nonce":22858}]},"public_addr":"172.21.15.146:6818/22858","cluster_addr":"172.21.15.146:6822/22858","heartbeat_back_addr":"172.21.15.146:6830/22858","heartbeat_front_addr":"172.21.15.146:6826/22858","state":["exists","up"]},{"osd":8,"uuid":"c4907993-7513-4162-974f-07dcb0a260a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":23333},{"type":"v1","addr":"172.21.15.87:6825","nonce":23333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":23333},{"type":"v1","addr":"172.21.15.87:6827","nonce":23333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":23333},{"type":"v1","addr":"172.21.15.87:6831","nonce":23333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":23333},{"type":"v1","addr":"172.21.15.87:6829","nonce":23333}]},"public_addr":"172.21.15.87:6825/23333","cluster_addr":"172.21.15.87:6827/23333","heartbeat_back_addr":"172.21.15.87:6831/23333","heartbeat_front_addr":"172.21.15.87:6829/23333","state":["exists","up"]},{"osd":9,"uuid":"3523676f-c9b8-47ae-86c0-4930dca17831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":23254},{"type":"v1","addr":"172.21.15.192:6819","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":23254},{"type":"v1","addr":"172.21.15.192:6821","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":23254},{"type":"v1","addr":"172.21.15.192:6825","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":23254},{"type":"v1","addr":"172.21.15.192:6823","nonce":23254}]},"public_addr":"172.21.15.192:6819/23254","cluster_addr":"172.21.15.192:6821/23254","heartbeat_back_addr":"172.21.15.192:6825/23254","heartbeat_front_addr":"172.21.15.192:6823/23254","state":["exists","up"]},{"osd":10,"uuid":"88d5c251-0bb1-4624-8fa2-7f3b74bd1bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":22859},{"type":"v1","addr":"172.21.15.146:6819","nonce":22859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6821","nonce":22859},{"type":"v1","addr":"172.21.15.146:6823","nonce":22859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":22859},{"type":"v1","addr":"172.21.15.146:6831","nonce":22859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6825","nonce":22859},{"type":"v1","addr":"172.21.15.146:6827","nonce":22859}]},"public_addr":"172.21.15.146:6819/22859","cluster_addr":"172.21.15.146:6823/22859","heartbeat_back_addr":"172.21.15.146:6831/22859","heartbeat_front_addr":"172.21.15.146:6827/22859","state":["exists","up"]},{"osd":11,"uuid":"31f650d6-ba1e-4f29-92ff-6abee04c0f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":23317},{"type":"v1","addr":"172.21.15.87:6809","nonce":23317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":23317},{"type":"v1","addr":"172.21.15.87:6811","nonce":23317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":23317},{"type":"v1","addr":"172.21.15.87:6816","nonce":23317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":23317},{"type":"v1","addr":"172.21.15.87:6813","nonce":23317}]},"public_addr":"172.21.15.87:6809/23317","cluster_addr":"172.21.15.87:6811/23317","heartbeat_back_addr":"172.21.15.87:6816/23317","heartbeat_front_addr":"172.21.15.87:6813/23317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.538863+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.552293+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.585265+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.505194+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.550032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.558089+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.565622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.587102+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.654330+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.599072+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.645833+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.596236+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:48:10.389 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.385+0000 7f8f41ebf700 1 -- 172.21.15.192:0/3169106943 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f8f140806a0 msgr2=0x7f8f14082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:10.389 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.385+0000 7f8f41ebf700 1 --2- 172.21.15.192:0/3169106943 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f8f140806a0 0x7f8f14082b60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f8f2c00b740 tx=0x7f8f2c008040).stop 2020-11-20T11:48:10.389 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.385+0000 7f8f41ebf700 1 -- 172.21.15.192:0/3169106943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f3c154920 msgr2=0x7f8f3c14c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:10.390 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.385+0000 7f8f41ebf700 1 --2- 172.21.15.192:0/3169106943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f3c154920 0x7f8f3c14c690 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f8f34009310 tx=0x7f8f34016000).stop 2020-11-20T11:48:10.390 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.385+0000 7f8f41ebf700 1 -- 172.21.15.192:0/3169106943 shutdown_connections 2020-11-20T11:48:10.390 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.385+0000 7f8f41ebf700 1 --2- 172.21.15.192:0/3169106943 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f8f140806a0 0x7f8f14082b60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:10.390 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.385+0000 7f8f41ebf700 1 --2- 172.21.15.192:0/3169106943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f3c154920 0x7f8f3c14c690 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:10.390 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.385+0000 7f8f41ebf700 1 --2- 172.21.15.192:0/3169106943 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8f3c060370 0x7f8f3c0c0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:10.391 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.385+0000 7f8f41ebf700 1 --2- 172.21.15.192:0/3169106943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f3c064c40 0x7f8f3c14c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:10.391 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.386+0000 7f8f41ebf700 1 -- 172.21.15.192:0/3169106943 >> 172.21.15.192:0/3169106943 conn(0x7f8f3c062100 msgr2=0x7f8f3c154d90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:10.391 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.386+0000 7f8f41ebf700 1 -- 172.21.15.192:0/3169106943 shutdown_connections 2020-11-20T11:48:10.392 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.386+0000 7f8f41ebf700 1 -- 172.21.15.192:0/3169106943 wait complete. 2020-11-20T11:48:10.401 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2020-11-20T11:48:10.512 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.509+0000 7fd1ad8d3700 1 Processor -- start 2020-11-20T11:48:10.513 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.509+0000 7fd1ad8d3700 1 -- start start 2020-11-20T11:48:10.516 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.510+0000 7fd1ad8d3700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd1a8154920 0x7fd1a8060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:10.516 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.510+0000 7fd1ad8d3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd1a8064c40 0x7fd1a8151340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:10.516 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.510+0000 7fd1ad8d3700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a8151e80 con 0x7fd1a8060370 2020-11-20T11:48:10.516 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.510+0000 7fd1ad8d3700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1a8152120 con 0x7fd1a8154920 2020-11-20T11:48:10.517 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.510+0000 7fd1ad8d3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1a8064260 con 0x7fd1a8064c40 2020-11-20T11:48:10.517 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.510+0000 7fd1a6ffd700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fd1a8060370 0x7fd1a80c2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51504/0 (socket says 172.21.15.192:51504) 2020-11-20T11:48:10.518 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.510+0000 7fd1a6ffd700 1 -- 172.21.15.192:0/87116846 learned_addr learned my addr 172.21.15.192:0/87116846 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:10.518 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.510+0000 7fd19ffff700 1 --2- 172.21.15.192:0/87116846 >> v2:172.21.15.87:3300/0 conn(0x7fd1a8154920 0x7fd1a8060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:10.518 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.510+0000 7fd1a67fc700 1 -- 172.21.15.192:0/87116846 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1150301785 0 0) 0x7fd1a8151e80 con 0x7fd1a8060370 2020-11-20T11:48:10.518 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.510+0000 7fd1a77fe700 1 --2- 172.21.15.192:0/87116846 >> v2:172.21.15.146:3300/0 conn(0x7fd1a8064c40 0x7fd1a8151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:10.519 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.510+0000 7fd1a67fc700 1 -- 172.21.15.192:0/87116846 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd188003280 con 0x7fd1a8060370 2020-11-20T11:48:10.519 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.511+0000 7fd19ffff700 1 -- 172.21.15.192:0/87116846 >> v2:172.21.15.146:3300/0 conn(0x7fd1a8064c40 msgr2=0x7fd1a8151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:10.519 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.511+0000 7fd19ffff700 1 --2- 172.21.15.192:0/87116846 >> v2:172.21.15.146:3300/0 conn(0x7fd1a8064c40 0x7fd1a8151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:10.519 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.511+0000 7fd1a67fc700 1 -- 172.21.15.192:0/87116846 <== mon.2 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 597013221 0 0) 0x7fd188003280 con 0x7fd1a8060370 2020-11-20T11:48:10.519 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.511+0000 7fd19ffff700 1 -- 172.21.15.192:0/87116846 >> v1:172.21.15.192:6789/0 conn(0x7fd1a8060370 legacy=0x7fd1a80c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:10.520 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.511+0000 7fd19ffff700 1 -- 172.21.15.192:0/87116846 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a8064500 con 0x7fd1a8154920 2020-11-20T11:48:10.520 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.511+0000 7fd19ffff700 1 --2- 172.21.15.192:0/87116846 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1a8154920 0x7fd1a8060750 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fd1a8065700 tx=0x7fd190006e30).ready entity=mon.0 client_cookie=c0e99a08cd5c3653 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:10.520 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.511+0000 7fd1a67fc700 1 -- 172.21.15.192:0/87116846 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd198001520 con 0x7fd1a8154920 2020-11-20T11:48:10.520 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.511+0000 7fd1a67fc700 1 -- 172.21.15.192:0/87116846 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd190000e90 con 0x7fd1a8154920 2020-11-20T11:48:10.521 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.511+0000 7fd1a67fc700 1 -- 172.21.15.192:0/87116846 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd190011610 con 0x7fd1a8154920 2020-11-20T11:48:10.521 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.511+0000 7fd1ad8d3700 1 -- 172.21.15.192:0/87116846 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1a8154920 msgr2=0x7fd1a8060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:10.521 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.511+0000 7fd1ad8d3700 1 --2- 172.21.15.192:0/87116846 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1a8154920 0x7fd1a8060750 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fd1a8065700 tx=0x7fd190006e30).stop 2020-11-20T11:48:10.521 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.511+0000 7fd1ad8d3700 1 -- 172.21.15.192:0/87116846 shutdown_connections 2020-11-20T11:48:10.522 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.511+0000 7fd1ad8d3700 1 --2- 172.21.15.192:0/87116846 >> v2:172.21.15.146:3300/0 conn(0x7fd1a8064c40 0x7fd1a8151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:10.522 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.511+0000 7fd1ad8d3700 1 --2- 172.21.15.192:0/87116846 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1a8154920 0x7fd1a8060750 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:10.522 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.511+0000 7fd1ad8d3700 1 -- 172.21.15.192:0/87116846 >> 172.21.15.192:0/87116846 conn(0x7fd1a8062100 msgr2=0x7fd1a80c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:10.522 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.512+0000 7fd1ad8d3700 1 -- 172.21.15.192:0/87116846 shutdown_connections 2020-11-20T11:48:10.523 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.512+0000 7fd1ad8d3700 1 -- 172.21.15.192:0/87116846 wait complete. 2020-11-20T11:48:10.523 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.513+0000 7fd1ad8d3700 1 Processor -- start 2020-11-20T11:48:10.523 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.513+0000 7fd1ad8d3700 1 -- start start 2020-11-20T11:48:10.526 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.513+0000 7fd1ad8d3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1a8060370 0x7fd1a8164910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:10.526 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.513+0000 7fd1ad8d3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1a8064c40 0x7fd1a814f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:10.526 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.513+0000 7fd1ad8d3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1a80c7510 0x7fd1a81562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:10.527 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.513+0000 7fd1ad8d3700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a814fd70 con 0x7fd1a8064c40 2020-11-20T11:48:10.527 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.513+0000 7fd1ad8d3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a8147fe0 con 0x7fd1a8060370 2020-11-20T11:48:10.527 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.513+0000 7fd1ad8d3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a814f830 con 0x7fd1a80c7510 2020-11-20T11:48:10.527 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.513+0000 7fd1a77fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1a80c7510 0x7fd1a81562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:10.528 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.513+0000 7fd1a77fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1a80c7510 0x7fd1a81562a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48846/0 (socket says 172.21.15.192:48846) 2020-11-20T11:48:10.528 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.513+0000 7fd1a77fe700 1 -- 172.21.15.192:0/3394261652 learned_addr learned my addr 172.21.15.192:0/3394261652 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:10.529 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.513+0000 7fd19ffff700 1 --2- 172.21.15.192:0/3394261652 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1a8064c40 0x7fd1a814f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:10.529 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.514+0000 7fd1a6ffd700 1 --2- 172.21.15.192:0/3394261652 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1a8060370 0x7fd1a8164910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:10.529 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.514+0000 7fd1a77fe700 1 -- 172.21.15.192:0/3394261652 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1a8060370 msgr2=0x7fd1a8164910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:10.529 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.514+0000 7fd1a77fe700 1 --2- 172.21.15.192:0/3394261652 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1a8060370 0x7fd1a8164910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:10.530 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.514+0000 7fd1a77fe700 1 -- 172.21.15.192:0/3394261652 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1a8064c40 msgr2=0x7fd1a814f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:10.530 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.514+0000 7fd1a77fe700 1 --2- 172.21.15.192:0/3394261652 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1a8064c40 0x7fd1a814f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:10.530 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.514+0000 7fd1a77fe700 1 -- 172.21.15.192:0/3394261652 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a814fad0 con 0x7fd1a80c7510 2020-11-20T11:48:10.530 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.514+0000 7fd1a77fe700 1 --2- 172.21.15.192:0/3394261652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1a80c7510 0x7fd1a81562a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fd1a000ef50 tx=0x7fd1a0009220).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:10.531 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.514+0000 7fd19effd700 1 -- 172.21.15.192:0/3394261652 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a000cc10 con 0x7fd1a80c7510 2020-11-20T11:48:10.531 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.514+0000 7fd19effd700 1 -- 172.21.15.192:0/3394261652 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a000cd70 con 0x7fd1a80c7510 2020-11-20T11:48:10.531 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.514+0000 7fd1ad8d3700 1 -- 172.21.15.192:0/3394261652 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a8163f30 con 0x7fd1a80c7510 2020-11-20T11:48:10.531 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.514+0000 7fd19effd700 1 -- 172.21.15.192:0/3394261652 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a000cee0 con 0x7fd1a80c7510 2020-11-20T11:48:10.532 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.514+0000 7fd1ad8d3700 1 -- 172.21.15.192:0/3394261652 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a8164470 con 0x7fd1a80c7510 2020-11-20T11:48:10.532 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.515+0000 7fd1ad8d3700 1 -- 172.21.15.192:0/3394261652 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a80699a0 con 0x7fd1a80c7510 2020-11-20T11:48:10.532 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.516+0000 7fd19effd700 1 -- 172.21.15.192:0/3394261652 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fd1a0022070 con 0x7fd1a80c7510 2020-11-20T11:48:10.532 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.516+0000 7fd19effd700 1 --2- 172.21.15.192:0/3394261652 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fd184080670 0x7fd184082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:10.533 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.516+0000 7fd1a6ffd700 1 --2- 172.21.15.192:0/3394261652 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fd184080670 0x7fd184082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:10.534 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.517+0000 7fd1a6ffd700 1 --2- 172.21.15.192:0/3394261652 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fd184080670 0x7fd184082b30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fd1980016d0 tx=0x7fd198001640).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:10.534 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.517+0000 7fd19effd700 1 -- 172.21.15.192:0/3394261652 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fd1a007b8a0 con 0x7fd1a80c7510 2020-11-20T11:48:10.534 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.520+0000 7fd19effd700 1 -- 172.21.15.192:0/3394261652 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fd1a0077c40 con 0x7fd1a80c7510 2020-11-20T11:48:10.709 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.706+0000 7fd1ad8d3700 1 -- 172.21.15.192:0/3394261652 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd1a8164600 con 0x7fd1a80c7510 2020-11-20T11:48:10.846 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.843+0000 7fd19effd700 1 -- 172.21.15.192:0/3394261652 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd1a0016020 con 0x7fd1a80c7510 2020-11-20T11:48:10.848 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.845+0000 7fd1ad8d3700 1 -- 172.21.15.192:0/3394261652 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fd184080670 msgr2=0x7fd184082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:10.848 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.845+0000 7fd1ad8d3700 1 --2- 172.21.15.192:0/3394261652 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fd184080670 0x7fd184082b30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fd1980016d0 tx=0x7fd198001640).stop 2020-11-20T11:48:10.848 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.845+0000 7fd1ad8d3700 1 -- 172.21.15.192:0/3394261652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1a80c7510 msgr2=0x7fd1a81562a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:10.848 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.845+0000 7fd1ad8d3700 1 --2- 172.21.15.192:0/3394261652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1a80c7510 0x7fd1a81562a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fd1a000ef50 tx=0x7fd1a0009220).stop 2020-11-20T11:48:10.849 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.845+0000 7fd1ad8d3700 1 -- 172.21.15.192:0/3394261652 shutdown_connections 2020-11-20T11:48:10.849 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.845+0000 7fd1ad8d3700 1 --2- 172.21.15.192:0/3394261652 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fd184080670 0x7fd184082b30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:10.849 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.845+0000 7fd1ad8d3700 1 --2- 172.21.15.192:0/3394261652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1a80c7510 0x7fd1a81562a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:10.849 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.845+0000 7fd1ad8d3700 1 --2- 172.21.15.192:0/3394261652 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd1a8060370 0x7fd1a8164910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:10.849 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.845+0000 7fd1ad8d3700 1 --2- 172.21.15.192:0/3394261652 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd1a8064c40 0x7fd1a814f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:10.850 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.845+0000 7fd1ad8d3700 1 -- 172.21.15.192:0/3394261652 >> 172.21.15.192:0/3394261652 conn(0x7fd1a8062100 msgr2=0x7fd1a80673b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:10.850 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.845+0000 7fd1ad8d3700 1 -- 172.21.15.192:0/3394261652 shutdown_connections 2020-11-20T11:48:10.850 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.845+0000 7fd1ad8d3700 1 -- 172.21.15.192:0/3394261652 wait complete. 2020-11-20T11:48:10.859 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2020-11-20T11:48:10.971 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.968+0000 7f1bcd904700 1 Processor -- start 2020-11-20T11:48:10.972 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.968+0000 7f1bcd904700 1 -- start start 2020-11-20T11:48:10.974 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.969+0000 7f1bcd904700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1bc8060370 0x7f1bc8060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:10.974 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.969+0000 7f1bcd904700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc8151e80 con 0x7f1bc8064c40 2020-11-20T11:48:10.975 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.969+0000 7f1bcd904700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc8152120 con 0x7f1bc8154920 2020-11-20T11:48:10.975 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.969+0000 7f1bcd904700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc8064260 con 0x7f1bc8060370 2020-11-20T11:48:10.975 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.969+0000 7f1bbffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1bc8154920 0x7f1bc80c2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.192:60806/0 (socket says 172.21.15.192:60806) 2020-11-20T11:48:10.975 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.970+0000 7f1bbffff700 1 -- 172.21.15.192:0/3333433667 learned_addr learned my addr 172.21.15.192:0/3333433667 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:10.975 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.970+0000 7f1bc6ffd700 1 --2- 172.21.15.192:0/3333433667 >> v2:172.21.15.87:3300/0 conn(0x7f1bc8060370 0x7f1bc8060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:10.976 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.970+0000 7f1bc67fc700 1 -- 172.21.15.192:0/3333433667 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1904881012 0 0) 0x7f1bc8152120 con 0x7f1bc8154920 2020-11-20T11:48:10.976 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.970+0000 7f1bc67fc700 1 -- 172.21.15.192:0/3333433667 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ba8003280 con 0x7f1bc8154920 2020-11-20T11:48:10.976 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.970+0000 7f1bc67fc700 1 -- 172.21.15.192:0/3333433667 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1554526782 0 0) 0x7f1bc8151e80 con 0x7f1bc8064c40 2020-11-20T11:48:10.976 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.970+0000 7f1bc67fc700 1 -- 172.21.15.192:0/3333433667 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bc8152120 con 0x7f1bc8064c40 2020-11-20T11:48:10.976 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.970+0000 7f1bc6ffd700 1 -- 172.21.15.192:0/3333433667 >> v1:172.21.15.146:6789/0 conn(0x7f1bc8154920 legacy=0x7f1bc80c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:10.977 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.970+0000 7f1bc6ffd700 1 -- 172.21.15.192:0/3333433667 >> v1:172.21.15.87:6789/0 conn(0x7f1bc8064c40 legacy=0x7f1bc8151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:10.977 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.970+0000 7f1bc6ffd700 1 -- 172.21.15.192:0/3333433667 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc8064500 con 0x7f1bc8060370 2020-11-20T11:48:10.977 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.970+0000 7f1bc6ffd700 1 --2- 172.21.15.192:0/3333433667 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bc8060370 0x7f1bc8060750 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f1bb8006fd0 tx=0x7f1bb8006e30).ready entity=mon.0 client_cookie=aaae5eb910e2c8be server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:10.977 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.970+0000 7f1bc67fc700 1 -- 172.21.15.192:0/3333433667 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb80096c0 con 0x7f1bc8060370 2020-11-20T11:48:10.977 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.970+0000 7f1bc67fc700 1 -- 172.21.15.192:0/3333433667 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb8000e90 con 0x7f1bc8060370 2020-11-20T11:48:10.978 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.970+0000 7f1bc67fc700 1 -- 172.21.15.192:0/3333433667 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8009a30 con 0x7f1bc8060370 2020-11-20T11:48:10.978 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.971+0000 7f1bcd904700 1 -- 172.21.15.192:0/3333433667 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bc8060370 msgr2=0x7f1bc8060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:10.978 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.971+0000 7f1bcd904700 1 --2- 172.21.15.192:0/3333433667 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bc8060370 0x7f1bc8060750 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f1bb8006fd0 tx=0x7f1bb8006e30).stop 2020-11-20T11:48:10.978 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.971+0000 7f1bcd904700 1 -- 172.21.15.192:0/3333433667 shutdown_connections 2020-11-20T11:48:10.978 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.971+0000 7f1bcd904700 1 --2- 172.21.15.192:0/3333433667 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bc8060370 0x7f1bc8060750 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:10.979 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.971+0000 7f1bcd904700 1 -- 172.21.15.192:0/3333433667 >> 172.21.15.192:0/3333433667 conn(0x7f1bc8062100 msgr2=0x7f1bc80c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:10.979 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.971+0000 7f1bcd904700 1 -- 172.21.15.192:0/3333433667 shutdown_connections 2020-11-20T11:48:10.979 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.971+0000 7f1bcd904700 1 -- 172.21.15.192:0/3333433667 wait complete. 2020-11-20T11:48:10.982 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.972+0000 7f1bcd904700 1 Processor -- start 2020-11-20T11:48:10.982 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.972+0000 7f1bcd904700 1 -- start start 2020-11-20T11:48:10.982 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.973+0000 7f1bcd904700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bc8060370 0x7f1bc80bfae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:10.982 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.973+0000 7f1bcd904700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bc8064c40 0x7f1bc8163ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:10.982 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.973+0000 7f1bcd904700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bc8154920 0x7f1bc80b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:10.983 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.973+0000 7f1bcd904700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc8163fd0 con 0x7f1bc8064c40 2020-11-20T11:48:10.983 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.973+0000 7f1bcd904700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc8164250 con 0x7f1bc8060370 2020-11-20T11:48:10.983 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.973+0000 7f1bcd904700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc81644f0 con 0x7f1bc8154920 2020-11-20T11:48:10.983 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.973+0000 7f1bc77fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bc8154920 0x7f1bc80b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:10.983 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.973+0000 7f1bc77fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bc8154920 0x7f1bc80b0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48858/0 (socket says 172.21.15.192:48858) 2020-11-20T11:48:10.984 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.973+0000 7f1bc77fe700 1 -- 172.21.15.192:0/4084604599 learned_addr learned my addr 172.21.15.192:0/4084604599 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:10.984 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.973+0000 7f1bbffff700 1 --2- 172.21.15.192:0/4084604599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bc8064c40 0x7f1bc8163ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:10.984 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.973+0000 7f1bc6ffd700 1 --2- 172.21.15.192:0/4084604599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bc8060370 0x7f1bc80bfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:10.984 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.973+0000 7f1bc77fe700 1 -- 172.21.15.192:0/4084604599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bc8060370 msgr2=0x7f1bc80bfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:10.984 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.973+0000 7f1bc77fe700 1 --2- 172.21.15.192:0/4084604599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bc8060370 0x7f1bc80bfae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:10.985 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.973+0000 7f1bc77fe700 1 -- 172.21.15.192:0/4084604599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bc8064c40 msgr2=0x7f1bc8163ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:10.985 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.973+0000 7f1bc77fe700 1 --2- 172.21.15.192:0/4084604599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bc8064c40 0x7f1bc8163ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:10.985 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.973+0000 7f1bc77fe700 1 -- 172.21.15.192:0/4084604599 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc8164790 con 0x7f1bc8154920 2020-11-20T11:48:10.985 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.973+0000 7f1bc77fe700 1 --2- 172.21.15.192:0/4084604599 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bc8154920 0x7f1bc80b0340 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f1bc000ca90 tx=0x7f1bc0007dd0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:10.985 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.973+0000 7f1bbeffd700 1 -- 172.21.15.192:0/4084604599 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0002240 con 0x7f1bc8154920 2020-11-20T11:48:10.986 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.973+0000 7f1bbeffd700 1 -- 172.21.15.192:0/4084604599 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc00023a0 con 0x7f1bc8154920 2020-11-20T11:48:10.986 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.973+0000 7f1bbeffd700 1 -- 172.21.15.192:0/4084604599 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0001860 con 0x7f1bc8154920 2020-11-20T11:48:10.986 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.973+0000 7f1bcd904700 1 -- 172.21.15.192:0/4084604599 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc8160780 con 0x7f1bc8154920 2020-11-20T11:48:10.986 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.973+0000 7f1bcd904700 1 -- 172.21.15.192:0/4084604599 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc80b0830 con 0x7f1bc8154920 2020-11-20T11:48:10.986 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.974+0000 7f1bcd904700 1 -- 172.21.15.192:0/4084604599 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bc80699a0 con 0x7f1bc8154920 2020-11-20T11:48:10.987 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.975+0000 7f1bbeffd700 1 -- 172.21.15.192:0/4084604599 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f1bc0019030 con 0x7f1bc8154920 2020-11-20T11:48:10.987 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.975+0000 7f1bbeffd700 1 --2- 172.21.15.192:0/4084604599 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f1ba4080670 0x7f1ba4082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:10.987 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.976+0000 7f1bbeffd700 1 -- 172.21.15.192:0/4084604599 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f1bc00a2110 con 0x7f1bc8154920 2020-11-20T11:48:10.987 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.976+0000 7f1bc6ffd700 1 --2- 172.21.15.192:0/4084604599 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f1ba4080670 0x7f1ba4082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:10.987 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.976+0000 7f1bc6ffd700 1 --2- 172.21.15.192:0/4084604599 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f1ba4080670 0x7f1ba4082b30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f1bc814e260 tx=0x7f1bb8015000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:10.988 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:10.979+0000 7f1bbeffd700 1 -- 172.21.15.192:0/4084604599 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f1bc0076b20 con 0x7f1bc8154920 2020-11-20T11:48:11.168 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.165+0000 7f1bcd904700 1 -- 172.21.15.192:0/4084604599 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f1bc8160be0 con 0x7f1bc8154920 2020-11-20T11:48:11.847 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.844+0000 7f1bbeffd700 1 -- 172.21.15.192:0/4084604599 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v6) v1 ==== 115+0+0 (secure 0 0 0) 0x7f1bc007a140 con 0x7f1bc8154920 2020-11-20T11:48:11.849 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.846+0000 7f1bcd904700 1 -- 172.21.15.192:0/4084604599 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f1ba4080670 msgr2=0x7f1ba4082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:11.850 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.846+0000 7f1bcd904700 1 --2- 172.21.15.192:0/4084604599 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f1ba4080670 0x7f1ba4082b30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f1bc814e260 tx=0x7f1bb8015000).stop 2020-11-20T11:48:11.850 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.846+0000 7f1bcd904700 1 -- 172.21.15.192:0/4084604599 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bc8154920 msgr2=0x7f1bc80b0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:11.850 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.846+0000 7f1bcd904700 1 --2- 172.21.15.192:0/4084604599 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bc8154920 0x7f1bc80b0340 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f1bc000ca90 tx=0x7f1bc0007dd0).stop 2020-11-20T11:48:11.850 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.846+0000 7f1bcd904700 1 -- 172.21.15.192:0/4084604599 shutdown_connections 2020-11-20T11:48:11.850 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.846+0000 7f1bcd904700 1 --2- 172.21.15.192:0/4084604599 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f1ba4080670 0x7f1ba4082b30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:11.851 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.846+0000 7f1bcd904700 1 --2- 172.21.15.192:0/4084604599 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bc8154920 0x7f1bc80b0340 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:11.851 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.846+0000 7f1bcd904700 1 --2- 172.21.15.192:0/4084604599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bc8060370 0x7f1bc80bfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:11.851 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.846+0000 7f1bcd904700 1 --2- 172.21.15.192:0/4084604599 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1bc8064c40 0x7f1bc8163ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:11.851 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.846+0000 7f1bcd904700 1 -- 172.21.15.192:0/4084604599 >> 172.21.15.192:0/4084604599 conn(0x7f1bc8062100 msgr2=0x7f1bc80c2340 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:11.851 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.846+0000 7f1bcd904700 1 -- 172.21.15.192:0/4084604599 shutdown_connections 2020-11-20T11:48:11.852 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.846+0000 7f1bcd904700 1 -- 172.21.15.192:0/4084604599 wait complete. 2020-11-20T11:48:11.862 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-11-20T11:48:11.971 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.968+0000 7f19ab79c700 1 Processor -- start 2020-11-20T11:48:11.972 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.969+0000 7f19ab79c700 1 -- start start 2020-11-20T11:48:11.974 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.969+0000 7f19ab79c700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f19a4060750 0x7f19a4064c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:11.974 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.969+0000 7f19ab79c700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a4065130 con 0x7f19a4154920 2020-11-20T11:48:11.974 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.969+0000 7f19ab79c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a4151e80 con 0x7f19a4060370 2020-11-20T11:48:11.975 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.969+0000 7f19ab79c700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a4152120 con 0x7f19a4060750 2020-11-20T11:48:11.975 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.970+0000 7f19a9d39700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f19a4060750 0x7f19a4064c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:11.975 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.970+0000 7f19a9d39700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f19a4060750 0x7f19a4064c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.192:58306/0 (socket says 172.21.15.192:58306) 2020-11-20T11:48:11.975 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.970+0000 7f19a9d39700 1 -- 172.21.15.192:0/1235417102 learned_addr learned my addr 172.21.15.192:0/1235417102 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:11.975 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.970+0000 7f19a9538700 1 --1- 172.21.15.192:0/1235417102 >> v1:172.21.15.146:6789/0 conn(0x7f19a4060370 0x7f19a40c2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.192:60818/0 (socket says 172.21.15.192:60818) 2020-11-20T11:48:11.976 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.970+0000 7f19a8d37700 1 --1- 172.21.15.192:0/1235417102 >> v1:172.21.15.87:6789/0 conn(0x7f19a4154920 0x7f19a4151340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.192:38248/0 (socket says 172.21.15.192:38248) 2020-11-20T11:48:11.976 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.970+0000 7f1993fff700 1 -- 172.21.15.192:0/1235417102 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4169148630 0 0) 0x7f19a4151e80 con 0x7f19a4060370 2020-11-20T11:48:11.976 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.970+0000 7f1993fff700 1 -- 172.21.15.192:0/1235417102 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f198c003280 con 0x7f19a4060370 2020-11-20T11:48:11.976 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.970+0000 7f19a9d39700 1 -- 172.21.15.192:0/1235417102 >> v1:172.21.15.146:6789/0 conn(0x7f19a4060370 legacy=0x7f19a40c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:11.976 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.970+0000 7f19a9d39700 1 -- 172.21.15.192:0/1235417102 >> v1:172.21.15.87:6789/0 conn(0x7f19a4154920 legacy=0x7f19a4151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:11.977 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.970+0000 7f1993fff700 1 -- 172.21.15.192:0/1235417102 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445998678 0 0) 0x7f19a4065130 con 0x7f19a4154920 2020-11-20T11:48:11.977 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.970+0000 7f19a9d39700 1 -- 172.21.15.192:0/1235417102 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a4064260 con 0x7f19a4060750 2020-11-20T11:48:11.977 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.970+0000 7f19a9d39700 1 --2- 172.21.15.192:0/1235417102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19a4060750 0x7f19a4064c40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f199c009d90 tx=0x7f199c0092d0).ready entity=mon.0 client_cookie=8009a31bf1428753 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:11.977 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.970+0000 7f1993fff700 1 -- 172.21.15.192:0/1235417102 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c00bc80 con 0x7f19a4060750 2020-11-20T11:48:11.977 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.970+0000 7f1993fff700 1 -- 172.21.15.192:0/1235417102 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199c00bde0 con 0x7f19a4060750 2020-11-20T11:48:11.978 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.970+0000 7f1993fff700 1 -- 172.21.15.192:0/1235417102 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c011610 con 0x7f19a4060750 2020-11-20T11:48:11.978 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.971+0000 7f19ab79c700 1 -- 172.21.15.192:0/1235417102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19a4060750 msgr2=0x7f19a4064c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:11.978 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.971+0000 7f19ab79c700 1 --2- 172.21.15.192:0/1235417102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19a4060750 0x7f19a4064c40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f199c009d90 tx=0x7f199c0092d0).stop 2020-11-20T11:48:11.978 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.971+0000 7f19ab79c700 1 -- 172.21.15.192:0/1235417102 shutdown_connections 2020-11-20T11:48:11.978 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.971+0000 7f19ab79c700 1 --2- 172.21.15.192:0/1235417102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19a4060750 0x7f19a4064c40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:11.979 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.971+0000 7f19ab79c700 1 -- 172.21.15.192:0/1235417102 >> 172.21.15.192:0/1235417102 conn(0x7f19a4062100 msgr2=0x7f19a40c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:11.979 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.971+0000 7f19ab79c700 1 -- 172.21.15.192:0/1235417102 shutdown_connections 2020-11-20T11:48:11.979 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.971+0000 7f19ab79c700 1 -- 172.21.15.192:0/1235417102 wait complete. 2020-11-20T11:48:11.982 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.972+0000 7f19ab79c700 1 Processor -- start 2020-11-20T11:48:11.982 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.972+0000 7f19ab79c700 1 -- start start 2020-11-20T11:48:11.982 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.973+0000 7f19ab79c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19a4060370 0x7f19a40b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:11.982 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.973+0000 7f19ab79c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19a4060750 0x7f19a4163730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:11.983 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.973+0000 7f19ab79c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19a4154920 0x7f19a4160a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:11.983 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.973+0000 7f19ab79c700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a4163c20 con 0x7f19a4154920 2020-11-20T11:48:11.983 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.973+0000 7f19ab79c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a4163ea0 con 0x7f19a4060370 2020-11-20T11:48:11.983 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.973+0000 7f19ab79c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a4164140 con 0x7f19a4060750 2020-11-20T11:48:11.983 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.973+0000 7f19a8d37700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19a4060750 0x7f19a4163730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:11.984 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.973+0000 7f19a8d37700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19a4060750 0x7f19a4163730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48870/0 (socket says 172.21.15.192:48870) 2020-11-20T11:48:11.984 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.973+0000 7f19a8d37700 1 -- 172.21.15.192:0/1912878766 learned_addr learned my addr 172.21.15.192:0/1912878766 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:11.984 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.973+0000 7f19a9d39700 1 --2- 172.21.15.192:0/1912878766 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19a4154920 0x7f19a4160a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:11.984 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.973+0000 7f19a9538700 1 --2- 172.21.15.192:0/1912878766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19a4060370 0x7f19a40b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:11.984 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.973+0000 7f19a8d37700 1 -- 172.21.15.192:0/1912878766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19a4060370 msgr2=0x7f19a40b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:11.985 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.973+0000 7f19a8d37700 1 --2- 172.21.15.192:0/1912878766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19a4060370 0x7f19a40b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:11.985 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.973+0000 7f19a8d37700 1 -- 172.21.15.192:0/1912878766 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19a4154920 msgr2=0x7f19a4160a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:11.985 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.973+0000 7f19a8d37700 1 --2- 172.21.15.192:0/1912878766 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19a4154920 0x7f19a4160a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:11.985 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.973+0000 7f19a8d37700 1 -- 172.21.15.192:0/1912878766 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a41643e0 con 0x7f19a4060750 2020-11-20T11:48:11.985 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.973+0000 7f19a9d39700 1 --2- 172.21.15.192:0/1912878766 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19a4154920 0x7f19a4160a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:48:11.986 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.974+0000 7f19a8d37700 1 --2- 172.21.15.192:0/1912878766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19a4060750 0x7f19a4163730 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f199400c790 tx=0x7f1994007b20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:11.986 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.974+0000 7f19917fa700 1 -- 172.21.15.192:0/1912878766 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1994007320 con 0x7f19a4060750 2020-11-20T11:48:11.986 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.974+0000 7f19917fa700 1 -- 172.21.15.192:0/1912878766 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1994005570 con 0x7f19a4060750 2020-11-20T11:48:11.986 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.974+0000 7f19ab79c700 1 -- 172.21.15.192:0/1912878766 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a4160350 con 0x7f19a4060750 2020-11-20T11:48:11.986 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.974+0000 7f19917fa700 1 -- 172.21.15.192:0/1912878766 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19940058f0 con 0x7f19a4060750 2020-11-20T11:48:11.987 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.974+0000 7f19ab79c700 1 -- 172.21.15.192:0/1912878766 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a4160f80 con 0x7f19a4060750 2020-11-20T11:48:11.987 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.975+0000 7f19ab79c700 1 -- 172.21.15.192:0/1912878766 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a40699a0 con 0x7f19a4060750 2020-11-20T11:48:11.987 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.975+0000 7f19917fa700 1 -- 172.21.15.192:0/1912878766 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f1994010030 con 0x7f19a4060750 2020-11-20T11:48:11.987 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.976+0000 7f19917fa700 1 --2- 172.21.15.192:0/1912878766 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f197c080670 0x7f197c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:11.987 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.976+0000 7f19917fa700 1 -- 172.21.15.192:0/1912878766 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f19940a27e0 con 0x7f19a4060750 2020-11-20T11:48:11.988 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.976+0000 7f19a9538700 1 --2- 172.21.15.192:0/1912878766 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f197c080670 0x7f197c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:11.988 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.976+0000 7f19a9538700 1 --2- 172.21.15.192:0/1912878766 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f197c080670 0x7f197c082b30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f19a0007e60 tx=0x7f19a0007180).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:11.988 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:11.979+0000 7f19917fa700 1 -- 172.21.15.192:0/1912878766 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f19940771f0 con 0x7f19a4060750 2020-11-20T11:48:12.171 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.168+0000 7f19ab79c700 1 -- 172.21.15.192:0/1912878766 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19a41607b0 con 0x7f19a4060750 2020-11-20T11:48:12.172 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.169+0000 7f19917fa700 1 -- 172.21.15.192:0/1912878766 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2483 (secure 0 0 0) 0x7f199407a810 con 0x7f19a4060750 2020-11-20T11:48:12.172 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:48:12.173 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4296,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/3791880310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3791880310},{"type":"v1","addr":"172.21.15.87:6833","nonce":3791880310}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":2},{"gid":4307,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/56648167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":56648167},{"type":"v1","addr":"172.21.15.192:6835","nonce":56648167}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-11-20T11:48:09.832534+0000","modified":"2020-11-20T11:48:11.842814+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4319":{"gid":4319,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6833/1982840368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1982840368},{"type":"v1","addr":"172.21.15.146:6833","nonce":1982840368}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-11-20T11:48:12.174 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.170+0000 7f19ab79c700 1 -- 172.21.15.192:0/1912878766 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f197c080670 msgr2=0x7f197c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:12.174 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.170+0000 7f19ab79c700 1 --2- 172.21.15.192:0/1912878766 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f197c080670 0x7f197c082b30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f19a0007e60 tx=0x7f19a0007180).stop 2020-11-20T11:48:12.174 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.170+0000 7f19ab79c700 1 -- 172.21.15.192:0/1912878766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19a4060750 msgr2=0x7f19a4163730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:12.174 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.170+0000 7f19ab79c700 1 --2- 172.21.15.192:0/1912878766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19a4060750 0x7f19a4163730 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f199400c790 tx=0x7f1994007b20).stop 2020-11-20T11:48:12.175 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.170+0000 7f19ab79c700 1 -- 172.21.15.192:0/1912878766 shutdown_connections 2020-11-20T11:48:12.175 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.170+0000 7f19ab79c700 1 --2- 172.21.15.192:0/1912878766 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f197c080670 0x7f197c082b30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:12.175 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.170+0000 7f19ab79c700 1 --2- 172.21.15.192:0/1912878766 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f19a4154920 0x7f19a4160a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:12.175 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.170+0000 7f19ab79c700 1 --2- 172.21.15.192:0/1912878766 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f19a4060370 0x7f19a40b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:12.176 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.170+0000 7f19ab79c700 1 --2- 172.21.15.192:0/1912878766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19a4060750 0x7f19a4163730 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:12.176 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.170+0000 7f19ab79c700 1 -- 172.21.15.192:0/1912878766 >> 172.21.15.192:0/1912878766 conn(0x7f19a4062100 msgr2=0x7f19a4154d90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:12.176 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.170+0000 7f19ab79c700 1 -- 172.21.15.192:0/1912878766 shutdown_connections 2020-11-20T11:48:12.176 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.170+0000 7f19ab79c700 1 -- 172.21.15.192:0/1912878766 wait complete. 2020-11-20T11:48:12.176 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 6 2020-11-20T11:48:12.185 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:48:12.293 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.290+0000 7f42c9b42700 1 Processor -- start 2020-11-20T11:48:12.293 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.290+0000 7f42c9b42700 1 -- start start 2020-11-20T11:48:12.297 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.291+0000 7f42c9b42700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c4154610 con 0x7f42c4061bd0 2020-11-20T11:48:12.297 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.291+0000 7f42c9b42700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c41548b0 con 0x7f42c4150c70 2020-11-20T11:48:12.297 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.291+0000 7f42c9b42700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c4154b50 con 0x7f42c40617f0 2020-11-20T11:48:12.297 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.291+0000 7f42c8b40700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f42c40617f0 0x7f42c4150560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51548/0 (socket says 172.21.15.192:51548) 2020-11-20T11:48:12.297 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.291+0000 7f42c8b40700 1 -- 172.21.15.192:0/3583636853 learned_addr learned my addr 172.21.15.192:0/3583636853 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:12.298 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.291+0000 7f42c37fe700 1 -- 172.21.15.192:0/3583636853 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 98666027 0 0) 0x7f42c4154b50 con 0x7f42c40617f0 2020-11-20T11:48:12.298 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.291+0000 7f42c37fe700 1 -- 172.21.15.192:0/3583636853 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42a8003280 con 0x7f42c40617f0 2020-11-20T11:48:12.298 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.291+0000 7f42c37fe700 1 -- 172.21.15.192:0/3583636853 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 855150331 0 0) 0x7f42c41548b0 con 0x7f42c4150c70 2020-11-20T11:48:12.298 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.291+0000 7f42c37fe700 1 -- 172.21.15.192:0/3583636853 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42c4154b50 con 0x7f42c4150c70 2020-11-20T11:48:12.298 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.291+0000 7f42c37fe700 1 -- 172.21.15.192:0/3583636853 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4126488904 0 0) 0x7f42c4154610 con 0x7f42c4061bd0 2020-11-20T11:48:12.299 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.291+0000 7f42c37fe700 1 -- 172.21.15.192:0/3583636853 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42c41548b0 con 0x7f42c4061bd0 2020-11-20T11:48:12.299 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.291+0000 7f42c37fe700 1 -- 172.21.15.192:0/3583636853 <== mon.2 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2278535365 0 0) 0x7f42a8003280 con 0x7f42c40617f0 2020-11-20T11:48:12.299 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.291+0000 7f42c37fe700 1 -- 172.21.15.192:0/3583636853 >> v1:172.21.15.146:6789/0 conn(0x7f42c4150c70 legacy=0x7f42c4151430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:12.299 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.291+0000 7f42c37fe700 1 -- 172.21.15.192:0/3583636853 >> v1:172.21.15.87:6789/0 conn(0x7f42c4061bd0 legacy=0x7f42c40675e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:12.299 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.291+0000 7f42c37fe700 1 -- 172.21.15.192:0/3583636853 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c4154df0 con 0x7f42c40617f0 2020-11-20T11:48:12.300 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.291+0000 7f42c37fe700 1 -- 172.21.15.192:0/3583636853 <== mon.2 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3985397220 0 0) 0x7f42b8001520 con 0x7f42c40617f0 2020-11-20T11:48:12.300 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.291+0000 7f42c37fe700 1 -- 172.21.15.192:0/3583636853 >> v1:172.21.15.192:6789/0 conn(0x7f42c40617f0 legacy=0x7f42c4150560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:12.300 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.291+0000 7f42c37fe700 1 --2- 172.21.15.192:0/3583636853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42a8003b80 0x7f42a8003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:12.300 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.291+0000 7f42c37fe700 1 --2- 172.21.15.192:0/3583636853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42a8004610 0x7f42a8004a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:12.300 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.291+0000 7f42c37fe700 1 --2- 172.21.15.192:0/3583636853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42a8005070 0x7f42a800b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:12.301 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.291+0000 7f42c37fe700 1 -- 172.21.15.192:0/3583636853 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a800bd60 con 0x7f42a8005070 2020-11-20T11:48:12.301 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.291+0000 7f42c37fe700 1 -- 172.21.15.192:0/3583636853 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a800bed0 con 0x7f42a8003b80 2020-11-20T11:48:12.301 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.291+0000 7f42c37fe700 1 -- 172.21.15.192:0/3583636853 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a800c090 con 0x7f42a8004610 2020-11-20T11:48:12.301 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.292+0000 7f42c3fff700 1 --2- 172.21.15.192:0/3583636853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42a8004610 0x7f42a8004a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:12.302 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.292+0000 7f42c8b40700 1 --2- 172.21.15.192:0/3583636853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42a8003b80 0x7f42a8003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:12.302 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.292+0000 7f42c9341700 1 --2- 172.21.15.192:0/3583636853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42a8005070 0x7f42a800b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:12.302 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.292+0000 7f42c3fff700 1 -- 172.21.15.192:0/3583636853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42a8003b80 msgr2=0x7f42a8003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:12.302 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.292+0000 7f42c3fff700 1 --2- 172.21.15.192:0/3583636853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42a8003b80 0x7f42a8003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:12.302 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.292+0000 7f42c3fff700 1 -- 172.21.15.192:0/3583636853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42a8005070 msgr2=0x7f42a800b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:12.303 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.292+0000 7f42c3fff700 1 --2- 172.21.15.192:0/3583636853 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42a8005070 0x7f42a800b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:12.303 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.292+0000 7f42c9341700 1 -- 172.21.15.192:0/3583636853 reap_dead start 2020-11-20T11:48:12.303 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.292+0000 7f42c3fff700 1 -- 172.21.15.192:0/3583636853 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a8003280 con 0x7f42a8004610 2020-11-20T11:48:12.303 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.292+0000 7f42c3fff700 1 --2- 172.21.15.192:0/3583636853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42a8004610 0x7f42a8004a90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f42b0001a20 tx=0x7f42b0007bb0).ready entity=mon.2 client_cookie=b21d1966e06bd0aa server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:12.304 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.292+0000 7f42c37fe700 1 -- 172.21.15.192:0/3583636853 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b000c860 con 0x7f42a8004610 2020-11-20T11:48:12.304 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.292+0000 7f42c37fe700 1 -- 172.21.15.192:0/3583636853 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b000c9c0 con 0x7f42a8004610 2020-11-20T11:48:12.304 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.292+0000 7f42c37fe700 1 -- 172.21.15.192:0/3583636853 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b000cd60 con 0x7f42a8004610 2020-11-20T11:48:12.304 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.292+0000 7f42c9b42700 1 -- 172.21.15.192:0/3583636853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42a8004610 msgr2=0x7f42a8004a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:12.305 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.292+0000 7f42c9b42700 1 --2- 172.21.15.192:0/3583636853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42a8004610 0x7f42a8004a90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f42b0001a20 tx=0x7f42b0007bb0).stop 2020-11-20T11:48:12.305 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.292+0000 7f42c9b42700 1 -- 172.21.15.192:0/3583636853 shutdown_connections 2020-11-20T11:48:12.305 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.292+0000 7f42c9b42700 1 --2- 172.21.15.192:0/3583636853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42a8004610 0x7f42a8004a90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:12.305 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.293+0000 7f42c9b42700 1 -- 172.21.15.192:0/3583636853 >> 172.21.15.192:0/3583636853 conn(0x7f42c40c77f0 msgr2=0x7f42c40c7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:12.306 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.293+0000 7f42c9b42700 1 -- 172.21.15.192:0/3583636853 shutdown_connections 2020-11-20T11:48:12.306 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.293+0000 7f42c9b42700 1 -- 172.21.15.192:0/3583636853 wait complete. 2020-11-20T11:48:12.306 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.294+0000 7f42c9b42700 1 Processor -- start 2020-11-20T11:48:12.306 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.294+0000 7f42c9b42700 1 -- start start 2020-11-20T11:48:12.309 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.295+0000 7f42c9b42700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42a8004610 0x7f42c40c2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:12.309 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.295+0000 7f42c9b42700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42c40c2770 0x7f42c4161400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:12.309 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.295+0000 7f42c9b42700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42c41618f0 0x7f42c4143f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:12.310 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.295+0000 7f42c9b42700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c4146b40 con 0x7f42a8004610 2020-11-20T11:48:12.310 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.295+0000 7f42c9b42700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c414b350 con 0x7f42c40c2770 2020-11-20T11:48:12.310 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.295+0000 7f42c9b42700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c41460c0 con 0x7f42c41618f0 2020-11-20T11:48:12.311 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.295+0000 7f42c9341700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42c41618f0 0x7f42c4143f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:12.311 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.295+0000 7f42c9341700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42c41618f0 0x7f42c4143f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48892/0 (socket says 172.21.15.192:48892) 2020-11-20T11:48:12.311 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.295+0000 7f42c9341700 1 -- 172.21.15.192:0/712705395 learned_addr learned my addr 172.21.15.192:0/712705395 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:12.311 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.295+0000 7f42c8b40700 1 --2- 172.21.15.192:0/712705395 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42a8004610 0x7f42c40c2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:12.311 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.295+0000 7f42c3fff700 1 --2- 172.21.15.192:0/712705395 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42c40c2770 0x7f42c4161400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:12.312 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.295+0000 7f42c9341700 1 -- 172.21.15.192:0/712705395 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42c40c2770 msgr2=0x7f42c4161400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:12.313 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.295+0000 7f42c9341700 1 --2- 172.21.15.192:0/712705395 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42c40c2770 0x7f42c4161400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:12.313 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.295+0000 7f42c9341700 1 -- 172.21.15.192:0/712705395 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42a8004610 msgr2=0x7f42c40c2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:12.313 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.295+0000 7f42c9341700 1 --2- 172.21.15.192:0/712705395 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42a8004610 0x7f42c40c2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:12.313 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.295+0000 7f42c9341700 1 -- 172.21.15.192:0/712705395 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c4146360 con 0x7f42c41618f0 2020-11-20T11:48:12.314 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.295+0000 7f42c9341700 1 --2- 172.21.15.192:0/712705395 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42c41618f0 0x7f42c4143f70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f42c40661e0 tx=0x7f42bc007f50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:12.314 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.295+0000 7f42c0ff9700 1 -- 172.21.15.192:0/712705395 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc006ac0 con 0x7f42c41618f0 2020-11-20T11:48:12.314 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.295+0000 7f42c0ff9700 1 -- 172.21.15.192:0/712705395 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42bc006c20 con 0x7f42c41618f0 2020-11-20T11:48:12.314 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.295+0000 7f42c9b42700 1 -- 172.21.15.192:0/712705395 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c4146600 con 0x7f42c41618f0 2020-11-20T11:48:12.314 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.295+0000 7f42c0ff9700 1 -- 172.21.15.192:0/712705395 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc002020 con 0x7f42c41618f0 2020-11-20T11:48:12.315 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.295+0000 7f42c9b42700 1 -- 172.21.15.192:0/712705395 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c4160f60 con 0x7f42c41618f0 2020-11-20T11:48:12.315 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.296+0000 7f42c9b42700 1 -- 172.21.15.192:0/712705395 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c4064b70 con 0x7f42c41618f0 2020-11-20T11:48:12.315 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.297+0000 7f42c0ff9700 1 -- 172.21.15.192:0/712705395 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f42bc002390 con 0x7f42c41618f0 2020-11-20T11:48:12.315 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.297+0000 7f42c0ff9700 1 --2- 172.21.15.192:0/712705395 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f429c080670 0x7f429c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:12.315 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.297+0000 7f42c0ff9700 1 -- 172.21.15.192:0/712705395 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f42bc0a26f0 con 0x7f42c41618f0 2020-11-20T11:48:12.316 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.297+0000 7f42c8b40700 1 --2- 172.21.15.192:0/712705395 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f429c080670 0x7f429c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:12.316 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.298+0000 7f42c8b40700 1 --2- 172.21.15.192:0/712705395 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f429c080670 0x7f429c082b30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f42b8000e10 tx=0x7f42c4154ce0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:12.316 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.301+0000 7f42c0ff9700 1 -- 172.21.15.192:0/712705395 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f42bc077100 con 0x7f42c41618f0 2020-11-20T11:48:12.445 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.442+0000 7f42c9b42700 1 -- 172.21.15.192:0/712705395 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42c41610f0 con 0x7f42c41618f0 2020-11-20T11:48:12.446 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.443+0000 7f42c0ff9700 1 -- 172.21.15.192:0/712705395 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21795 (secure 0 0 0) 0x7f42bc07a720 con 0x7f42c41618f0 2020-11-20T11:48:12.447 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:48:12.447 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":28,"fsid":"4871390d-d110-4379-8302-5810d7b54f34","created":"2020-11-20T11:47:49.059675+0000","modified":"2020-11-20T11:48:09.832333+0000","last_up_change":"2020-11-20T11:47:57.317253+0000","last_in_change":"2020-11-20T11:47:57.317253+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:47:52.327778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:48:01.912951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:48:04.793810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:48:07.506705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77a5e1d9-0fb0-450c-872e-4aee77dede49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":23242},{"type":"v1","addr":"172.21.15.192:6827","nonce":23242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":23242},{"type":"v1","addr":"172.21.15.192:6829","nonce":23242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":23242},{"type":"v1","addr":"172.21.15.192:6833","nonce":23242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":23242},{"type":"v1","addr":"172.21.15.192:6831","nonce":23242}]},"public_addr":"172.21.15.192:6827/23242","cluster_addr":"172.21.15.192:6829/23242","heartbeat_back_addr":"172.21.15.192:6833/23242","heartbeat_front_addr":"172.21.15.192:6831/23242","state":["exists","up"]},{"osd":1,"uuid":"564330c6-5c45-4ef6-8718-bbfa97848e6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":22856},{"type":"v1","addr":"172.21.15.146:6801","nonce":22856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":22856},{"type":"v1","addr":"172.21.15.146:6803","nonce":22856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":22856},{"type":"v1","addr":"172.21.15.146:6807","nonce":22856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":22856},{"type":"v1","addr":"172.21.15.146:6805","nonce":22856}]},"public_addr":"172.21.15.146:6801/22856","cluster_addr":"172.21.15.146:6803/22856","heartbeat_back_addr":"172.21.15.146:6807/22856","heartbeat_front_addr":"172.21.15.146:6805/22856","state":["exists","up"]},{"osd":2,"uuid":"128ddb77-579b-4fa3-a0cb-7465ad959f3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6815","nonce":23326},{"type":"v1","addr":"172.21.15.87:6817","nonce":23326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":23326},{"type":"v1","addr":"172.21.15.87:6819","nonce":23326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":23326},{"type":"v1","addr":"172.21.15.87:6823","nonce":23326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":23326},{"type":"v1","addr":"172.21.15.87:6821","nonce":23326}]},"public_addr":"172.21.15.87:6817/23326","cluster_addr":"172.21.15.87:6819/23326","heartbeat_back_addr":"172.21.15.87:6823/23326","heartbeat_front_addr":"172.21.15.87:6821/23326","state":["exists","up"]},{"osd":3,"uuid":"4668cfdf-d172-4f30-95b8-ac842108a520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":23243},{"type":"v1","addr":"172.21.15.192:6803","nonce":23243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":23243},{"type":"v1","addr":"172.21.15.192:6805","nonce":23243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":23243},{"type":"v1","addr":"172.21.15.192:6809","nonce":23243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":23243},{"type":"v1","addr":"172.21.15.192:6807","nonce":23243}]},"public_addr":"172.21.15.192:6803/23243","cluster_addr":"172.21.15.192:6805/23243","heartbeat_back_addr":"172.21.15.192:6809/23243","heartbeat_front_addr":"172.21.15.192:6807/23243","state":["exists","up"]},{"osd":4,"uuid":"c4bc8ba5-0d22-49f5-97a6-2ca71e3a8c62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":22857},{"type":"v1","addr":"172.21.15.146:6809","nonce":22857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":22857},{"type":"v1","addr":"172.21.15.146:6811","nonce":22857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":22857},{"type":"v1","addr":"172.21.15.146:6815","nonce":22857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":22857},{"type":"v1","addr":"172.21.15.146:6813","nonce":22857}]},"public_addr":"172.21.15.146:6809/22857","cluster_addr":"172.21.15.146:6811/22857","heartbeat_back_addr":"172.21.15.146:6815/22857","heartbeat_front_addr":"172.21.15.146:6813/22857","state":["exists","up"]},{"osd":5,"uuid":"2d15f1db-e580-4715-9728-8fe5dd7e34d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":23316},{"type":"v1","addr":"172.21.15.87:6801","nonce":23316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":23316},{"type":"v1","addr":"172.21.15.87:6803","nonce":23316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":23316},{"type":"v1","addr":"172.21.15.87:6807","nonce":23316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":23316},{"type":"v1","addr":"172.21.15.87:6805","nonce":23316}]},"public_addr":"172.21.15.87:6801/23316","cluster_addr":"172.21.15.87:6803/23316","heartbeat_back_addr":"172.21.15.87:6807/23316","heartbeat_front_addr":"172.21.15.87:6805/23316","state":["exists","up"]},{"osd":6,"uuid":"a659da2b-bdce-42ac-8b30-b8c69b4c7041","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":23246},{"type":"v1","addr":"172.21.15.192:6811","nonce":23246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":23246},{"type":"v1","addr":"172.21.15.192:6813","nonce":23246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":23246},{"type":"v1","addr":"172.21.15.192:6817","nonce":23246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":23246},{"type":"v1","addr":"172.21.15.192:6815","nonce":23246}]},"public_addr":"172.21.15.192:6811/23246","cluster_addr":"172.21.15.192:6813/23246","heartbeat_back_addr":"172.21.15.192:6817/23246","heartbeat_front_addr":"172.21.15.192:6815/23246","state":["exists","up"]},{"osd":7,"uuid":"d6e41ac5-bab7-49e2-a17a-ef794bcc4a09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":22858},{"type":"v1","addr":"172.21.15.146:6818","nonce":22858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":22858},{"type":"v1","addr":"172.21.15.146:6822","nonce":22858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":22858},{"type":"v1","addr":"172.21.15.146:6830","nonce":22858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":22858},{"type":"v1","addr":"172.21.15.146:6826","nonce":22858}]},"public_addr":"172.21.15.146:6818/22858","cluster_addr":"172.21.15.146:6822/22858","heartbeat_back_addr":"172.21.15.146:6830/22858","heartbeat_front_addr":"172.21.15.146:6826/22858","state":["exists","up"]},{"osd":8,"uuid":"c4907993-7513-4162-974f-07dcb0a260a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":23333},{"type":"v1","addr":"172.21.15.87:6825","nonce":23333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":23333},{"type":"v1","addr":"172.21.15.87:6827","nonce":23333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":23333},{"type":"v1","addr":"172.21.15.87:6831","nonce":23333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":23333},{"type":"v1","addr":"172.21.15.87:6829","nonce":23333}]},"public_addr":"172.21.15.87:6825/23333","cluster_addr":"172.21.15.87:6827/23333","heartbeat_back_addr":"172.21.15.87:6831/23333","heartbeat_front_addr":"172.21.15.87:6829/23333","state":["exists","up"]},{"osd":9,"uuid":"3523676f-c9b8-47ae-86c0-4930dca17831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":23254},{"type":"v1","addr":"172.21.15.192:6819","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":23254},{"type":"v1","addr":"172.21.15.192:6821","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":23254},{"type":"v1","addr":"172.21.15.192:6825","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":23254},{"type":"v1","addr":"172.21.15.192:6823","nonce":23254}]},"public_addr":"172.21.15.192:6819/23254","cluster_addr":"172.21.15.192:6821/23254","heartbeat_back_addr":"172.21.15.192:6825/23254","heartbeat_front_addr":"172.21.15.192:6823/23254","state":["exists","up"]},{"osd":10,"uuid":"88d5c251-0bb1-4624-8fa2-7f3b74bd1bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":22859},{"type":"v1","addr":"172.21.15.146:6819","nonce":22859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6821","nonce":22859},{"type":"v1","addr":"172.21.15.146:6823","nonce":22859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":22859},{"type":"v1","addr":"172.21.15.146:6831","nonce":22859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6825","nonce":22859},{"type":"v1","addr":"172.21.15.146:6827","nonce":22859}]},"public_addr":"172.21.15.146:6819/22859","cluster_addr":"172.21.15.146:6823/22859","heartbeat_back_addr":"172.21.15.146:6831/22859","heartbeat_front_addr":"172.21.15.146:6827/22859","state":["exists","up"]},{"osd":11,"uuid":"31f650d6-ba1e-4f29-92ff-6abee04c0f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":23317},{"type":"v1","addr":"172.21.15.87:6809","nonce":23317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":23317},{"type":"v1","addr":"172.21.15.87:6811","nonce":23317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":23317},{"type":"v1","addr":"172.21.15.87:6816","nonce":23317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":23317},{"type":"v1","addr":"172.21.15.87:6813","nonce":23317}]},"public_addr":"172.21.15.87:6809/23317","cluster_addr":"172.21.15.87:6811/23317","heartbeat_back_addr":"172.21.15.87:6816/23317","heartbeat_front_addr":"172.21.15.87:6813/23317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.538863+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.552293+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.585265+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.505194+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.550032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.558089+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.565622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.587102+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.654330+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.599072+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.645833+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.596236+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:48:12.448 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.445+0000 7f42c9b42700 1 -- 172.21.15.192:0/712705395 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f429c080670 msgr2=0x7f429c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:12.449 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.445+0000 7f42c9b42700 1 --2- 172.21.15.192:0/712705395 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f429c080670 0x7f429c082b30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f42b8000e10 tx=0x7f42c4154ce0).stop 2020-11-20T11:48:12.449 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.445+0000 7f42c9b42700 1 -- 172.21.15.192:0/712705395 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42c41618f0 msgr2=0x7f42c4143f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:12.449 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.445+0000 7f42c9b42700 1 --2- 172.21.15.192:0/712705395 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42c41618f0 0x7f42c4143f70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f42c40661e0 tx=0x7f42bc007f50).stop 2020-11-20T11:48:12.449 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.445+0000 7f42c9b42700 1 -- 172.21.15.192:0/712705395 shutdown_connections 2020-11-20T11:48:12.450 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.445+0000 7f42c9b42700 1 --2- 172.21.15.192:0/712705395 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f429c080670 0x7f429c082b30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:12.450 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.445+0000 7f42c9b42700 1 --2- 172.21.15.192:0/712705395 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42c41618f0 0x7f42c4143f70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:12.450 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.445+0000 7f42c9b42700 1 --2- 172.21.15.192:0/712705395 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f42a8004610 0x7f42c40c2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:12.450 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.445+0000 7f42c9b42700 1 --2- 172.21.15.192:0/712705395 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42c40c2770 0x7f42c4161400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:12.451 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.445+0000 7f42c9b42700 1 -- 172.21.15.192:0/712705395 >> 172.21.15.192:0/712705395 conn(0x7f42c40c77f0 msgr2=0x7f42c4067f30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:12.451 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.445+0000 7f42c9b42700 1 -- 172.21.15.192:0/712705395 shutdown_connections 2020-11-20T11:48:12.451 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.445+0000 7f42c9b42700 1 -- 172.21.15.192:0/712705395 wait complete. 2020-11-20T11:48:12.460 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:48:12.461 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2020-11-20T11:48:12.571 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.567+0000 7fda7df0a700 1 Processor -- start 2020-11-20T11:48:12.572 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.567+0000 7fda7df0a700 1 -- start start 2020-11-20T11:48:12.572 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.568+0000 7fda7df0a700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fda78060370 0x7fda78060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:12.572 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.568+0000 7fda7df0a700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda780665a0 con 0x7fda78066110 2020-11-20T11:48:12.572 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.568+0000 7fda7df0a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda781520a0 con 0x7fda781554b0 2020-11-20T11:48:12.572 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.568+0000 7fda7df0a700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda780635d0 con 0x7fda78060370 2020-11-20T11:48:12.576 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.569+0000 7fda76ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fda781554b0 0x7fda780bfa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.192:60856/0 (socket says 172.21.15.192:60856) 2020-11-20T11:48:12.576 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.569+0000 7fda76ffd700 1 -- 172.21.15.192:0/3440348267 learned_addr learned my addr 172.21.15.192:0/3440348267 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:12.576 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.569+0000 7fda777fe700 1 --2- 172.21.15.192:0/3440348267 >> v2:172.21.15.87:3300/0 conn(0x7fda78060370 0x7fda78060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:12.576 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.569+0000 7fda767fc700 1 -- 172.21.15.192:0/3440348267 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 925106693 0 0) 0x7fda781520a0 con 0x7fda781554b0 2020-11-20T11:48:12.577 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.569+0000 7fda767fc700 1 -- 172.21.15.192:0/3440348267 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda64003280 con 0x7fda781554b0 2020-11-20T11:48:12.577 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.569+0000 7fda777fe700 1 -- 172.21.15.192:0/3440348267 >> v1:172.21.15.146:6789/0 conn(0x7fda781554b0 legacy=0x7fda780bfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:12.577 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.569+0000 7fda777fe700 1 -- 172.21.15.192:0/3440348267 >> v1:172.21.15.87:6789/0 conn(0x7fda78066110 legacy=0x7fda78150410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:12.577 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.569+0000 7fda767fc700 1 -- 172.21.15.192:0/3440348267 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1094711736 0 0) 0x7fda70001490 con 0x7fda78066110 2020-11-20T11:48:12.578 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.569+0000 7fda777fe700 1 -- 172.21.15.192:0/3440348267 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda78065490 con 0x7fda78060370 2020-11-20T11:48:12.578 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.569+0000 7fda777fe700 1 --2- 172.21.15.192:0/3440348267 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda78060370 0x7fda78060750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fda68006fd0 tx=0x7fda68006e30).ready entity=mon.0 client_cookie=a55d40af0510f666 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:12.578 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.569+0000 7fda767fc700 1 -- 172.21.15.192:0/3440348267 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6800bec0 con 0x7fda78060370 2020-11-20T11:48:12.578 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.569+0000 7fda767fc700 1 -- 172.21.15.192:0/3440348267 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda68000e90 con 0x7fda78060370 2020-11-20T11:48:12.578 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.569+0000 7fda767fc700 1 -- 172.21.15.192:0/3440348267 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda68009a80 con 0x7fda78060370 2020-11-20T11:48:12.578 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.570+0000 7fda7df0a700 1 -- 172.21.15.192:0/3440348267 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda78060370 msgr2=0x7fda78060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:12.579 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.570+0000 7fda7df0a700 1 --2- 172.21.15.192:0/3440348267 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda78060370 0x7fda78060750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fda68006fd0 tx=0x7fda68006e30).stop 2020-11-20T11:48:12.579 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.570+0000 7fda7df0a700 1 -- 172.21.15.192:0/3440348267 shutdown_connections 2020-11-20T11:48:12.579 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.570+0000 7fda7df0a700 1 --2- 172.21.15.192:0/3440348267 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda78060370 0x7fda78060750 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:12.579 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.570+0000 7fda7df0a700 1 -- 172.21.15.192:0/3440348267 >> 172.21.15.192:0/3440348267 conn(0x7fda780c46a0 msgr2=0x7fda780c4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:12.579 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.570+0000 7fda7df0a700 1 -- 172.21.15.192:0/3440348267 shutdown_connections 2020-11-20T11:48:12.580 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.570+0000 7fda7df0a700 1 -- 172.21.15.192:0/3440348267 wait complete. 2020-11-20T11:48:12.580 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.571+0000 7fda7df0a700 1 Processor -- start 2020-11-20T11:48:12.580 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.571+0000 7fda7df0a700 1 -- start start 2020-11-20T11:48:12.580 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.572+0000 7fda7df0a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda78060370 0x7fda781646b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:12.580 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.572+0000 7fda7df0a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda78066110 0x7fda78153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:12.581 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.572+0000 7fda7df0a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda781554b0 0x7fda78161080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:12.581 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.572+0000 7fda7df0a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda78160760 con 0x7fda78066110 2020-11-20T11:48:12.581 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.572+0000 7fda7df0a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda780bd990 con 0x7fda78060370 2020-11-20T11:48:12.581 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.572+0000 7fda7df0a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda780be870 con 0x7fda781554b0 2020-11-20T11:48:12.581 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.572+0000 7fda77fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda781554b0 0x7fda78161080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:12.582 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.572+0000 7fda77fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda781554b0 0x7fda78161080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48906/0 (socket says 172.21.15.192:48906) 2020-11-20T11:48:12.582 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.572+0000 7fda77fff700 1 -- 172.21.15.192:0/3136232253 learned_addr learned my addr 172.21.15.192:0/3136232253 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:12.582 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.572+0000 7fda777fe700 1 --2- 172.21.15.192:0/3136232253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda78060370 0x7fda781646b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:12.582 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.572+0000 7fda76ffd700 1 --2- 172.21.15.192:0/3136232253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda78066110 0x7fda78153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:12.582 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.572+0000 7fda77fff700 1 -- 172.21.15.192:0/3136232253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda78060370 msgr2=0x7fda781646b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:12.583 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.572+0000 7fda77fff700 1 --2- 172.21.15.192:0/3136232253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda78060370 0x7fda781646b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:12.583 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.572+0000 7fda77fff700 1 -- 172.21.15.192:0/3136232253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda78066110 msgr2=0x7fda78153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:12.583 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.572+0000 7fda77fff700 1 --2- 172.21.15.192:0/3136232253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda78066110 0x7fda78153660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:12.583 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.572+0000 7fda77fff700 1 -- 172.21.15.192:0/3136232253 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda780bdb80 con 0x7fda781554b0 2020-11-20T11:48:12.583 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.572+0000 7fda76ffd700 1 --2- 172.21.15.192:0/3136232253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda78066110 0x7fda78153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:48:12.584 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.572+0000 7fda77fff700 1 --2- 172.21.15.192:0/3136232253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda781554b0 0x7fda78161080 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fda7000ca10 tx=0x7fda70007c10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:12.584 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.572+0000 7fda577fe700 1 -- 172.21.15.192:0/3136232253 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7000a7f0 con 0x7fda781554b0 2020-11-20T11:48:12.584 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.572+0000 7fda577fe700 1 -- 172.21.15.192:0/3136232253 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7000a990 con 0x7fda781554b0 2020-11-20T11:48:12.584 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.573+0000 7fda7df0a700 1 -- 172.21.15.192:0/3136232253 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda780bde20 con 0x7fda781554b0 2020-11-20T11:48:12.584 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.573+0000 7fda577fe700 1 -- 172.21.15.192:0/3136232253 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7000ad50 con 0x7fda781554b0 2020-11-20T11:48:12.585 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.573+0000 7fda7df0a700 1 -- 172.21.15.192:0/3136232253 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda78160940 con 0x7fda781554b0 2020-11-20T11:48:12.586 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.573+0000 7fda7df0a700 1 -- 172.21.15.192:0/3136232253 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda780699a0 con 0x7fda781554b0 2020-11-20T11:48:12.586 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.574+0000 7fda577fe700 1 -- 172.21.15.192:0/3136232253 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fda70010070 con 0x7fda781554b0 2020-11-20T11:48:12.586 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.575+0000 7fda577fe700 1 --2- 172.21.15.192:0/3136232253 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fda50080670 0x7fda50082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:12.586 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.575+0000 7fda577fe700 1 -- 172.21.15.192:0/3136232253 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fda700a26f0 con 0x7fda781554b0 2020-11-20T11:48:12.586 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.575+0000 7fda777fe700 1 --2- 172.21.15.192:0/3136232253 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fda50080670 0x7fda50082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:12.587 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.575+0000 7fda777fe700 1 --2- 172.21.15.192:0/3136232253 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fda50080670 0x7fda50082b30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fda68006ba0 tx=0x7fda68015000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:12.587 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.578+0000 7fda577fe700 1 -- 172.21.15.192:0/3136232253 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fda70077080 con 0x7fda781554b0 2020-11-20T11:48:12.721 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.718+0000 7fda7df0a700 1 -- 172.21.15.192:0/3136232253 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda780665a0 con 0x7fda781554b0 2020-11-20T11:48:12.722 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.719+0000 7fda577fe700 1 -- 172.21.15.192:0/3136232253 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21795 (secure 0 0 0) 0x7fda780665a0 con 0x7fda781554b0 2020-11-20T11:48:12.722 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:48:12.723 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":28,"fsid":"4871390d-d110-4379-8302-5810d7b54f34","created":"2020-11-20T11:47:49.059675+0000","modified":"2020-11-20T11:48:09.832333+0000","last_up_change":"2020-11-20T11:47:57.317253+0000","last_in_change":"2020-11-20T11:47:57.317253+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:47:52.327778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:48:01.912951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:48:04.793810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:48:07.506705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77a5e1d9-0fb0-450c-872e-4aee77dede49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":23242},{"type":"v1","addr":"172.21.15.192:6827","nonce":23242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":23242},{"type":"v1","addr":"172.21.15.192:6829","nonce":23242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":23242},{"type":"v1","addr":"172.21.15.192:6833","nonce":23242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":23242},{"type":"v1","addr":"172.21.15.192:6831","nonce":23242}]},"public_addr":"172.21.15.192:6827/23242","cluster_addr":"172.21.15.192:6829/23242","heartbeat_back_addr":"172.21.15.192:6833/23242","heartbeat_front_addr":"172.21.15.192:6831/23242","state":["exists","up"]},{"osd":1,"uuid":"564330c6-5c45-4ef6-8718-bbfa97848e6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":22856},{"type":"v1","addr":"172.21.15.146:6801","nonce":22856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":22856},{"type":"v1","addr":"172.21.15.146:6803","nonce":22856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":22856},{"type":"v1","addr":"172.21.15.146:6807","nonce":22856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":22856},{"type":"v1","addr":"172.21.15.146:6805","nonce":22856}]},"public_addr":"172.21.15.146:6801/22856","cluster_addr":"172.21.15.146:6803/22856","heartbeat_back_addr":"172.21.15.146:6807/22856","heartbeat_front_addr":"172.21.15.146:6805/22856","state":["exists","up"]},{"osd":2,"uuid":"128ddb77-579b-4fa3-a0cb-7465ad959f3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6815","nonce":23326},{"type":"v1","addr":"172.21.15.87:6817","nonce":23326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":23326},{"type":"v1","addr":"172.21.15.87:6819","nonce":23326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":23326},{"type":"v1","addr":"172.21.15.87:6823","nonce":23326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":23326},{"type":"v1","addr":"172.21.15.87:6821","nonce":23326}]},"public_addr":"172.21.15.87:6817/23326","cluster_addr":"172.21.15.87:6819/23326","heartbeat_back_addr":"172.21.15.87:6823/23326","heartbeat_front_addr":"172.21.15.87:6821/23326","state":["exists","up"]},{"osd":3,"uuid":"4668cfdf-d172-4f30-95b8-ac842108a520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":23243},{"type":"v1","addr":"172.21.15.192:6803","nonce":23243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":23243},{"type":"v1","addr":"172.21.15.192:6805","nonce":23243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":23243},{"type":"v1","addr":"172.21.15.192:6809","nonce":23243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":23243},{"type":"v1","addr":"172.21.15.192:6807","nonce":23243}]},"public_addr":"172.21.15.192:6803/23243","cluster_addr":"172.21.15.192:6805/23243","heartbeat_back_addr":"172.21.15.192:6809/23243","heartbeat_front_addr":"172.21.15.192:6807/23243","state":["exists","up"]},{"osd":4,"uuid":"c4bc8ba5-0d22-49f5-97a6-2ca71e3a8c62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":22857},{"type":"v1","addr":"172.21.15.146:6809","nonce":22857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":22857},{"type":"v1","addr":"172.21.15.146:6811","nonce":22857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":22857},{"type":"v1","addr":"172.21.15.146:6815","nonce":22857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":22857},{"type":"v1","addr":"172.21.15.146:6813","nonce":22857}]},"public_addr":"172.21.15.146:6809/22857","cluster_addr":"172.21.15.146:6811/22857","heartbeat_back_addr":"172.21.15.146:6815/22857","heartbeat_front_addr":"172.21.15.146:6813/22857","state":["exists","up"]},{"osd":5,"uuid":"2d15f1db-e580-4715-9728-8fe5dd7e34d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":23316},{"type":"v1","addr":"172.21.15.87:6801","nonce":23316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":23316},{"type":"v1","addr":"172.21.15.87:6803","nonce":23316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":23316},{"type":"v1","addr":"172.21.15.87:6807","nonce":23316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":23316},{"type":"v1","addr":"172.21.15.87:6805","nonce":23316}]},"public_addr":"172.21.15.87:6801/23316","cluster_addr":"172.21.15.87:6803/23316","heartbeat_back_addr":"172.21.15.87:6807/23316","heartbeat_front_addr":"172.21.15.87:6805/23316","state":["exists","up"]},{"osd":6,"uuid":"a659da2b-bdce-42ac-8b30-b8c69b4c7041","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":23246},{"type":"v1","addr":"172.21.15.192:6811","nonce":23246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":23246},{"type":"v1","addr":"172.21.15.192:6813","nonce":23246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":23246},{"type":"v1","addr":"172.21.15.192:6817","nonce":23246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":23246},{"type":"v1","addr":"172.21.15.192:6815","nonce":23246}]},"public_addr":"172.21.15.192:6811/23246","cluster_addr":"172.21.15.192:6813/23246","heartbeat_back_addr":"172.21.15.192:6817/23246","heartbeat_front_addr":"172.21.15.192:6815/23246","state":["exists","up"]},{"osd":7,"uuid":"d6e41ac5-bab7-49e2-a17a-ef794bcc4a09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":22858},{"type":"v1","addr":"172.21.15.146:6818","nonce":22858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":22858},{"type":"v1","addr":"172.21.15.146:6822","nonce":22858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":22858},{"type":"v1","addr":"172.21.15.146:6830","nonce":22858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":22858},{"type":"v1","addr":"172.21.15.146:6826","nonce":22858}]},"public_addr":"172.21.15.146:6818/22858","cluster_addr":"172.21.15.146:6822/22858","heartbeat_back_addr":"172.21.15.146:6830/22858","heartbeat_front_addr":"172.21.15.146:6826/22858","state":["exists","up"]},{"osd":8,"uuid":"c4907993-7513-4162-974f-07dcb0a260a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":23333},{"type":"v1","addr":"172.21.15.87:6825","nonce":23333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":23333},{"type":"v1","addr":"172.21.15.87:6827","nonce":23333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":23333},{"type":"v1","addr":"172.21.15.87:6831","nonce":23333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":23333},{"type":"v1","addr":"172.21.15.87:6829","nonce":23333}]},"public_addr":"172.21.15.87:6825/23333","cluster_addr":"172.21.15.87:6827/23333","heartbeat_back_addr":"172.21.15.87:6831/23333","heartbeat_front_addr":"172.21.15.87:6829/23333","state":["exists","up"]},{"osd":9,"uuid":"3523676f-c9b8-47ae-86c0-4930dca17831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":23254},{"type":"v1","addr":"172.21.15.192:6819","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":23254},{"type":"v1","addr":"172.21.15.192:6821","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":23254},{"type":"v1","addr":"172.21.15.192:6825","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":23254},{"type":"v1","addr":"172.21.15.192:6823","nonce":23254}]},"public_addr":"172.21.15.192:6819/23254","cluster_addr":"172.21.15.192:6821/23254","heartbeat_back_addr":"172.21.15.192:6825/23254","heartbeat_front_addr":"172.21.15.192:6823/23254","state":["exists","up"]},{"osd":10,"uuid":"88d5c251-0bb1-4624-8fa2-7f3b74bd1bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":22859},{"type":"v1","addr":"172.21.15.146:6819","nonce":22859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6821","nonce":22859},{"type":"v1","addr":"172.21.15.146:6823","nonce":22859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":22859},{"type":"v1","addr":"172.21.15.146:6831","nonce":22859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6825","nonce":22859},{"type":"v1","addr":"172.21.15.146:6827","nonce":22859}]},"public_addr":"172.21.15.146:6819/22859","cluster_addr":"172.21.15.146:6823/22859","heartbeat_back_addr":"172.21.15.146:6831/22859","heartbeat_front_addr":"172.21.15.146:6827/22859","state":["exists","up"]},{"osd":11,"uuid":"31f650d6-ba1e-4f29-92ff-6abee04c0f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":23317},{"type":"v1","addr":"172.21.15.87:6809","nonce":23317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":23317},{"type":"v1","addr":"172.21.15.87:6811","nonce":23317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":23317},{"type":"v1","addr":"172.21.15.87:6816","nonce":23317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":23317},{"type":"v1","addr":"172.21.15.87:6813","nonce":23317}]},"public_addr":"172.21.15.87:6809/23317","cluster_addr":"172.21.15.87:6811/23317","heartbeat_back_addr":"172.21.15.87:6816/23317","heartbeat_front_addr":"172.21.15.87:6813/23317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.538863+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.552293+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.585265+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.505194+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.550032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.558089+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.565622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.587102+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.654330+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.599072+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.645833+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.596236+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:48:12.724 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.720+0000 7fda7df0a700 1 -- 172.21.15.192:0/3136232253 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fda50080670 msgr2=0x7fda50082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:12.724 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.720+0000 7fda7df0a700 1 --2- 172.21.15.192:0/3136232253 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fda50080670 0x7fda50082b30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fda68006ba0 tx=0x7fda68015000).stop 2020-11-20T11:48:12.724 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.720+0000 7fda7df0a700 1 -- 172.21.15.192:0/3136232253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda781554b0 msgr2=0x7fda78161080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:12.724 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.720+0000 7fda7df0a700 1 --2- 172.21.15.192:0/3136232253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda781554b0 0x7fda78161080 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fda7000ca10 tx=0x7fda70007c10).stop 2020-11-20T11:48:12.725 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.720+0000 7fda7df0a700 1 -- 172.21.15.192:0/3136232253 shutdown_connections 2020-11-20T11:48:12.725 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.720+0000 7fda7df0a700 1 --2- 172.21.15.192:0/3136232253 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fda50080670 0x7fda50082b30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:12.725 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.720+0000 7fda7df0a700 1 --2- 172.21.15.192:0/3136232253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda781554b0 0x7fda78161080 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:12.725 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.720+0000 7fda7df0a700 1 --2- 172.21.15.192:0/3136232253 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda78060370 0x7fda781646b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:12.725 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.720+0000 7fda7df0a700 1 --2- 172.21.15.192:0/3136232253 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda78066110 0x7fda78153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:12.726 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.720+0000 7fda7df0a700 1 -- 172.21.15.192:0/3136232253 >> 172.21.15.192:0/3136232253 conn(0x7fda780c46a0 msgr2=0x7fda780c3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:12.726 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.720+0000 7fda7df0a700 1 -- 172.21.15.192:0/3136232253 shutdown_connections 2020-11-20T11:48:12.726 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.720+0000 7fda7df0a700 1 -- 172.21.15.192:0/3136232253 wait complete. 2020-11-20T11:48:12.735 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-20T11:47:52.327778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-20T11:48:01.912951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-11-20T11:48:04.793810+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-11-20T11:48:07.506705+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-11-20T11:48:12.736 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2020-11-20T11:48:12.847 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.844+0000 7f7c89ad0700 1 Processor -- start 2020-11-20T11:48:12.847 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.844+0000 7f7c89ad0700 1 -- start start 2020-11-20T11:48:12.848 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.845+0000 7f7c89ad0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7c84067830 0x7f7c84067c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:12.849 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.845+0000 7f7c89ad0700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c840bca20 con 0x7f7c840bacc0 2020-11-20T11:48:12.849 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.845+0000 7f7c89ad0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c840bccb0 con 0x7f7c840ba860 2020-11-20T11:48:12.849 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.845+0000 7f7c89ad0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c8414e210 con 0x7f7c84067830 2020-11-20T11:48:12.849 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.845+0000 7f7c83fff700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f7c840bacc0 0x7f7c840640e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.192:38298/0 (socket says 172.21.15.192:38298) 2020-11-20T11:48:12.850 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.845+0000 7f7c83fff700 1 -- 172.21.15.192:0/295214307 learned_addr learned my addr 172.21.15.192:0/295214307 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:12.850 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.845+0000 7f7c837fe700 1 --2- 172.21.15.192:0/295214307 >> v2:172.21.15.146:3300/0 conn(0x7f7c84067830 0x7f7c84067c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:12.850 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.845+0000 7f7c837fe700 1 -- 172.21.15.192:0/295214307 >> v1:172.21.15.146:6789/0 conn(0x7f7c840ba860 legacy=0x7f7c840bc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:12.850 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.845+0000 7f7c837fe700 1 -- 172.21.15.192:0/295214307 >> v1:172.21.15.87:6789/0 conn(0x7f7c840bacc0 legacy=0x7f7c840640e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:12.850 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.845+0000 7f7c837fe700 1 -- 172.21.15.192:0/295214307 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c8414e4b0 con 0x7f7c84067830 2020-11-20T11:48:12.851 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.845+0000 7f7c837fe700 1 --2- 172.21.15.192:0/295214307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c84067830 0x7f7c84067c10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f7c74006fd0 tx=0x7f7c74006e30).ready entity=mon.1 client_cookie=621d0872b7b8b57b server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:12.853 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.847+0000 7f7c82ffd700 1 -- 172.21.15.192:0/295214307 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c74009870 con 0x7f7c84067830 2020-11-20T11:48:12.854 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.847+0000 7f7c82ffd700 1 -- 172.21.15.192:0/295214307 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c74000e90 con 0x7f7c84067830 2020-11-20T11:48:12.854 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.847+0000 7f7c82ffd700 1 -- 172.21.15.192:0/295214307 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c74009be0 con 0x7f7c84067830 2020-11-20T11:48:12.854 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.847+0000 7f7c89ad0700 1 -- 172.21.15.192:0/295214307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c84067830 msgr2=0x7f7c84067c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:12.854 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.847+0000 7f7c89ad0700 1 --2- 172.21.15.192:0/295214307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c84067830 0x7f7c84067c10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f7c74006fd0 tx=0x7f7c74006e30).stop 2020-11-20T11:48:12.854 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.847+0000 7f7c89ad0700 1 -- 172.21.15.192:0/295214307 shutdown_connections 2020-11-20T11:48:12.856 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.847+0000 7f7c89ad0700 1 --2- 172.21.15.192:0/295214307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c84067830 0x7f7c84067c10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:12.856 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.847+0000 7f7c89ad0700 1 -- 172.21.15.192:0/295214307 >> 172.21.15.192:0/295214307 conn(0x7f7c84062100 msgr2=0x7f7c840c3590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:12.856 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.847+0000 7f7c89ad0700 1 -- 172.21.15.192:0/295214307 shutdown_connections 2020-11-20T11:48:12.857 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.847+0000 7f7c89ad0700 1 -- 172.21.15.192:0/295214307 wait complete. 2020-11-20T11:48:12.857 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.848+0000 7f7c89ad0700 1 Processor -- start 2020-11-20T11:48:12.857 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.849+0000 7f7c89ad0700 1 -- start start 2020-11-20T11:48:12.857 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.849+0000 7f7c89ad0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c84067830 0x7f7c8414af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:12.858 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.849+0000 7f7c89ad0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c840ba860 0x7f7c8414b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:12.858 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.849+0000 7f7c89ad0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c840bacc0 0x7f7c841449f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:12.858 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.849+0000 7f7c89ad0700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8415d970 con 0x7f7c840ba860 2020-11-20T11:48:12.858 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.849+0000 7f7c89ad0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8415dc10 con 0x7f7c84067830 2020-11-20T11:48:12.858 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.849+0000 7f7c89ad0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8415deb0 con 0x7f7c840bacc0 2020-11-20T11:48:12.859 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.849+0000 7f7c83fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c840bacc0 0x7f7c841449f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:12.859 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.849+0000 7f7c83fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c840bacc0 0x7f7c841449f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48920/0 (socket says 172.21.15.192:48920) 2020-11-20T11:48:12.859 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.849+0000 7f7c83fff700 1 -- 172.21.15.192:0/981970477 learned_addr learned my addr 172.21.15.192:0/981970477 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:12.860 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.849+0000 7f7c7bfff700 1 --2- 172.21.15.192:0/981970477 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c840ba860 0x7f7c8414b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:12.860 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.849+0000 7f7c837fe700 1 --2- 172.21.15.192:0/981970477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c84067830 0x7f7c8414af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:12.860 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.850+0000 7f7c83fff700 1 -- 172.21.15.192:0/981970477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c84067830 msgr2=0x7f7c8414af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:12.860 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.850+0000 7f7c83fff700 1 --2- 172.21.15.192:0/981970477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c84067830 0x7f7c8414af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:12.861 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.850+0000 7f7c83fff700 1 -- 172.21.15.192:0/981970477 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c840ba860 msgr2=0x7f7c8414b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:12.861 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.850+0000 7f7c83fff700 1 --2- 172.21.15.192:0/981970477 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c840ba860 0x7f7c8414b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:12.861 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.850+0000 7f7c83fff700 1 -- 172.21.15.192:0/981970477 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c8415e150 con 0x7f7c840bacc0 2020-11-20T11:48:12.861 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.850+0000 7f7c83fff700 1 --2- 172.21.15.192:0/981970477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c840bacc0 0x7f7c841449f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f7c7c00ca10 tx=0x7f7c7c0013a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:12.861 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.850+0000 7f7c7b7fe700 1 -- 172.21.15.192:0/981970477 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c005bc0 con 0x7f7c840bacc0 2020-11-20T11:48:12.862 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.850+0000 7f7c7b7fe700 1 -- 172.21.15.192:0/981970477 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7c005d20 con 0x7f7c840bacc0 2020-11-20T11:48:12.862 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.850+0000 7f7c89ad0700 1 -- 172.21.15.192:0/981970477 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c8415e3f0 con 0x7f7c840bacc0 2020-11-20T11:48:12.862 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.850+0000 7f7c7b7fe700 1 -- 172.21.15.192:0/981970477 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c007320 con 0x7f7c840bacc0 2020-11-20T11:48:12.862 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.850+0000 7f7c89ad0700 1 -- 172.21.15.192:0/981970477 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c8415d5e0 con 0x7f7c840bacc0 2020-11-20T11:48:12.863 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.851+0000 7f7c89ad0700 1 -- 172.21.15.192:0/981970477 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c840699a0 con 0x7f7c840bacc0 2020-11-20T11:48:12.863 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.851+0000 7f7c7b7fe700 1 -- 172.21.15.192:0/981970477 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f7c7c01d070 con 0x7f7c840bacc0 2020-11-20T11:48:12.864 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.852+0000 7f7c7b7fe700 1 --2- 172.21.15.192:0/981970477 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f7c60080670 0x7f7c60082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:12.864 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.852+0000 7f7c7b7fe700 1 -- 172.21.15.192:0/981970477 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f7c7c0a1ed0 con 0x7f7c840bacc0 2020-11-20T11:48:12.864 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.852+0000 7f7c837fe700 1 --2- 172.21.15.192:0/981970477 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f7c60080670 0x7f7c60082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:12.864 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.852+0000 7f7c837fe700 1 --2- 172.21.15.192:0/981970477 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f7c60080670 0x7f7c60082b30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f7c74006e70 tx=0x7f7c74015000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:12.865 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.855+0000 7f7c7b7fe700 1 -- 172.21.15.192:0/981970477 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f7c7c0768e0 con 0x7f7c840bacc0 2020-11-20T11:48:12.997 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.993+0000 7f7c89ad0700 1 -- 172.21.15.192:0/981970477 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f7c840bf8d0 con 0x7f7c840bacc0 2020-11-20T11:48:12.997 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.994+0000 7f7c7b7fe700 1 -- 172.21.15.192:0/981970477 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v28) v1 ==== 110+0+10 (secure 0 0 0) 0x7f7c7c079f00 con 0x7f7c840bacc0 2020-11-20T11:48:12.998 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2020-11-20T11:48:12.999 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.995+0000 7f7c89ad0700 1 -- 172.21.15.192:0/981970477 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f7c60080670 msgr2=0x7f7c60082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:12.999 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.995+0000 7f7c89ad0700 1 --2- 172.21.15.192:0/981970477 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f7c60080670 0x7f7c60082b30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f7c74006e70 tx=0x7f7c74015000).stop 2020-11-20T11:48:12.999 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.995+0000 7f7c89ad0700 1 -- 172.21.15.192:0/981970477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c840bacc0 msgr2=0x7f7c841449f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:12.999 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.995+0000 7f7c89ad0700 1 --2- 172.21.15.192:0/981970477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c840bacc0 0x7f7c841449f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f7c7c00ca10 tx=0x7f7c7c0013a0).stop 2020-11-20T11:48:12.999 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.995+0000 7f7c89ad0700 1 -- 172.21.15.192:0/981970477 shutdown_connections 2020-11-20T11:48:13.000 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.995+0000 7f7c89ad0700 1 --2- 172.21.15.192:0/981970477 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f7c60080670 0x7f7c60082b30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:13.000 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.995+0000 7f7c89ad0700 1 --2- 172.21.15.192:0/981970477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c840bacc0 0x7f7c841449f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:13.000 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.995+0000 7f7c89ad0700 1 --2- 172.21.15.192:0/981970477 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c84067830 0x7f7c8414af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:13.000 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.995+0000 7f7c89ad0700 1 --2- 172.21.15.192:0/981970477 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7c840ba860 0x7f7c8414b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:13.000 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.995+0000 7f7c89ad0700 1 -- 172.21.15.192:0/981970477 >> 172.21.15.192:0/981970477 conn(0x7f7c84062100 msgr2=0x7f7c84145d70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:13.001 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.996+0000 7f7c89ad0700 1 -- 172.21.15.192:0/981970477 shutdown_connections 2020-11-20T11:48:13.001 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:12.996+0000 7f7c89ad0700 1 -- 172.21.15.192:0/981970477 wait complete. 2020-11-20T11:48:13.010 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-11-20T11:48:13.122 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.119+0000 7f57ee740700 1 Processor -- start 2020-11-20T11:48:13.123 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.119+0000 7f57ee740700 1 -- start start 2020-11-20T11:48:13.125 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.120+0000 7f57ee740700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f57e8060750 0x7f57e8064c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:13.125 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.120+0000 7f57ee740700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57e8065130 con 0x7f57e8154920 2020-11-20T11:48:13.125 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.120+0000 7f57ee740700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57e8151e80 con 0x7f57e8060370 2020-11-20T11:48:13.126 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.120+0000 7f57ee740700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57e8152120 con 0x7f57e8060750 2020-11-20T11:48:13.126 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.120+0000 7f57eccdd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f57e8060750 0x7f57e8064c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:13.126 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.120+0000 7f57e7fff700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f57e8060370 0x7f57e80c2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51592/0 (socket says 172.21.15.192:51592) 2020-11-20T11:48:13.126 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.120+0000 7f57eccdd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f57e8060750 0x7f57e8064c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48928/0 (socket says 172.21.15.192:48928) 2020-11-20T11:48:13.126 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.120+0000 7f57e7fff700 1 -- 172.21.15.192:0/522438710 learned_addr learned my addr 172.21.15.192:0/522438710 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:13.127 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.120+0000 7f57eccdd700 1 -- 172.21.15.192:0/522438710 >> v1:172.21.15.192:6789/0 conn(0x7f57e8060370 legacy=0x7f57e80c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:13.127 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.120+0000 7f57eccdd700 1 -- 172.21.15.192:0/522438710 >> v1:172.21.15.146:6789/0 conn(0x7f57e8154920 legacy=0x7f57e8151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:13.127 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.121+0000 7f57eccdd700 1 -- 172.21.15.192:0/522438710 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e8064260 con 0x7f57e8060750 2020-11-20T11:48:13.127 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.120+0000 7f57e6ffd700 1 -- 172.21.15.192:0/522438710 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4104491245 0 0) 0x7f57e8151e80 con 0x7f57e8060370 2020-11-20T11:48:13.127 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.121+0000 7f57eccdd700 1 --2- 172.21.15.192:0/522438710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57e8060750 0x7f57e8064c40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f57e0009ce0 tx=0x7f57e0009220).ready entity=mon.2 client_cookie=335af165e1d1b176 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:13.128 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.121+0000 7f57e6ffd700 1 -- 172.21.15.192:0/522438710 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e000bc40 con 0x7f57e8060750 2020-11-20T11:48:13.128 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.121+0000 7f57e6ffd700 1 -- 172.21.15.192:0/522438710 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e000bda0 con 0x7f57e8060750 2020-11-20T11:48:13.128 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.121+0000 7f57e6ffd700 1 -- 172.21.15.192:0/522438710 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e0011610 con 0x7f57e8060750 2020-11-20T11:48:13.128 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.121+0000 7f57ee740700 1 -- 172.21.15.192:0/522438710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57e8060750 msgr2=0x7f57e8064c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:13.128 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.121+0000 7f57ee740700 1 --2- 172.21.15.192:0/522438710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57e8060750 0x7f57e8064c40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f57e0009ce0 tx=0x7f57e0009220).stop 2020-11-20T11:48:13.129 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.121+0000 7f57ee740700 1 -- 172.21.15.192:0/522438710 shutdown_connections 2020-11-20T11:48:13.129 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.121+0000 7f57ee740700 1 --2- 172.21.15.192:0/522438710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57e8060750 0x7f57e8064c40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:13.129 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.121+0000 7f57ee740700 1 -- 172.21.15.192:0/522438710 >> 172.21.15.192:0/522438710 conn(0x7f57e8062100 msgr2=0x7f57e80c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:13.129 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.122+0000 7f57ee740700 1 -- 172.21.15.192:0/522438710 shutdown_connections 2020-11-20T11:48:13.129 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.122+0000 7f57ee740700 1 -- 172.21.15.192:0/522438710 wait complete. 2020-11-20T11:48:13.132 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.123+0000 7f57ee740700 1 Processor -- start 2020-11-20T11:48:13.132 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.123+0000 7f57ee740700 1 -- start start 2020-11-20T11:48:13.132 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.124+0000 7f57ee740700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57e8060370 0x7f57e8158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:13.132 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.124+0000 7f57ee740700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57e8060750 0x7f57e814da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:13.133 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.124+0000 7f57ee740700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57e8154920 0x7f57e814b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:13.133 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.124+0000 7f57ee740700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e8160330 con 0x7f57e8060370 2020-11-20T11:48:13.133 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.124+0000 7f57ee740700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e8160510 con 0x7f57e8154920 2020-11-20T11:48:13.133 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.124+0000 7f57ee740700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e81607b0 con 0x7f57e8060750 2020-11-20T11:48:13.134 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.124+0000 7f57e77fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57e8060750 0x7f57e814da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:13.134 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.124+0000 7f57e77fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57e8060750 0x7f57e814da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48932/0 (socket says 172.21.15.192:48932) 2020-11-20T11:48:13.134 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.124+0000 7f57e77fe700 1 -- 172.21.15.192:0/2187600625 learned_addr learned my addr 172.21.15.192:0/2187600625 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:13.134 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.124+0000 7f57e7fff700 1 --2- 172.21.15.192:0/2187600625 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57e8060370 0x7f57e8158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:13.134 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.124+0000 7f57e77fe700 1 -- 172.21.15.192:0/2187600625 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57e8154920 msgr2=0x7f57e814b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:13.135 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.124+0000 7f57eccdd700 1 --2- 172.21.15.192:0/2187600625 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57e8154920 0x7f57e814b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:13.135 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.124+0000 7f57e77fe700 1 --2- 172.21.15.192:0/2187600625 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57e8154920 0x7f57e814b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:13.135 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.124+0000 7f57e77fe700 1 -- 172.21.15.192:0/2187600625 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57e8060370 msgr2=0x7f57e8158220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:13.135 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.124+0000 7f57e77fe700 1 --2- 172.21.15.192:0/2187600625 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57e8060370 0x7f57e8158220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:13.135 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.124+0000 7f57e77fe700 1 -- 172.21.15.192:0/2187600625 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e8160a50 con 0x7f57e8060750 2020-11-20T11:48:13.135 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.124+0000 7f57e77fe700 1 --2- 172.21.15.192:0/2187600625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57e8060750 0x7f57e814da30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f57dc00c730 tx=0x7f57dc007c70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:13.136 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.124+0000 7f57c7fff700 1 -- 172.21.15.192:0/2187600625 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57dc00e4a0 con 0x7f57e8060750 2020-11-20T11:48:13.136 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.124+0000 7f57c7fff700 1 -- 172.21.15.192:0/2187600625 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57dc00e620 con 0x7f57e8060750 2020-11-20T11:48:13.136 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.124+0000 7f57ee740700 1 -- 172.21.15.192:0/2187600625 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57e8160cf0 con 0x7f57e8060750 2020-11-20T11:48:13.136 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.124+0000 7f57c7fff700 1 -- 172.21.15.192:0/2187600625 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57dc00e9e0 con 0x7f57e8060750 2020-11-20T11:48:13.137 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.124+0000 7f57ee740700 1 -- 172.21.15.192:0/2187600625 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57e80c5ea0 con 0x7f57e8060750 2020-11-20T11:48:13.137 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.125+0000 7f57ee740700 1 -- 172.21.15.192:0/2187600625 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57e80699a0 con 0x7f57e8060750 2020-11-20T11:48:13.137 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.126+0000 7f57c7fff700 1 -- 172.21.15.192:0/2187600625 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f57dc019030 con 0x7f57e8060750 2020-11-20T11:48:13.137 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.126+0000 7f57c7fff700 1 --2- 172.21.15.192:0/2187600625 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f57c0080670 0x7f57c0082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:13.137 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.126+0000 7f57c7fff700 1 -- 172.21.15.192:0/2187600625 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f57dc0a1e30 con 0x7f57e8060750 2020-11-20T11:48:13.138 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.126+0000 7f57e7fff700 1 --2- 172.21.15.192:0/2187600625 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f57c0080670 0x7f57c0082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:13.138 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.127+0000 7f57e7fff700 1 --2- 172.21.15.192:0/2187600625 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f57c0080670 0x7f57c0082b30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f57d80067c0 tx=0x7f57d8007c60).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:13.138 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.130+0000 7f57c7fff700 1 -- 172.21.15.192:0/2187600625 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f57dc076840 con 0x7f57e8060750 2020-11-20T11:48:13.274 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.271+0000 7f57ee740700 1 -- 172.21.15.192:0/2187600625 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f57e805ca80 con 0x7f57e8060750 2020-11-20T11:48:13.274 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.271+0000 7f57c7fff700 1 -- 172.21.15.192:0/2187600625 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f57dc007d90 con 0x7f57e8060750 2020-11-20T11:48:13.275 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 8 2020-11-20T11:48:13.276 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.273+0000 7f57ee740700 1 -- 172.21.15.192:0/2187600625 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f57c0080670 msgr2=0x7f57c0082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:13.276 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.273+0000 7f57ee740700 1 --2- 172.21.15.192:0/2187600625 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f57c0080670 0x7f57c0082b30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f57d80067c0 tx=0x7f57d8007c60).stop 2020-11-20T11:48:13.276 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.273+0000 7f57ee740700 1 -- 172.21.15.192:0/2187600625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57e8060750 msgr2=0x7f57e814da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:13.276 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.273+0000 7f57ee740700 1 --2- 172.21.15.192:0/2187600625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57e8060750 0x7f57e814da30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f57dc00c730 tx=0x7f57dc007c70).stop 2020-11-20T11:48:13.277 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.273+0000 7f57ee740700 1 -- 172.21.15.192:0/2187600625 shutdown_connections 2020-11-20T11:48:13.277 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.273+0000 7f57ee740700 1 --2- 172.21.15.192:0/2187600625 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f57c0080670 0x7f57c0082b30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:13.277 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.273+0000 7f57ee740700 1 --2- 172.21.15.192:0/2187600625 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57e8154920 0x7f57e814b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:13.277 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.273+0000 7f57ee740700 1 --2- 172.21.15.192:0/2187600625 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f57e8060370 0x7f57e8158220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:13.277 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.273+0000 7f57ee740700 1 --2- 172.21.15.192:0/2187600625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57e8060750 0x7f57e814da30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:13.278 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.273+0000 7f57ee740700 1 -- 172.21.15.192:0/2187600625 >> 172.21.15.192:0/2187600625 conn(0x7f57e8062100 msgr2=0x7f57e8154d90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:13.278 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.273+0000 7f57ee740700 1 -- 172.21.15.192:0/2187600625 shutdown_connections 2020-11-20T11:48:13.278 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.273+0000 7f57ee740700 1 -- 172.21.15.192:0/2187600625 wait complete. 2020-11-20T11:48:13.287 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-11-20T11:48:13.398 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.395+0000 7f16e3f8f700 1 Processor -- start 2020-11-20T11:48:13.399 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.395+0000 7f16e3f8f700 1 -- start start 2020-11-20T11:48:13.400 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.396+0000 7f16e3f8f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f16dc062be0 0x7f16dc0640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:13.400 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.396+0000 7f16e3f8f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16dc0be960 con 0x7f16dc062800 2020-11-20T11:48:13.400 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.396+0000 7f16e3f8f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16dc0bec00 con 0x7f16dc14dfb0 2020-11-20T11:48:13.400 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.396+0000 7f16e3f8f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16dc0beea0 con 0x7f16dc062be0 2020-11-20T11:48:13.401 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.396+0000 7f16e152a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f16dc062be0 0x7f16dc0640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:13.401 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.396+0000 7f16e252c700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f16dc14dfb0 0x7f16dc14e440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51608/0 (socket says 172.21.15.192:51608) 2020-11-20T11:48:13.401 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.396+0000 7f16e252c700 1 -- 172.21.15.192:0/1916462707 learned_addr learned my addr 172.21.15.192:0/1916462707 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:13.401 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.397+0000 7f16e152a700 1 -- 172.21.15.192:0/1916462707 >> v1:172.21.15.192:6789/0 conn(0x7f16dc14dfb0 legacy=0x7f16dc14e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:13.402 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.397+0000 7f16e152a700 1 -- 172.21.15.192:0/1916462707 >> v1:172.21.15.146:6789/0 conn(0x7f16dc062800 legacy=0x7f16dc0639e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:13.402 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.397+0000 7f16e152a700 1 -- 172.21.15.192:0/1916462707 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16dc0bf140 con 0x7f16dc062be0 2020-11-20T11:48:13.402 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.397+0000 7f16e152a700 1 --2- 172.21.15.192:0/1916462707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16dc062be0 0x7f16dc0640f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f16cc006fd0 tx=0x7f16cc006e30).ready entity=mon.2 client_cookie=22e65c82f7ee6df7 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:13.402 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.397+0000 7f16e0d29700 1 -- 172.21.15.192:0/1916462707 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc0097a0 con 0x7f16dc062be0 2020-11-20T11:48:13.402 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.397+0000 7f16e0d29700 1 -- 172.21.15.192:0/1916462707 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16cc000e90 con 0x7f16dc062be0 2020-11-20T11:48:13.402 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.397+0000 7f16e0d29700 1 -- 172.21.15.192:0/1916462707 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc009b10 con 0x7f16dc062be0 2020-11-20T11:48:13.404 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.397+0000 7f16e3f8f700 1 -- 172.21.15.192:0/1916462707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16dc062be0 msgr2=0x7f16dc0640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:13.405 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.397+0000 7f16e3f8f700 1 --2- 172.21.15.192:0/1916462707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16dc062be0 0x7f16dc0640f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f16cc006fd0 tx=0x7f16cc006e30).stop 2020-11-20T11:48:13.405 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.397+0000 7f16e3f8f700 1 -- 172.21.15.192:0/1916462707 shutdown_connections 2020-11-20T11:48:13.405 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.397+0000 7f16e3f8f700 1 --2- 172.21.15.192:0/1916462707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16dc062be0 0x7f16dc0640f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:13.405 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.397+0000 7f16e3f8f700 1 -- 172.21.15.192:0/1916462707 >> 172.21.15.192:0/1916462707 conn(0x7f16dc0c4910 msgr2=0x7f16dc0c08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:13.406 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.397+0000 7f16e3f8f700 1 -- 172.21.15.192:0/1916462707 shutdown_connections 2020-11-20T11:48:13.406 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.397+0000 7f16e3f8f700 1 -- 172.21.15.192:0/1916462707 wait complete. 2020-11-20T11:48:13.406 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.398+0000 7f16e3f8f700 1 Processor -- start 2020-11-20T11:48:13.406 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.398+0000 7f16e3f8f700 1 -- start start 2020-11-20T11:48:13.406 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.399+0000 7f16e3f8f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16dc062800 0x7f16dc112ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:13.407 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.399+0000 7f16e3f8f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16dc062be0 0x7f16dc1644b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:13.407 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.399+0000 7f16e3f8f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16dc14dfb0 0x7f16dc14d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:13.407 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.399+0000 7f16e3f8f700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc1649a0 con 0x7f16dc062be0 2020-11-20T11:48:13.407 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.399+0000 7f16e3f8f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc0bd970 con 0x7f16dc14dfb0 2020-11-20T11:48:13.407 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.399+0000 7f16e3f8f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc113450 con 0x7f16dc062800 2020-11-20T11:48:13.408 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.399+0000 7f16e1d2b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16dc062800 0x7f16dc112ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:13.408 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.399+0000 7f16e1d2b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16dc062800 0x7f16dc112ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48944/0 (socket says 172.21.15.192:48944) 2020-11-20T11:48:13.408 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.399+0000 7f16e1d2b700 1 -- 172.21.15.192:0/3524981320 learned_addr learned my addr 172.21.15.192:0/3524981320 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:13.409 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.399+0000 7f16e1d2b700 1 -- 172.21.15.192:0/3524981320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16dc14dfb0 msgr2=0x7f16dc14d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:13.409 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.399+0000 7f16e1d2b700 1 --2- 172.21.15.192:0/3524981320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16dc14dfb0 0x7f16dc14d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:48:13.409 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.399+0000 7f16e1d2b700 1 -- 172.21.15.192:0/3524981320 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16dc062be0 msgr2=0x7f16dc1644b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:13.409 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.400+0000 7f16e1d2b700 1 --2- 172.21.15.192:0/3524981320 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16dc062be0 0x7f16dc1644b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:48:13.410 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.400+0000 7f16e1d2b700 1 -- 172.21.15.192:0/3524981320 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16dc1136f0 con 0x7f16dc062800 2020-11-20T11:48:13.410 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.400+0000 7f16e1d2b700 1 --2- 172.21.15.192:0/3524981320 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16dc062800 0x7f16dc112ea0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f16d8009690 tx=0x7f16d8006db0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:13.410 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.400+0000 7f16c9ffb700 1 -- 172.21.15.192:0/3524981320 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d80113f0 con 0x7f16dc062800 2020-11-20T11:48:13.410 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.400+0000 7f16c9ffb700 1 -- 172.21.15.192:0/3524981320 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d8011550 con 0x7f16dc062800 2020-11-20T11:48:13.410 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.400+0000 7f16c9ffb700 1 -- 172.21.15.192:0/3524981320 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d8011910 con 0x7f16dc062800 2020-11-20T11:48:13.411 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.400+0000 7f16e3f8f700 1 -- 172.21.15.192:0/3524981320 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16dc160660 con 0x7f16dc062800 2020-11-20T11:48:13.411 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.400+0000 7f16e3f8f700 1 -- 172.21.15.192:0/3524981320 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16dc160ba0 con 0x7f16dc062800 2020-11-20T11:48:13.411 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.401+0000 7f16e3f8f700 1 -- 172.21.15.192:0/3524981320 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16dc05ca80 con 0x7f16dc062800 2020-11-20T11:48:13.411 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.401+0000 7f16c9ffb700 1 -- 172.21.15.192:0/3524981320 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f16d8011d00 con 0x7f16dc062800 2020-11-20T11:48:13.412 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.402+0000 7f16c9ffb700 1 --2- 172.21.15.192:0/3524981320 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f16b8080670 0x7f16b8082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:13.412 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.402+0000 7f16c9ffb700 1 -- 172.21.15.192:0/3524981320 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f16d80a1fb0 con 0x7f16dc062800 2020-11-20T11:48:13.412 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.402+0000 7f16e152a700 1 --2- 172.21.15.192:0/3524981320 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f16b8080670 0x7f16b8082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:13.413 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.402+0000 7f16e152a700 1 --2- 172.21.15.192:0/3524981320 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f16b8080670 0x7f16b8082b30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f16dc1557c0 tx=0x7f16cc015000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:13.413 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.406+0000 7f16c9ffb700 1 -- 172.21.15.192:0/3524981320 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f16d80769c0 con 0x7f16dc062800 2020-11-20T11:48:13.548 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.544+0000 7f16e3f8f700 1 -- 172.21.15.192:0/3524981320 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f16dc069580 con 0x7f16dc062800 2020-11-20T11:48:13.548 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.545+0000 7f16c9ffb700 1 -- 172.21.15.192:0/3524981320 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+10 (secure 0 0 0) 0x7f16d8079fe0 con 0x7f16dc062800 2020-11-20T11:48:13.548 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 8 2020-11-20T11:48:13.550 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.546+0000 7f16e3f8f700 1 -- 172.21.15.192:0/3524981320 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f16b8080670 msgr2=0x7f16b8082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:13.550 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.546+0000 7f16e3f8f700 1 --2- 172.21.15.192:0/3524981320 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f16b8080670 0x7f16b8082b30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f16dc1557c0 tx=0x7f16cc015000).stop 2020-11-20T11:48:13.550 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.546+0000 7f16e3f8f700 1 -- 172.21.15.192:0/3524981320 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16dc062800 msgr2=0x7f16dc112ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:13.550 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.546+0000 7f16e3f8f700 1 --2- 172.21.15.192:0/3524981320 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16dc062800 0x7f16dc112ea0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f16d8009690 tx=0x7f16d8006db0).stop 2020-11-20T11:48:13.551 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.546+0000 7f16e3f8f700 1 -- 172.21.15.192:0/3524981320 shutdown_connections 2020-11-20T11:48:13.551 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.546+0000 7f16e3f8f700 1 --2- 172.21.15.192:0/3524981320 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f16b8080670 0x7f16b8082b30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:13.551 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.546+0000 7f16e3f8f700 1 --2- 172.21.15.192:0/3524981320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16dc14dfb0 0x7f16dc14d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:48:13.551 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.546+0000 7f16e3f8f700 1 --2- 172.21.15.192:0/3524981320 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16dc062800 0x7f16dc112ea0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:13.551 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.546+0000 7f16e3f8f700 1 --2- 172.21.15.192:0/3524981320 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f16dc062be0 0x7f16dc1644b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:48:13.552 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.546+0000 7f16e3f8f700 1 -- 172.21.15.192:0/3524981320 >> 172.21.15.192:0/3524981320 conn(0x7f16dc0c4910 msgr2=0x7f16dc0c3510 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:13.552 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.546+0000 7f16e3f8f700 1 -- 172.21.15.192:0/3524981320 shutdown_connections 2020-11-20T11:48:13.552 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.546+0000 7f16e3f8f700 1 -- 172.21.15.192:0/3524981320 wait complete. 2020-11-20T11:48:13.561 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-11-20T11:48:13.672 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.669+0000 7f8db3068700 1 Processor -- start 2020-11-20T11:48:13.672 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.669+0000 7f8db3068700 1 -- start start 2020-11-20T11:48:13.676 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.670+0000 7f8db3068700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dac151e80 con 0x7f8dac060750 2020-11-20T11:48:13.676 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.670+0000 7f8db3068700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dac152120 con 0x7f8dac154920 2020-11-20T11:48:13.676 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.670+0000 7f8db3068700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dac064260 con 0x7f8dac060370 2020-11-20T11:48:13.676 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.670+0000 7f8db0e04700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f8dac060370 0x7f8dac0c2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51620/0 (socket says 172.21.15.192:51620) 2020-11-20T11:48:13.677 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.670+0000 7f8db0e04700 1 -- 172.21.15.192:0/883798577 learned_addr learned my addr 172.21.15.192:0/883798577 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:13.677 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.670+0000 7f8dab7fe700 1 -- 172.21.15.192:0/883798577 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3278569009 0 0) 0x7f8dac064260 con 0x7f8dac060370 2020-11-20T11:48:13.677 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.670+0000 7f8dab7fe700 1 -- 172.21.15.192:0/883798577 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d90003280 con 0x7f8dac060370 2020-11-20T11:48:13.677 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.670+0000 7f8dab7fe700 1 -- 172.21.15.192:0/883798577 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3962603141 0 0) 0x7f8dac151e80 con 0x7f8dac060750 2020-11-20T11:48:13.677 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.670+0000 7f8dab7fe700 1 -- 172.21.15.192:0/883798577 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dac064260 con 0x7f8dac060750 2020-11-20T11:48:13.678 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.670+0000 7f8dab7fe700 1 -- 172.21.15.192:0/883798577 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 307758768 0 0) 0x7f8dac152120 con 0x7f8dac154920 2020-11-20T11:48:13.678 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.670+0000 7f8dab7fe700 1 -- 172.21.15.192:0/883798577 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dac151e80 con 0x7f8dac154920 2020-11-20T11:48:13.678 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.670+0000 7f8dab7fe700 1 -- 172.21.15.192:0/883798577 <== mon.2 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1383343801 0 0) 0x7f8d90003280 con 0x7f8dac060370 2020-11-20T11:48:13.678 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.670+0000 7f8dab7fe700 1 -- 172.21.15.192:0/883798577 >> v1:172.21.15.146:6789/0 conn(0x7f8dac154920 legacy=0x7f8dac151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:13.679 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.670+0000 7f8dab7fe700 1 -- 172.21.15.192:0/883798577 >> v1:172.21.15.87:6789/0 conn(0x7f8dac060750 legacy=0x7f8dac15bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:13.679 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.670+0000 7f8dab7fe700 1 -- 172.21.15.192:0/883798577 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dac064500 con 0x7f8dac060370 2020-11-20T11:48:13.679 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.670+0000 7f8dab7fe700 1 -- 172.21.15.192:0/883798577 <== mon.2 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3985397220 0 0) 0x7f8da0001520 con 0x7f8dac060370 2020-11-20T11:48:13.679 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.670+0000 7f8dab7fe700 1 -- 172.21.15.192:0/883798577 >> v1:172.21.15.192:6789/0 conn(0x7f8dac060370 legacy=0x7f8dac0c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:13.679 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.670+0000 7f8dab7fe700 1 --2- 172.21.15.192:0/883798577 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d90003ae0 0x7f8d90003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:13.679 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.670+0000 7f8dab7fe700 1 --2- 172.21.15.192:0/883798577 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d90004520 0x7f8d900049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:13.680 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.670+0000 7f8dab7fe700 1 --2- 172.21.15.192:0/883798577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d90004ff0 0x7f8d9000b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:13.680 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.670+0000 7f8dab7fe700 1 -- 172.21.15.192:0/883798577 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9000bd00 con 0x7f8d90004ff0 2020-11-20T11:48:13.680 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.670+0000 7f8dab7fe700 1 -- 172.21.15.192:0/883798577 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9000be70 con 0x7f8d90004520 2020-11-20T11:48:13.680 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.670+0000 7f8dab7fe700 1 -- 172.21.15.192:0/883798577 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9000c030 con 0x7f8d90003ae0 2020-11-20T11:48:13.680 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.671+0000 7f8db0e04700 1 --2- 172.21.15.192:0/883798577 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d90003ae0 0x7f8d90003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:13.681 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.671+0000 7f8dabfff700 1 --2- 172.21.15.192:0/883798577 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d90004520 0x7f8d900049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:13.681 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.671+0000 7f8db1605700 1 --2- 172.21.15.192:0/883798577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d90004ff0 0x7f8d9000b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:13.681 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.671+0000 7f8db0e04700 1 -- 172.21.15.192:0/883798577 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d90004520 msgr2=0x7f8d900049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:13.681 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.671+0000 7f8db0e04700 1 --2- 172.21.15.192:0/883798577 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d90004520 0x7f8d900049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:13.681 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.671+0000 7f8db0e04700 1 -- 172.21.15.192:0/883798577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d90004ff0 msgr2=0x7f8d9000b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:13.682 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.671+0000 7f8db0e04700 1 --2- 172.21.15.192:0/883798577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d90004ff0 0x7f8d9000b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:13.682 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.671+0000 7f8db0e04700 1 -- 172.21.15.192:0/883798577 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d90003280 con 0x7f8d90003ae0 2020-11-20T11:48:13.682 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.671+0000 7f8db1605700 1 --2- 172.21.15.192:0/883798577 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8d90004ff0 0x7f8d9000b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:48:13.682 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.671+0000 7f8db1605700 1 -- 172.21.15.192:0/883798577 reap_dead start 2020-11-20T11:48:13.682 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.671+0000 7f8db0e04700 1 --2- 172.21.15.192:0/883798577 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d90003ae0 0x7f8d90003ec0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f8da000c420 tx=0x7f8dac0643f0).ready entity=mon.2 client_cookie=eacba2a09318e6df server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:13.683 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.671+0000 7f8dab7fe700 1 -- 172.21.15.192:0/883798577 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da00070d0 con 0x7f8d90003ae0 2020-11-20T11:48:13.683 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.671+0000 7f8dab7fe700 1 -- 172.21.15.192:0/883798577 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da0007230 con 0x7f8d90003ae0 2020-11-20T11:48:13.683 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.671+0000 7f8dab7fe700 1 -- 172.21.15.192:0/883798577 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da0005630 con 0x7f8d90003ae0 2020-11-20T11:48:13.683 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.671+0000 7f8db3068700 1 -- 172.21.15.192:0/883798577 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d90003ae0 msgr2=0x7f8d90003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:13.683 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.671+0000 7f8db3068700 1 --2- 172.21.15.192:0/883798577 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d90003ae0 0x7f8d90003ec0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f8da000c420 tx=0x7f8dac0643f0).stop 2020-11-20T11:48:13.684 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.672+0000 7f8db3068700 1 -- 172.21.15.192:0/883798577 shutdown_connections 2020-11-20T11:48:13.684 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.672+0000 7f8db3068700 1 --2- 172.21.15.192:0/883798577 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d90003ae0 0x7f8d90003ec0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:13.684 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.672+0000 7f8db3068700 1 -- 172.21.15.192:0/883798577 >> 172.21.15.192:0/883798577 conn(0x7f8dac062100 msgr2=0x7f8dac0c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:13.684 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.672+0000 7f8db3068700 1 -- 172.21.15.192:0/883798577 shutdown_connections 2020-11-20T11:48:13.685 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.672+0000 7f8db3068700 1 -- 172.21.15.192:0/883798577 wait complete. 2020-11-20T11:48:13.685 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.673+0000 7f8db3068700 1 Processor -- start 2020-11-20T11:48:13.686 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.673+0000 7f8db3068700 1 -- start start 2020-11-20T11:48:13.688 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.674+0000 7f8db3068700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d90003ae0 0x7f8dac1612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:13.689 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.674+0000 7f8db3068700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8dac1578a0 0x7f8dac163e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:13.689 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.674+0000 7f8db3068700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dac153ff0 0x7f8dac067db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:13.689 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.674+0000 7f8db3068700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac1617d0 con 0x7f8dac153ff0 2020-11-20T11:48:13.689 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.674+0000 7f8db3068700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac164700 con 0x7f8dac1578a0 2020-11-20T11:48:13.690 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.674+0000 7f8db3068700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac1649a0 con 0x7f8d90003ae0 2020-11-20T11:48:13.690 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.674+0000 7f8db0e04700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d90003ae0 0x7f8dac1612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:13.690 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.674+0000 7f8db0e04700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d90003ae0 0x7f8dac1612e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48964/0 (socket says 172.21.15.192:48964) 2020-11-20T11:48:13.690 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.674+0000 7f8db0e04700 1 -- 172.21.15.192:0/2663652030 learned_addr learned my addr 172.21.15.192:0/2663652030 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:13.690 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.674+0000 7f8db1605700 1 --2- 172.21.15.192:0/2663652030 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dac153ff0 0x7f8dac067db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:13.690 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.674+0000 7f8dabfff700 1 --2- 172.21.15.192:0/2663652030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8dac1578a0 0x7f8dac163e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:13.691 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.674+0000 7f8db0e04700 1 -- 172.21.15.192:0/2663652030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8dac1578a0 msgr2=0x7f8dac163e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:13.691 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.674+0000 7f8db0e04700 1 --2- 172.21.15.192:0/2663652030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8dac1578a0 0x7f8dac163e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:13.691 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.674+0000 7f8db0e04700 1 -- 172.21.15.192:0/2663652030 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dac153ff0 msgr2=0x7f8dac067db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:13.691 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.674+0000 7f8db0e04700 1 --2- 172.21.15.192:0/2663652030 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dac153ff0 0x7f8dac067db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:13.691 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.674+0000 7f8db0e04700 1 -- 172.21.15.192:0/2663652030 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dac164c40 con 0x7f8d90003ae0 2020-11-20T11:48:13.692 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.674+0000 7f8db0e04700 1 --2- 172.21.15.192:0/2663652030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d90003ae0 0x7f8dac1612e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f8da000d010 tx=0x7f8da0013000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:13.692 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.674+0000 7f8da8ff9700 1 -- 172.21.15.192:0/2663652030 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da001b070 con 0x7f8d90003ae0 2020-11-20T11:48:13.692 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.674+0000 7f8da8ff9700 1 -- 172.21.15.192:0/2663652030 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da0001060 con 0x7f8d90003ae0 2020-11-20T11:48:13.692 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.674+0000 7f8db3068700 1 -- 172.21.15.192:0/2663652030 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dac160900 con 0x7f8d90003ae0 2020-11-20T11:48:13.692 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.674+0000 7f8da8ff9700 1 -- 172.21.15.192:0/2663652030 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da0005e00 con 0x7f8d90003ae0 2020-11-20T11:48:13.693 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.674+0000 7f8db3068700 1 -- 172.21.15.192:0/2663652030 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dac160e40 con 0x7f8d90003ae0 2020-11-20T11:48:13.693 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.675+0000 7f8db3068700 1 -- 172.21.15.192:0/2663652030 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dac0699a0 con 0x7f8d90003ae0 2020-11-20T11:48:13.693 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.676+0000 7f8da8ff9700 1 -- 172.21.15.192:0/2663652030 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f8da0027070 con 0x7f8d90003ae0 2020-11-20T11:48:13.693 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.676+0000 7f8da8ff9700 1 --2- 172.21.15.192:0/2663652030 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f8d84080670 0x7f8d84082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:13.693 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.676+0000 7f8da8ff9700 1 -- 172.21.15.192:0/2663652030 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f8da00a30f0 con 0x7f8d90003ae0 2020-11-20T11:48:13.694 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.676+0000 7f8dabfff700 1 --2- 172.21.15.192:0/2663652030 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f8d84080670 0x7f8d84082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:13.694 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.677+0000 7f8dabfff700 1 --2- 172.21.15.192:0/2663652030 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f8d84080670 0x7f8d84082b30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f8d980079b0 tx=0x7f8d98009040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:13.694 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.680+0000 7f8da8ff9700 1 -- 172.21.15.192:0/2663652030 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f8da0077b00 con 0x7f8d90003ae0 2020-11-20T11:48:13.823 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.820+0000 7f8db3068700 1 -- 172.21.15.192:0/2663652030 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8dac05ca80 con 0x7f8d90003ae0 2020-11-20T11:48:13.824 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.820+0000 7f8da8ff9700 1 -- 172.21.15.192:0/2663652030 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+10 (secure 0 0 0) 0x7f8da0001ca0 con 0x7f8d90003ae0 2020-11-20T11:48:13.824 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 8 2020-11-20T11:48:13.825 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.822+0000 7f8db3068700 1 -- 172.21.15.192:0/2663652030 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f8d84080670 msgr2=0x7f8d84082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:13.825 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.822+0000 7f8db3068700 1 --2- 172.21.15.192:0/2663652030 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f8d84080670 0x7f8d84082b30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f8d980079b0 tx=0x7f8d98009040).stop 2020-11-20T11:48:13.826 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.822+0000 7f8db3068700 1 -- 172.21.15.192:0/2663652030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d90003ae0 msgr2=0x7f8dac1612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:13.826 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.822+0000 7f8db3068700 1 --2- 172.21.15.192:0/2663652030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d90003ae0 0x7f8dac1612e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f8da000d010 tx=0x7f8da0013000).stop 2020-11-20T11:48:13.826 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.822+0000 7f8db3068700 1 -- 172.21.15.192:0/2663652030 shutdown_connections 2020-11-20T11:48:13.827 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.822+0000 7f8db3068700 1 --2- 172.21.15.192:0/2663652030 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f8d84080670 0x7f8d84082b30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:13.827 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.822+0000 7f8db3068700 1 --2- 172.21.15.192:0/2663652030 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dac153ff0 0x7f8dac067db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:13.827 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.822+0000 7f8db3068700 1 --2- 172.21.15.192:0/2663652030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d90003ae0 0x7f8dac1612e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:13.827 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.822+0000 7f8db3068700 1 --2- 172.21.15.192:0/2663652030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8dac1578a0 0x7f8dac163e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:13.827 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.822+0000 7f8db3068700 1 -- 172.21.15.192:0/2663652030 >> 172.21.15.192:0/2663652030 conn(0x7f8dac062100 msgr2=0x7f8dac0673b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:13.828 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.822+0000 7f8db3068700 1 -- 172.21.15.192:0/2663652030 shutdown_connections 2020-11-20T11:48:13.828 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.822+0000 7f8db3068700 1 -- 172.21.15.192:0/2663652030 wait complete. 2020-11-20T11:48:13.836 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-11-20T11:48:13.837 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-11-20T11:48:13.837 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2020-11-20T11:48:13.945 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.942+0000 7f957727d700 1 Processor -- start 2020-11-20T11:48:13.945 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.942+0000 7f957727d700 1 -- start start 2020-11-20T11:48:13.948 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.943+0000 7f957727d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9570060750 0x7f9570064c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:13.948 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.943+0000 7f957727d700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9570065130 con 0x7f9570154920 2020-11-20T11:48:13.948 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.943+0000 7f957727d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9570151e80 con 0x7f9570060370 2020-11-20T11:48:13.948 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.943+0000 7f957727d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9570152120 con 0x7f9570060750 2020-11-20T11:48:13.949 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.943+0000 7f957581a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9570060750 0x7f9570064c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:13.949 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.943+0000 7f957581a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9570060750 0x7f9570064c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48974/0 (socket says 172.21.15.192:48974) 2020-11-20T11:48:13.949 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.943+0000 7f9575019700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f9570060370 0x7f95700c2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51640/0 (socket says 172.21.15.192:51640) 2020-11-20T11:48:13.949 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.943+0000 7f957581a700 1 -- 172.21.15.192:0/3814763447 learned_addr learned my addr 172.21.15.192:0/3814763447 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:13.949 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.943+0000 7f957581a700 1 -- 172.21.15.192:0/3814763447 >> v1:172.21.15.192:6789/0 conn(0x7f9570060370 legacy=0x7f95700c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:13.950 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.943+0000 7f957581a700 1 -- 172.21.15.192:0/3814763447 >> v1:172.21.15.87:6789/0 conn(0x7f9570154920 legacy=0x7f9570151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:13.950 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.943+0000 7f955ffff700 1 -- 172.21.15.192:0/3814763447 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1331453317 0 0) 0x7f9570151e80 con 0x7f9570060370 2020-11-20T11:48:13.950 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.943+0000 7f957581a700 1 -- 172.21.15.192:0/3814763447 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9570064260 con 0x7f9570060750 2020-11-20T11:48:13.950 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.944+0000 7f957581a700 1 --2- 172.21.15.192:0/3814763447 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9570060750 0x7f9570064c40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f9568009d90 tx=0x7f95680092d0).ready entity=mon.2 client_cookie=1811f339a4a7571c server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:13.950 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.944+0000 7f955ffff700 1 -- 172.21.15.192:0/3814763447 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956800bc80 con 0x7f9570060750 2020-11-20T11:48:13.951 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.944+0000 7f955ffff700 1 -- 172.21.15.192:0/3814763447 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956800bde0 con 0x7f9570060750 2020-11-20T11:48:13.951 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.944+0000 7f955ffff700 1 -- 172.21.15.192:0/3814763447 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9568011610 con 0x7f9570060750 2020-11-20T11:48:13.951 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.944+0000 7f957727d700 1 -- 172.21.15.192:0/3814763447 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9570060750 msgr2=0x7f9570064c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:13.951 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.944+0000 7f957727d700 1 --2- 172.21.15.192:0/3814763447 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9570060750 0x7f9570064c40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f9568009d90 tx=0x7f95680092d0).stop 2020-11-20T11:48:13.952 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.944+0000 7f957727d700 1 -- 172.21.15.192:0/3814763447 shutdown_connections 2020-11-20T11:48:13.952 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.944+0000 7f957727d700 1 --2- 172.21.15.192:0/3814763447 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9570060750 0x7f9570064c40 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:13.952 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.944+0000 7f957727d700 1 -- 172.21.15.192:0/3814763447 >> 172.21.15.192:0/3814763447 conn(0x7f9570062100 msgr2=0x7f95700c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:13.953 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.944+0000 7f957727d700 1 -- 172.21.15.192:0/3814763447 shutdown_connections 2020-11-20T11:48:13.953 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.944+0000 7f957727d700 1 -- 172.21.15.192:0/3814763447 wait complete. 2020-11-20T11:48:13.955 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.945+0000 7f957727d700 1 Processor -- start 2020-11-20T11:48:13.956 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.945+0000 7f957727d700 1 -- start start 2020-11-20T11:48:13.956 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.946+0000 7f957727d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9570060370 0x7f9570154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:13.956 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.946+0000 7f957727d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9570060750 0x7f9570160dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:13.956 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.946+0000 7f957727d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9570154920 0x7f9570149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:13.957 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.946+0000 7f957727d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9570163920 con 0x7f9570154920 2020-11-20T11:48:13.957 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.946+0000 7f957727d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95700b10d0 con 0x7f9570060370 2020-11-20T11:48:13.957 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.946+0000 7f957727d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95700b1370 con 0x7f9570060750 2020-11-20T11:48:13.957 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.946+0000 7f9574818700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9570060750 0x7f9570160dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:13.957 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.946+0000 7f9574818700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9570060750 0x7f9570160dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48980/0 (socket says 172.21.15.192:48980) 2020-11-20T11:48:13.958 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.946+0000 7f9574818700 1 -- 172.21.15.192:0/2960489620 learned_addr learned my addr 172.21.15.192:0/2960489620 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:13.958 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.946+0000 7f957581a700 1 --2- 172.21.15.192:0/2960489620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9570154920 0x7f9570149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:13.958 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.947+0000 7f9575019700 1 --2- 172.21.15.192:0/2960489620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9570060370 0x7f9570154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:13.958 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.947+0000 7f9574818700 1 -- 172.21.15.192:0/2960489620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9570060370 msgr2=0x7f9570154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:13.959 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.947+0000 7f9574818700 1 --2- 172.21.15.192:0/2960489620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9570060370 0x7f9570154250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:13.959 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.947+0000 7f9574818700 1 -- 172.21.15.192:0/2960489620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9570154920 msgr2=0x7f9570149090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:13.959 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.947+0000 7f9574818700 1 --2- 172.21.15.192:0/2960489620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9570154920 0x7f9570149090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:13.959 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.947+0000 7f9574818700 1 -- 172.21.15.192:0/2960489620 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9570163b50 con 0x7f9570060750 2020-11-20T11:48:13.959 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.947+0000 7f9575019700 1 --2- 172.21.15.192:0/2960489620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9570060370 0x7f9570154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:48:13.960 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.947+0000 7f9574818700 1 --2- 172.21.15.192:0/2960489620 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9570060750 0x7f9570160dc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f956000c710 tx=0x7f9560007c90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:13.960 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.947+0000 7f955d7fa700 1 -- 172.21.15.192:0/2960489620 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9560007020 con 0x7f9570060750 2020-11-20T11:48:13.960 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.947+0000 7f955d7fa700 1 -- 172.21.15.192:0/2960489620 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9560001e90 con 0x7f9570060750 2020-11-20T11:48:13.961 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.947+0000 7f957727d700 1 -- 172.21.15.192:0/2960489620 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9570163df0 con 0x7f9570060750 2020-11-20T11:48:13.961 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.947+0000 7f955d7fa700 1 -- 172.21.15.192:0/2960489620 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95600073b0 con 0x7f9570060750 2020-11-20T11:48:13.961 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.947+0000 7f957727d700 1 -- 172.21.15.192:0/2960489620 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95700be0e0 con 0x7f9570060750 2020-11-20T11:48:13.961 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.948+0000 7f957727d700 1 -- 172.21.15.192:0/2960489620 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95700699a0 con 0x7f9570060750 2020-11-20T11:48:13.962 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.948+0000 7f955d7fa700 1 -- 172.21.15.192:0/2960489620 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f9560010030 con 0x7f9570060750 2020-11-20T11:48:13.962 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.949+0000 7f955d7fa700 1 --2- 172.21.15.192:0/2960489620 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f9548080670 0x7f9548082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:13.962 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.949+0000 7f955d7fa700 1 -- 172.21.15.192:0/2960489620 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f95600a2040 con 0x7f9570060750 2020-11-20T11:48:13.962 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.949+0000 7f9575019700 1 --2- 172.21.15.192:0/2960489620 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f9548080670 0x7f9548082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:13.963 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.949+0000 7f9575019700 1 --2- 172.21.15.192:0/2960489620 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f9548080670 0x7f9548082b30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f956c001520 tx=0x7f956c009040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:13.963 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:13.952+0000 7f955d7fa700 1 -- 172.21.15.192:0/2960489620 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f9560076a50 con 0x7f9570060750 2020-11-20T11:48:14.130 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.127+0000 7f957727d700 1 -- 172.21.15.192:0/2960489620 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f957005ca80 con 0x7f9570060750 2020-11-20T11:48:14.134 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.131+0000 7f955d7fa700 1 -- 172.21.15.192:0/2960489620 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+202043 (secure 0 0 0) 0x7f956007a070 con 0x7f9570060750 2020-11-20T11:48:14.137 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:48:14.139 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.133+0000 7f957727d700 1 -- 172.21.15.192:0/2960489620 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f9548080670 msgr2=0x7f9548082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:14.139 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.133+0000 7f957727d700 1 --2- 172.21.15.192:0/2960489620 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f9548080670 0x7f9548082b30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f956c001520 tx=0x7f956c009040).stop 2020-11-20T11:48:14.139 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.133+0000 7f957727d700 1 -- 172.21.15.192:0/2960489620 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9570060750 msgr2=0x7f9570160dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:14.139 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.133+0000 7f957727d700 1 --2- 172.21.15.192:0/2960489620 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9570060750 0x7f9570160dc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f956000c710 tx=0x7f9560007c90).stop 2020-11-20T11:48:14.139 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.133+0000 7f957727d700 1 -- 172.21.15.192:0/2960489620 shutdown_connections 2020-11-20T11:48:14.140 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.133+0000 7f957727d700 1 --2- 172.21.15.192:0/2960489620 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f9548080670 0x7f9548082b30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:14.140 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.133+0000 7f957727d700 1 --2- 172.21.15.192:0/2960489620 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9570154920 0x7f9570149090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:14.140 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.133+0000 7f957727d700 1 --2- 172.21.15.192:0/2960489620 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9570060370 0x7f9570154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:14.140 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.133+0000 7f957727d700 1 --2- 172.21.15.192:0/2960489620 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9570060750 0x7f9570160dc0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:14.141 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.133+0000 7f957727d700 1 -- 172.21.15.192:0/2960489620 >> 172.21.15.192:0/2960489620 conn(0x7f9570062100 msgr2=0x7f9570154d90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:14.141 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.134+0000 7f957727d700 1 -- 172.21.15.192:0/2960489620 shutdown_connections 2020-11-20T11:48:14.141 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.134+0000 7f957727d700 1 -- 172.21.15.192:0/2960489620 wait complete. 2020-11-20T11:48:14.148 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":4,"active_gid":4106,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":22925},{"type":"v1","addr":"172.21.15.192:6801","nonce":22925}]},"active_addr":"172.21.15.192:6801/22925","active_change":"2020-11-20T11:47:52.294741+0000","active_mgr_features":4540138297136906239,"available":true,"standbys":[{"gid":4110,"name":"z","mgr_features":4540138297136906239,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":4111,"name":"y","mgr_features":4540138297136906239,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":604466527}]},{"addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":4077151917}]},{"addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":872945688}]}]}} 2020-11-20T11:48:14.155 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-11-20T11:48:14.155 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-11-20T11:48:14.156 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:48:14.298 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.294+0000 7f244f4c0700 1 Processor -- start 2020-11-20T11:48:14.298 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.295+0000 7f244f4c0700 1 -- start start 2020-11-20T11:48:14.306 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.295+0000 7f244f4c0700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2448060370 0x7f2448060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:14.306 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.295+0000 7f244f4c0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2448154920 0x7f2448064c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:14.306 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.295+0000 7f244f4c0700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2448065130 con 0x7f24480c2340 2020-11-20T11:48:14.307 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.295+0000 7f244f4c0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2448151e80 con 0x7f2448154920 2020-11-20T11:48:14.307 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.295+0000 7f244f4c0700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2448152120 con 0x7f2448060370 2020-11-20T11:48:14.307 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.296+0000 7f244d25c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2448060370 0x7f2448060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:14.307 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.296+0000 7f244da5d700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f24480c2340 0x7f2448151340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51652/0 (socket says 172.21.15.192:51652) 2020-11-20T11:48:14.307 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.296+0000 7f244da5d700 1 -- 172.21.15.192:0/3114274344 learned_addr learned my addr 172.21.15.192:0/3114274344 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:14.308 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.296+0000 7f244ca5b700 1 --2- 172.21.15.192:0/3114274344 >> v2:172.21.15.146:3300/0 conn(0x7f2448154920 0x7f2448064c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:14.308 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.296+0000 7f244d25c700 1 -- 172.21.15.192:0/3114274344 >> v2:172.21.15.146:3300/0 conn(0x7f2448154920 msgr2=0x7f2448064c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:14.308 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.296+0000 7f244d25c700 1 --2- 172.21.15.192:0/3114274344 >> v2:172.21.15.146:3300/0 conn(0x7f2448154920 0x7f2448064c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:14.308 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.296+0000 7f244d25c700 1 -- 172.21.15.192:0/3114274344 >> v1:172.21.15.192:6789/0 conn(0x7f24480c2340 legacy=0x7f2448151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:14.308 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.296+0000 7f244d25c700 1 -- 172.21.15.192:0/3114274344 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2448064260 con 0x7f2448060370 2020-11-20T11:48:14.309 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.296+0000 7f2437fff700 1 -- 172.21.15.192:0/3114274344 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2577095127 0 0) 0x7f2448065130 con 0x7f24480c2340 2020-11-20T11:48:14.309 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.296+0000 7f244d25c700 1 --2- 172.21.15.192:0/3114274344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2448060370 0x7f2448060750 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f24480c5450 tx=0x7f2438006e30).ready entity=mon.2 client_cookie=41907874e167b906 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:14.309 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.296+0000 7f2437fff700 1 -- 172.21.15.192:0/3114274344 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2438009840 con 0x7f2448060370 2020-11-20T11:48:14.309 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.296+0000 7f2437fff700 1 -- 172.21.15.192:0/3114274344 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2438000e90 con 0x7f2448060370 2020-11-20T11:48:14.310 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.296+0000 7f2437fff700 1 -- 172.21.15.192:0/3114274344 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2438009bb0 con 0x7f2448060370 2020-11-20T11:48:14.310 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.296+0000 7f244f4c0700 1 -- 172.21.15.192:0/3114274344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2448060370 msgr2=0x7f2448060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:14.310 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.296+0000 7f244f4c0700 1 --2- 172.21.15.192:0/3114274344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2448060370 0x7f2448060750 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f24480c5450 tx=0x7f2438006e30).stop 2020-11-20T11:48:14.311 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.297+0000 7f244f4c0700 1 -- 172.21.15.192:0/3114274344 shutdown_connections 2020-11-20T11:48:14.311 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.297+0000 7f244f4c0700 1 --2- 172.21.15.192:0/3114274344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2448060370 0x7f2448060750 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:14.311 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.297+0000 7f244f4c0700 1 --2- 172.21.15.192:0/3114274344 >> v2:172.21.15.146:3300/0 conn(0x7f2448154920 0x7f2448064c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:14.311 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.297+0000 7f244f4c0700 1 -- 172.21.15.192:0/3114274344 >> 172.21.15.192:0/3114274344 conn(0x7f2448062100 msgr2=0x7f24480c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:14.311 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.297+0000 7f244f4c0700 1 -- 172.21.15.192:0/3114274344 shutdown_connections 2020-11-20T11:48:14.312 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.297+0000 7f244f4c0700 1 -- 172.21.15.192:0/3114274344 wait complete. 2020-11-20T11:48:14.312 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.298+0000 7f244f4c0700 1 Processor -- start 2020-11-20T11:48:14.312 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.298+0000 7f244f4c0700 1 -- start start 2020-11-20T11:48:14.312 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.299+0000 7f244f4c0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2448060370 0x7f24480c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:14.313 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.299+0000 7f244f4c0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24480c2340 0x7f24481644d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:14.313 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.299+0000 7f244f4c0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2448154920 0x7f24480c28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:14.313 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.299+0000 7f244f4c0700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24480c5d10 con 0x7f24480c2340 2020-11-20T11:48:14.313 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.299+0000 7f244f4c0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24481649c0 con 0x7f2448154920 2020-11-20T11:48:14.313 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.299+0000 7f244f4c0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24480c3500 con 0x7f2448060370 2020-11-20T11:48:14.314 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.299+0000 7f244d25c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2448060370 0x7f24480c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:14.314 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.299+0000 7f244d25c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2448060370 0x7f24480c72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48990/0 (socket says 172.21.15.192:48990) 2020-11-20T11:48:14.314 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.299+0000 7f244d25c700 1 -- 172.21.15.192:0/1793212798 learned_addr learned my addr 172.21.15.192:0/1793212798 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:14.314 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.299+0000 7f244ca5b700 1 --2- 172.21.15.192:0/1793212798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24480c2340 0x7f24481644d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:14.314 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.299+0000 7f244da5d700 1 --2- 172.21.15.192:0/1793212798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2448154920 0x7f24480c28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:14.315 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.299+0000 7f244d25c700 1 -- 172.21.15.192:0/1793212798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2448154920 msgr2=0x7f24480c28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:14.315 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.299+0000 7f244d25c700 1 --2- 172.21.15.192:0/1793212798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2448154920 0x7f24480c28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:14.315 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.299+0000 7f244d25c700 1 -- 172.21.15.192:0/1793212798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24480c2340 msgr2=0x7f24481644d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:14.315 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.299+0000 7f244d25c700 1 --2- 172.21.15.192:0/1793212798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24480c2340 0x7f24481644d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:14.315 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.299+0000 7f244d25c700 1 -- 172.21.15.192:0/1793212798 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24480c7c70 con 0x7f2448060370 2020-11-20T11:48:14.316 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.299+0000 7f244da5d700 1 --2- 172.21.15.192:0/1793212798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2448154920 0x7f24480c28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:48:14.316 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.299+0000 7f244d25c700 1 --2- 172.21.15.192:0/1793212798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2448060370 0x7f24480c72e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f2438006e70 tx=0x7f2438015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:14.316 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.299+0000 7f24357fa700 1 -- 172.21.15.192:0/1793212798 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2438011db0 con 0x7f2448060370 2020-11-20T11:48:14.316 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.299+0000 7f24357fa700 1 -- 172.21.15.192:0/1793212798 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243801e460 con 0x7f2448060370 2020-11-20T11:48:14.316 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.299+0000 7f244f4c0700 1 -- 172.21.15.192:0/1793212798 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24480b0450 con 0x7f2448060370 2020-11-20T11:48:14.317 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.299+0000 7f24357fa700 1 -- 172.21.15.192:0/1793212798 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243801e7e0 con 0x7f2448060370 2020-11-20T11:48:14.317 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.299+0000 7f244f4c0700 1 -- 172.21.15.192:0/1793212798 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24480b0990 con 0x7f2448060370 2020-11-20T11:48:14.317 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.300+0000 7f244f4c0700 1 -- 172.21.15.192:0/1793212798 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24480699a0 con 0x7f2448060370 2020-11-20T11:48:14.317 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.301+0000 7f24357fa700 1 -- 172.21.15.192:0/1793212798 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f2438025030 con 0x7f2448060370 2020-11-20T11:48:14.317 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.301+0000 7f24357fa700 1 --2- 172.21.15.192:0/1793212798 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f2420080670 0x7f2420082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:14.318 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.301+0000 7f244ca5b700 1 --2- 172.21.15.192:0/1793212798 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f2420080670 0x7f2420082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:14.318 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.301+0000 7f24357fa700 1 -- 172.21.15.192:0/1793212798 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f24380a4250 con 0x7f2448060370 2020-11-20T11:48:14.318 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.302+0000 7f244ca5b700 1 --2- 172.21.15.192:0/1793212798 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f2420080670 0x7f2420082b30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f2444006fd0 tx=0x7f2444008040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:14.319 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.305+0000 7f24357fa700 1 -- 172.21.15.192:0/1793212798 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f2438078c60 con 0x7f2448060370 2020-11-20T11:48:14.449 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.446+0000 7f244f4c0700 1 -- 172.21.15.192:0/1793212798 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f244805ca80 con 0x7f2448060370 2020-11-20T11:48:14.450 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.447+0000 7f24357fa700 1 -- 172.21.15.192:0/1793212798 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21795 (secure 0 0 0) 0x7f2438023030 con 0x7f2448060370 2020-11-20T11:48:14.450 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:48:14.451 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":28,"fsid":"4871390d-d110-4379-8302-5810d7b54f34","created":"2020-11-20T11:47:49.059675+0000","modified":"2020-11-20T11:48:09.832333+0000","last_up_change":"2020-11-20T11:47:57.317253+0000","last_in_change":"2020-11-20T11:47:57.317253+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:47:52.327778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:48:01.912951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:48:04.793810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:48:07.506705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77a5e1d9-0fb0-450c-872e-4aee77dede49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":23242},{"type":"v1","addr":"172.21.15.192:6827","nonce":23242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":23242},{"type":"v1","addr":"172.21.15.192:6829","nonce":23242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":23242},{"type":"v1","addr":"172.21.15.192:6833","nonce":23242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":23242},{"type":"v1","addr":"172.21.15.192:6831","nonce":23242}]},"public_addr":"172.21.15.192:6827/23242","cluster_addr":"172.21.15.192:6829/23242","heartbeat_back_addr":"172.21.15.192:6833/23242","heartbeat_front_addr":"172.21.15.192:6831/23242","state":["exists","up"]},{"osd":1,"uuid":"564330c6-5c45-4ef6-8718-bbfa97848e6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":22856},{"type":"v1","addr":"172.21.15.146:6801","nonce":22856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":22856},{"type":"v1","addr":"172.21.15.146:6803","nonce":22856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":22856},{"type":"v1","addr":"172.21.15.146:6807","nonce":22856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":22856},{"type":"v1","addr":"172.21.15.146:6805","nonce":22856}]},"public_addr":"172.21.15.146:6801/22856","cluster_addr":"172.21.15.146:6803/22856","heartbeat_back_addr":"172.21.15.146:6807/22856","heartbeat_front_addr":"172.21.15.146:6805/22856","state":["exists","up"]},{"osd":2,"uuid":"128ddb77-579b-4fa3-a0cb-7465ad959f3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6815","nonce":23326},{"type":"v1","addr":"172.21.15.87:6817","nonce":23326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":23326},{"type":"v1","addr":"172.21.15.87:6819","nonce":23326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":23326},{"type":"v1","addr":"172.21.15.87:6823","nonce":23326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":23326},{"type":"v1","addr":"172.21.15.87:6821","nonce":23326}]},"public_addr":"172.21.15.87:6817/23326","cluster_addr":"172.21.15.87:6819/23326","heartbeat_back_addr":"172.21.15.87:6823/23326","heartbeat_front_addr":"172.21.15.87:6821/23326","state":["exists","up"]},{"osd":3,"uuid":"4668cfdf-d172-4f30-95b8-ac842108a520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":23243},{"type":"v1","addr":"172.21.15.192:6803","nonce":23243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":23243},{"type":"v1","addr":"172.21.15.192:6805","nonce":23243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":23243},{"type":"v1","addr":"172.21.15.192:6809","nonce":23243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":23243},{"type":"v1","addr":"172.21.15.192:6807","nonce":23243}]},"public_addr":"172.21.15.192:6803/23243","cluster_addr":"172.21.15.192:6805/23243","heartbeat_back_addr":"172.21.15.192:6809/23243","heartbeat_front_addr":"172.21.15.192:6807/23243","state":["exists","up"]},{"osd":4,"uuid":"c4bc8ba5-0d22-49f5-97a6-2ca71e3a8c62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":22857},{"type":"v1","addr":"172.21.15.146:6809","nonce":22857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":22857},{"type":"v1","addr":"172.21.15.146:6811","nonce":22857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":22857},{"type":"v1","addr":"172.21.15.146:6815","nonce":22857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":22857},{"type":"v1","addr":"172.21.15.146:6813","nonce":22857}]},"public_addr":"172.21.15.146:6809/22857","cluster_addr":"172.21.15.146:6811/22857","heartbeat_back_addr":"172.21.15.146:6815/22857","heartbeat_front_addr":"172.21.15.146:6813/22857","state":["exists","up"]},{"osd":5,"uuid":"2d15f1db-e580-4715-9728-8fe5dd7e34d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":23316},{"type":"v1","addr":"172.21.15.87:6801","nonce":23316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":23316},{"type":"v1","addr":"172.21.15.87:6803","nonce":23316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":23316},{"type":"v1","addr":"172.21.15.87:6807","nonce":23316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":23316},{"type":"v1","addr":"172.21.15.87:6805","nonce":23316}]},"public_addr":"172.21.15.87:6801/23316","cluster_addr":"172.21.15.87:6803/23316","heartbeat_back_addr":"172.21.15.87:6807/23316","heartbeat_front_addr":"172.21.15.87:6805/23316","state":["exists","up"]},{"osd":6,"uuid":"a659da2b-bdce-42ac-8b30-b8c69b4c7041","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":23246},{"type":"v1","addr":"172.21.15.192:6811","nonce":23246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":23246},{"type":"v1","addr":"172.21.15.192:6813","nonce":23246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":23246},{"type":"v1","addr":"172.21.15.192:6817","nonce":23246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":23246},{"type":"v1","addr":"172.21.15.192:6815","nonce":23246}]},"public_addr":"172.21.15.192:6811/23246","cluster_addr":"172.21.15.192:6813/23246","heartbeat_back_addr":"172.21.15.192:6817/23246","heartbeat_front_addr":"172.21.15.192:6815/23246","state":["exists","up"]},{"osd":7,"uuid":"d6e41ac5-bab7-49e2-a17a-ef794bcc4a09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":22858},{"type":"v1","addr":"172.21.15.146:6818","nonce":22858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":22858},{"type":"v1","addr":"172.21.15.146:6822","nonce":22858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":22858},{"type":"v1","addr":"172.21.15.146:6830","nonce":22858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":22858},{"type":"v1","addr":"172.21.15.146:6826","nonce":22858}]},"public_addr":"172.21.15.146:6818/22858","cluster_addr":"172.21.15.146:6822/22858","heartbeat_back_addr":"172.21.15.146:6830/22858","heartbeat_front_addr":"172.21.15.146:6826/22858","state":["exists","up"]},{"osd":8,"uuid":"c4907993-7513-4162-974f-07dcb0a260a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":23333},{"type":"v1","addr":"172.21.15.87:6825","nonce":23333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":23333},{"type":"v1","addr":"172.21.15.87:6827","nonce":23333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":23333},{"type":"v1","addr":"172.21.15.87:6831","nonce":23333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":23333},{"type":"v1","addr":"172.21.15.87:6829","nonce":23333}]},"public_addr":"172.21.15.87:6825/23333","cluster_addr":"172.21.15.87:6827/23333","heartbeat_back_addr":"172.21.15.87:6831/23333","heartbeat_front_addr":"172.21.15.87:6829/23333","state":["exists","up"]},{"osd":9,"uuid":"3523676f-c9b8-47ae-86c0-4930dca17831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":23254},{"type":"v1","addr":"172.21.15.192:6819","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":23254},{"type":"v1","addr":"172.21.15.192:6821","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":23254},{"type":"v1","addr":"172.21.15.192:6825","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":23254},{"type":"v1","addr":"172.21.15.192:6823","nonce":23254}]},"public_addr":"172.21.15.192:6819/23254","cluster_addr":"172.21.15.192:6821/23254","heartbeat_back_addr":"172.21.15.192:6825/23254","heartbeat_front_addr":"172.21.15.192:6823/23254","state":["exists","up"]},{"osd":10,"uuid":"88d5c251-0bb1-4624-8fa2-7f3b74bd1bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":22859},{"type":"v1","addr":"172.21.15.146:6819","nonce":22859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6821","nonce":22859},{"type":"v1","addr":"172.21.15.146:6823","nonce":22859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":22859},{"type":"v1","addr":"172.21.15.146:6831","nonce":22859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6825","nonce":22859},{"type":"v1","addr":"172.21.15.146:6827","nonce":22859}]},"public_addr":"172.21.15.146:6819/22859","cluster_addr":"172.21.15.146:6823/22859","heartbeat_back_addr":"172.21.15.146:6831/22859","heartbeat_front_addr":"172.21.15.146:6827/22859","state":["exists","up"]},{"osd":11,"uuid":"31f650d6-ba1e-4f29-92ff-6abee04c0f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":23317},{"type":"v1","addr":"172.21.15.87:6809","nonce":23317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":23317},{"type":"v1","addr":"172.21.15.87:6811","nonce":23317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":23317},{"type":"v1","addr":"172.21.15.87:6816","nonce":23317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":23317},{"type":"v1","addr":"172.21.15.87:6813","nonce":23317}]},"public_addr":"172.21.15.87:6809/23317","cluster_addr":"172.21.15.87:6811/23317","heartbeat_back_addr":"172.21.15.87:6816/23317","heartbeat_front_addr":"172.21.15.87:6813/23317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.538863+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.552293+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.585265+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.505194+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.550032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.558089+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.565622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.587102+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.654330+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.599072+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.645833+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.596236+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:48:14.452 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.448+0000 7f244f4c0700 1 -- 172.21.15.192:0/1793212798 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f2420080670 msgr2=0x7f2420082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:14.452 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.448+0000 7f244f4c0700 1 --2- 172.21.15.192:0/1793212798 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f2420080670 0x7f2420082b30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f2444006fd0 tx=0x7f2444008040).stop 2020-11-20T11:48:14.452 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.448+0000 7f244f4c0700 1 -- 172.21.15.192:0/1793212798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2448060370 msgr2=0x7f24480c72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:14.453 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.448+0000 7f244f4c0700 1 --2- 172.21.15.192:0/1793212798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2448060370 0x7f24480c72e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f2438006e70 tx=0x7f2438015000).stop 2020-11-20T11:48:14.453 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.449+0000 7f244f4c0700 1 -- 172.21.15.192:0/1793212798 shutdown_connections 2020-11-20T11:48:14.453 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.449+0000 7f244f4c0700 1 --2- 172.21.15.192:0/1793212798 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f2420080670 0x7f2420082b30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:14.453 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.449+0000 7f244f4c0700 1 --2- 172.21.15.192:0/1793212798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2448154920 0x7f24480c28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:14.454 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.449+0000 7f244f4c0700 1 --2- 172.21.15.192:0/1793212798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2448060370 0x7f24480c72e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:14.454 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.449+0000 7f244f4c0700 1 --2- 172.21.15.192:0/1793212798 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f24480c2340 0x7f24481644d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:14.454 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.449+0000 7f244f4c0700 1 -- 172.21.15.192:0/1793212798 >> 172.21.15.192:0/1793212798 conn(0x7f2448062100 msgr2=0x7f2448153bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:14.454 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.449+0000 7f244f4c0700 1 -- 172.21.15.192:0/1793212798 shutdown_connections 2020-11-20T11:48:14.454 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.449+0000 7f244f4c0700 1 -- 172.21.15.192:0/1793212798 wait complete. 2020-11-20T11:48:14.463 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-11-20T11:48:14.464 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:48:14.482 INFO:tasks.ceph.mds.b.smithi146.stderr:2020-11-20T11:48:14.479+0000 7fe48fb0d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2020-11-20T11:48:14.573 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.569+0000 7f6faae84700 1 Processor -- start 2020-11-20T11:48:14.573 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.570+0000 7f6faae84700 1 -- start start 2020-11-20T11:48:14.575 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.570+0000 7f6faae84700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6fa4060370 0x7f6fa4060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:14.575 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.570+0000 7f6faae84700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f6fa4064b90 0x7f6fa4065010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:14.576 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.570+0000 7f6faae84700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa4151340 con 0x7f6fa4061630 2020-11-20T11:48:14.576 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.570+0000 7f6faae84700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa4151110 con 0x7f6fa4064b90 2020-11-20T11:48:14.576 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.570+0000 7f6faae84700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa41515e0 con 0x7f6fa4060370 2020-11-20T11:48:14.576 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.571+0000 7f6fa9e82700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6fa4060370 0x7f6fa4060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:14.576 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.571+0000 7f6fa9e82700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6fa4060370 0x7f6fa4060750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48998/0 (socket says 172.21.15.192:48998) 2020-11-20T11:48:14.577 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.571+0000 7f6fa9e82700 1 -- 172.21.15.192:0/1090116260 learned_addr learned my addr 172.21.15.192:0/1090116260 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:14.577 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.571+0000 7f6fa9681700 1 --2- 172.21.15.192:0/1090116260 >> v2:172.21.15.87:3300/0 conn(0x7f6fa4064b90 0x7f6fa4065010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:14.577 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.571+0000 7f6fa9e82700 1 -- 172.21.15.192:0/1090116260 >> v2:172.21.15.87:3300/0 conn(0x7f6fa4064b90 msgr2=0x7f6fa4065010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:14.577 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.571+0000 7f6fa9e82700 1 --2- 172.21.15.192:0/1090116260 >> v2:172.21.15.87:3300/0 conn(0x7f6fa4064b90 0x7f6fa4065010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:14.578 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.571+0000 7f6fa9e82700 1 -- 172.21.15.192:0/1090116260 >> v1:172.21.15.146:6789/0 conn(0x7f6fa4061630 legacy=0x7f6fa4061ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:14.578 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.571+0000 7f6fa9e82700 1 -- 172.21.15.192:0/1090116260 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa4151880 con 0x7f6fa4060370 2020-11-20T11:48:14.578 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.571+0000 7f6fa9e82700 1 --2- 172.21.15.192:0/1090116260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fa4060370 0x7f6fa4060750 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f6fa40bb550 tx=0x7f6fa0006ef0).ready entity=mon.2 client_cookie=38499ebd71839850 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:14.578 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.571+0000 7f6fa8e80700 1 -- 172.21.15.192:0/1090116260 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa000b8f0 con 0x7f6fa4060370 2020-11-20T11:48:14.578 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.571+0000 7f6fa8e80700 1 -- 172.21.15.192:0/1090116260 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa0000e90 con 0x7f6fa4060370 2020-11-20T11:48:14.579 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.571+0000 7f6fa8e80700 1 -- 172.21.15.192:0/1090116260 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa000bc60 con 0x7f6fa4060370 2020-11-20T11:48:14.579 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.572+0000 7f6faae84700 1 -- 172.21.15.192:0/1090116260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fa4060370 msgr2=0x7f6fa4060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:14.579 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.572+0000 7f6faae84700 1 --2- 172.21.15.192:0/1090116260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fa4060370 0x7f6fa4060750 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f6fa40bb550 tx=0x7f6fa0006ef0).stop 2020-11-20T11:48:14.579 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.572+0000 7f6faae84700 1 -- 172.21.15.192:0/1090116260 shutdown_connections 2020-11-20T11:48:14.579 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.572+0000 7f6faae84700 1 --2- 172.21.15.192:0/1090116260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fa4060370 0x7f6fa4060750 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0x7f6fa40bb550 tx=0x7f6fa0006ef0).stop 2020-11-20T11:48:14.580 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.572+0000 7f6faae84700 1 --2- 172.21.15.192:0/1090116260 >> v2:172.21.15.87:3300/0 conn(0x7f6fa4064b90 0x7f6fa4065010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:14.580 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.572+0000 7f6faae84700 1 -- 172.21.15.192:0/1090116260 >> 172.21.15.192:0/1090116260 conn(0x7f6fa40ba9a0 msgr2=0x7f6fa40badb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:14.580 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.572+0000 7f6faae84700 1 -- 172.21.15.192:0/1090116260 shutdown_connections 2020-11-20T11:48:14.580 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.572+0000 7f6faae84700 1 -- 172.21.15.192:0/1090116260 wait complete. 2020-11-20T11:48:14.583 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.573+0000 7f6faae84700 1 Processor -- start 2020-11-20T11:48:14.583 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.573+0000 7f6faae84700 1 -- start start 2020-11-20T11:48:14.583 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.573+0000 7f6faae84700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6fa4061630 0x7f6fa414ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:14.583 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.573+0000 7f6faae84700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fa4064b90 0x7f6fa41524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:14.584 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.573+0000 7f6faae84700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fa414ef70 0x7f6fa4152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:14.584 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.574+0000 7f6faae84700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa4164090 con 0x7f6fa4061630 2020-11-20T11:48:14.584 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.574+0000 7f6faae84700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa4164330 con 0x7f6fa414ef70 2020-11-20T11:48:14.584 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.574+0000 7f6faae84700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa41645d0 con 0x7f6fa4064b90 2020-11-20T11:48:14.584 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.574+0000 7f6fa9681700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fa4064b90 0x7f6fa41524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:14.585 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.574+0000 7f6fa9681700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fa4064b90 0x7f6fa41524a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49004/0 (socket says 172.21.15.192:49004) 2020-11-20T11:48:14.585 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.574+0000 7f6fa9681700 1 -- 172.21.15.192:0/3292661051 learned_addr learned my addr 172.21.15.192:0/3292661051 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:14.585 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.574+0000 7f6fa9e82700 1 --2- 172.21.15.192:0/3292661051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6fa4061630 0x7f6fa414ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:14.585 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.574+0000 7f6faa683700 1 --2- 172.21.15.192:0/3292661051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fa414ef70 0x7f6fa4152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:14.585 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.574+0000 7f6fa9681700 1 -- 172.21.15.192:0/3292661051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fa414ef70 msgr2=0x7f6fa4152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:14.586 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.574+0000 7f6fa9681700 1 --2- 172.21.15.192:0/3292661051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fa414ef70 0x7f6fa4152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:14.586 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.574+0000 7f6fa9681700 1 -- 172.21.15.192:0/3292661051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6fa4061630 msgr2=0x7f6fa414ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:14.586 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.574+0000 7f6fa9681700 1 --2- 172.21.15.192:0/3292661051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6fa4061630 0x7f6fa414ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:14.586 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.574+0000 7f6fa9681700 1 -- 172.21.15.192:0/3292661051 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa4164870 con 0x7f6fa4064b90 2020-11-20T11:48:14.586 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.574+0000 7f6fa9681700 1 --2- 172.21.15.192:0/3292661051 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fa4064b90 0x7f6fa41524a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f6f9400db30 tx=0x7f6f94008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:14.587 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.574+0000 7f6f91ffb700 1 -- 172.21.15.192:0/3292661051 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9400de40 con 0x7f6fa4064b90 2020-11-20T11:48:14.587 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.574+0000 7f6f91ffb700 1 -- 172.21.15.192:0/3292661051 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f94009850 con 0x7f6fa4064b90 2020-11-20T11:48:14.587 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.574+0000 7f6faae84700 1 -- 172.21.15.192:0/3292661051 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa4164b10 con 0x7f6fa4064b90 2020-11-20T11:48:14.587 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.574+0000 7f6f91ffb700 1 -- 172.21.15.192:0/3292661051 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f94009bd0 con 0x7f6fa4064b90 2020-11-20T11:48:14.587 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.574+0000 7f6faae84700 1 -- 172.21.15.192:0/3292661051 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa4161be0 con 0x7f6fa4064b90 2020-11-20T11:48:14.588 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.575+0000 7f6faae84700 1 -- 172.21.15.192:0/3292661051 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa40bfad0 con 0x7f6fa4064b90 2020-11-20T11:48:14.588 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.576+0000 7f6f91ffb700 1 -- 172.21.15.192:0/3292661051 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f6f94013480 con 0x7f6fa4064b90 2020-11-20T11:48:14.588 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.576+0000 7f6f91ffb700 1 --2- 172.21.15.192:0/3292661051 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f6f7c080670 0x7f6f7c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:14.588 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.576+0000 7f6f91ffb700 1 -- 172.21.15.192:0/3292661051 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f6f940a2ce0 con 0x7f6fa4064b90 2020-11-20T11:48:14.588 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.576+0000 7f6fa9e82700 1 --2- 172.21.15.192:0/3292661051 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f6f7c080670 0x7f6f7c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:14.588 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.577+0000 7f6fa9e82700 1 --2- 172.21.15.192:0/3292661051 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f6f7c080670 0x7f6f7c082b30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f6fa40673f0 tx=0x7f6fa0016000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:14.589 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.580+0000 7f6f91ffb700 1 -- 172.21.15.192:0/3292661051 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f6f94077690 con 0x7f6fa4064b90 2020-11-20T11:48:14.723 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.720+0000 7f6faae84700 1 -- 172.21.15.192:0/3292661051 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6fa4151a60 con 0x7f6fa4064b90 2020-11-20T11:48:14.724 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.721+0000 7f6f91ffb700 1 -- 172.21.15.192:0/3292661051 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21795 (secure 0 0 0) 0x7f6f9407acb0 con 0x7f6fa4064b90 2020-11-20T11:48:14.725 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:48:14.725 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":28,"fsid":"4871390d-d110-4379-8302-5810d7b54f34","created":"2020-11-20T11:47:49.059675+0000","modified":"2020-11-20T11:48:09.832333+0000","last_up_change":"2020-11-20T11:47:57.317253+0000","last_in_change":"2020-11-20T11:47:57.317253+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:47:52.327778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:48:01.912951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:48:04.793810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:48:07.506705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77a5e1d9-0fb0-450c-872e-4aee77dede49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":23242},{"type":"v1","addr":"172.21.15.192:6827","nonce":23242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":23242},{"type":"v1","addr":"172.21.15.192:6829","nonce":23242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":23242},{"type":"v1","addr":"172.21.15.192:6833","nonce":23242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":23242},{"type":"v1","addr":"172.21.15.192:6831","nonce":23242}]},"public_addr":"172.21.15.192:6827/23242","cluster_addr":"172.21.15.192:6829/23242","heartbeat_back_addr":"172.21.15.192:6833/23242","heartbeat_front_addr":"172.21.15.192:6831/23242","state":["exists","up"]},{"osd":1,"uuid":"564330c6-5c45-4ef6-8718-bbfa97848e6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":22856},{"type":"v1","addr":"172.21.15.146:6801","nonce":22856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":22856},{"type":"v1","addr":"172.21.15.146:6803","nonce":22856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":22856},{"type":"v1","addr":"172.21.15.146:6807","nonce":22856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":22856},{"type":"v1","addr":"172.21.15.146:6805","nonce":22856}]},"public_addr":"172.21.15.146:6801/22856","cluster_addr":"172.21.15.146:6803/22856","heartbeat_back_addr":"172.21.15.146:6807/22856","heartbeat_front_addr":"172.21.15.146:6805/22856","state":["exists","up"]},{"osd":2,"uuid":"128ddb77-579b-4fa3-a0cb-7465ad959f3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6815","nonce":23326},{"type":"v1","addr":"172.21.15.87:6817","nonce":23326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":23326},{"type":"v1","addr":"172.21.15.87:6819","nonce":23326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":23326},{"type":"v1","addr":"172.21.15.87:6823","nonce":23326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":23326},{"type":"v1","addr":"172.21.15.87:6821","nonce":23326}]},"public_addr":"172.21.15.87:6817/23326","cluster_addr":"172.21.15.87:6819/23326","heartbeat_back_addr":"172.21.15.87:6823/23326","heartbeat_front_addr":"172.21.15.87:6821/23326","state":["exists","up"]},{"osd":3,"uuid":"4668cfdf-d172-4f30-95b8-ac842108a520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":23243},{"type":"v1","addr":"172.21.15.192:6803","nonce":23243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":23243},{"type":"v1","addr":"172.21.15.192:6805","nonce":23243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":23243},{"type":"v1","addr":"172.21.15.192:6809","nonce":23243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":23243},{"type":"v1","addr":"172.21.15.192:6807","nonce":23243}]},"public_addr":"172.21.15.192:6803/23243","cluster_addr":"172.21.15.192:6805/23243","heartbeat_back_addr":"172.21.15.192:6809/23243","heartbeat_front_addr":"172.21.15.192:6807/23243","state":["exists","up"]},{"osd":4,"uuid":"c4bc8ba5-0d22-49f5-97a6-2ca71e3a8c62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":22857},{"type":"v1","addr":"172.21.15.146:6809","nonce":22857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":22857},{"type":"v1","addr":"172.21.15.146:6811","nonce":22857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":22857},{"type":"v1","addr":"172.21.15.146:6815","nonce":22857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":22857},{"type":"v1","addr":"172.21.15.146:6813","nonce":22857}]},"public_addr":"172.21.15.146:6809/22857","cluster_addr":"172.21.15.146:6811/22857","heartbeat_back_addr":"172.21.15.146:6815/22857","heartbeat_front_addr":"172.21.15.146:6813/22857","state":["exists","up"]},{"osd":5,"uuid":"2d15f1db-e580-4715-9728-8fe5dd7e34d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":23316},{"type":"v1","addr":"172.21.15.87:6801","nonce":23316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":23316},{"type":"v1","addr":"172.21.15.87:6803","nonce":23316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":23316},{"type":"v1","addr":"172.21.15.87:6807","nonce":23316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":23316},{"type":"v1","addr":"172.21.15.87:6805","nonce":23316}]},"public_addr":"172.21.15.87:6801/23316","cluster_addr":"172.21.15.87:6803/23316","heartbeat_back_addr":"172.21.15.87:6807/23316","heartbeat_front_addr":"172.21.15.87:6805/23316","state":["exists","up"]},{"osd":6,"uuid":"a659da2b-bdce-42ac-8b30-b8c69b4c7041","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":23246},{"type":"v1","addr":"172.21.15.192:6811","nonce":23246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":23246},{"type":"v1","addr":"172.21.15.192:6813","nonce":23246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":23246},{"type":"v1","addr":"172.21.15.192:6817","nonce":23246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":23246},{"type":"v1","addr":"172.21.15.192:6815","nonce":23246}]},"public_addr":"172.21.15.192:6811/23246","cluster_addr":"172.21.15.192:6813/23246","heartbeat_back_addr":"172.21.15.192:6817/23246","heartbeat_front_addr":"172.21.15.192:6815/23246","state":["exists","up"]},{"osd":7,"uuid":"d6e41ac5-bab7-49e2-a17a-ef794bcc4a09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":22858},{"type":"v1","addr":"172.21.15.146:6818","nonce":22858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":22858},{"type":"v1","addr":"172.21.15.146:6822","nonce":22858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":22858},{"type":"v1","addr":"172.21.15.146:6830","nonce":22858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":22858},{"type":"v1","addr":"172.21.15.146:6826","nonce":22858}]},"public_addr":"172.21.15.146:6818/22858","cluster_addr":"172.21.15.146:6822/22858","heartbeat_back_addr":"172.21.15.146:6830/22858","heartbeat_front_addr":"172.21.15.146:6826/22858","state":["exists","up"]},{"osd":8,"uuid":"c4907993-7513-4162-974f-07dcb0a260a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":23333},{"type":"v1","addr":"172.21.15.87:6825","nonce":23333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":23333},{"type":"v1","addr":"172.21.15.87:6827","nonce":23333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":23333},{"type":"v1","addr":"172.21.15.87:6831","nonce":23333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":23333},{"type":"v1","addr":"172.21.15.87:6829","nonce":23333}]},"public_addr":"172.21.15.87:6825/23333","cluster_addr":"172.21.15.87:6827/23333","heartbeat_back_addr":"172.21.15.87:6831/23333","heartbeat_front_addr":"172.21.15.87:6829/23333","state":["exists","up"]},{"osd":9,"uuid":"3523676f-c9b8-47ae-86c0-4930dca17831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":23254},{"type":"v1","addr":"172.21.15.192:6819","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":23254},{"type":"v1","addr":"172.21.15.192:6821","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":23254},{"type":"v1","addr":"172.21.15.192:6825","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":23254},{"type":"v1","addr":"172.21.15.192:6823","nonce":23254}]},"public_addr":"172.21.15.192:6819/23254","cluster_addr":"172.21.15.192:6821/23254","heartbeat_back_addr":"172.21.15.192:6825/23254","heartbeat_front_addr":"172.21.15.192:6823/23254","state":["exists","up"]},{"osd":10,"uuid":"88d5c251-0bb1-4624-8fa2-7f3b74bd1bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":22859},{"type":"v1","addr":"172.21.15.146:6819","nonce":22859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6821","nonce":22859},{"type":"v1","addr":"172.21.15.146:6823","nonce":22859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":22859},{"type":"v1","addr":"172.21.15.146:6831","nonce":22859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6825","nonce":22859},{"type":"v1","addr":"172.21.15.146:6827","nonce":22859}]},"public_addr":"172.21.15.146:6819/22859","cluster_addr":"172.21.15.146:6823/22859","heartbeat_back_addr":"172.21.15.146:6831/22859","heartbeat_front_addr":"172.21.15.146:6827/22859","state":["exists","up"]},{"osd":11,"uuid":"31f650d6-ba1e-4f29-92ff-6abee04c0f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":23317},{"type":"v1","addr":"172.21.15.87:6809","nonce":23317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":23317},{"type":"v1","addr":"172.21.15.87:6811","nonce":23317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":23317},{"type":"v1","addr":"172.21.15.87:6816","nonce":23317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":23317},{"type":"v1","addr":"172.21.15.87:6813","nonce":23317}]},"public_addr":"172.21.15.87:6809/23317","cluster_addr":"172.21.15.87:6811/23317","heartbeat_back_addr":"172.21.15.87:6816/23317","heartbeat_front_addr":"172.21.15.87:6813/23317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.538863+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.552293+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.585265+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.505194+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.550032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.558089+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.565622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.587102+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.654330+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.599072+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.645833+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.596236+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:48:14.726 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.723+0000 7f6faae84700 1 -- 172.21.15.192:0/3292661051 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f6f7c080670 msgr2=0x7f6f7c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:14.726 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.723+0000 7f6faae84700 1 --2- 172.21.15.192:0/3292661051 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f6f7c080670 0x7f6f7c082b30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f6fa40673f0 tx=0x7f6fa0016000).stop 2020-11-20T11:48:14.727 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.723+0000 7f6faae84700 1 -- 172.21.15.192:0/3292661051 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fa4064b90 msgr2=0x7f6fa41524a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:14.727 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.723+0000 7f6faae84700 1 --2- 172.21.15.192:0/3292661051 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fa4064b90 0x7f6fa41524a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f6f9400db30 tx=0x7f6f94008040).stop 2020-11-20T11:48:14.727 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.723+0000 7f6faae84700 1 -- 172.21.15.192:0/3292661051 shutdown_connections 2020-11-20T11:48:14.727 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.723+0000 7f6faae84700 1 --2- 172.21.15.192:0/3292661051 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f6f7c080670 0x7f6f7c082b30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:14.727 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.723+0000 7f6faae84700 1 --2- 172.21.15.192:0/3292661051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fa414ef70 0x7f6fa4152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:14.728 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.723+0000 7f6faae84700 1 --2- 172.21.15.192:0/3292661051 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6fa4061630 0x7f6fa414ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:14.728 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.723+0000 7f6faae84700 1 --2- 172.21.15.192:0/3292661051 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fa4064b90 0x7f6fa41524a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:14.728 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.723+0000 7f6faae84700 1 -- 172.21.15.192:0/3292661051 >> 172.21.15.192:0/3292661051 conn(0x7f6fa40ba9a0 msgr2=0x7f6fa414f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:14.728 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.723+0000 7f6faae84700 1 -- 172.21.15.192:0/3292661051 shutdown_connections 2020-11-20T11:48:14.728 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.723+0000 7f6faae84700 1 -- 172.21.15.192:0/3292661051 wait complete. 2020-11-20T11:48:14.738 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2020-11-20T11:48:14.847 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.844+0000 7f35afdc4700 1 Processor -- start 2020-11-20T11:48:14.848 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.844+0000 7f35afdc4700 1 -- start start 2020-11-20T11:48:14.850 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.845+0000 7f35afdc4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f35a8060370 0x7f35a8060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:14.850 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.845+0000 7f35afdc4700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f35a8154920 0x7f35a8064c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:14.850 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.845+0000 7f35afdc4700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a8065130 con 0x7f35a80c2340 2020-11-20T11:48:14.851 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.845+0000 7f35afdc4700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a8151e80 con 0x7f35a8154920 2020-11-20T11:48:14.851 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.845+0000 7f35afdc4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a8152120 con 0x7f35a8060370 2020-11-20T11:48:14.851 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.846+0000 7f35adb60700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f35a8060370 0x7f35a8060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:14.851 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.846+0000 7f35adb60700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f35a8060370 0x7f35a8060750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.192:53098/0 (socket says 172.21.15.192:53098) 2020-11-20T11:48:14.851 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.846+0000 7f35adb60700 1 -- 172.21.15.192:0/3433113786 learned_addr learned my addr 172.21.15.192:0/3433113786 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:14.852 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.846+0000 7f35ad35f700 1 --2- 172.21.15.192:0/3433113786 >> v2:172.21.15.87:3300/0 conn(0x7f35a8154920 0x7f35a8064c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:14.853 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.846+0000 7f35adb60700 1 -- 172.21.15.192:0/3433113786 >> v2:172.21.15.87:3300/0 conn(0x7f35a8154920 msgr2=0x7f35a8064c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:14.853 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.846+0000 7f35adb60700 1 --2- 172.21.15.192:0/3433113786 >> v2:172.21.15.87:3300/0 conn(0x7f35a8154920 0x7f35a8064c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:14.853 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.846+0000 7f35adb60700 1 -- 172.21.15.192:0/3433113786 >> v1:172.21.15.87:6789/0 conn(0x7f35a80c2340 legacy=0x7f35a8151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:14.853 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.846+0000 7f35adb60700 1 -- 172.21.15.192:0/3433113786 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a8064260 con 0x7f35a8060370 2020-11-20T11:48:14.853 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.846+0000 7f35adb60700 1 --2- 172.21.15.192:0/3433113786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a8060370 0x7f35a8060750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f35a80c5450 tx=0x7f35a4006ef0).ready entity=mon.1 client_cookie=92dc3d27a6f7461a server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:14.854 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.846+0000 7f35acb5e700 1 -- 172.21.15.192:0/3433113786 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a400b8f0 con 0x7f35a8060370 2020-11-20T11:48:14.854 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.846+0000 7f35acb5e700 1 -- 172.21.15.192:0/3433113786 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a4000e90 con 0x7f35a8060370 2020-11-20T11:48:14.854 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.846+0000 7f35acb5e700 1 -- 172.21.15.192:0/3433113786 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a400bc60 con 0x7f35a8060370 2020-11-20T11:48:14.854 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.847+0000 7f35afdc4700 1 -- 172.21.15.192:0/3433113786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a8060370 msgr2=0x7f35a8060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:14.854 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.847+0000 7f35afdc4700 1 --2- 172.21.15.192:0/3433113786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a8060370 0x7f35a8060750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f35a80c5450 tx=0x7f35a4006ef0).stop 2020-11-20T11:48:14.855 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.847+0000 7f35afdc4700 1 -- 172.21.15.192:0/3433113786 shutdown_connections 2020-11-20T11:48:14.855 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.847+0000 7f35afdc4700 1 --2- 172.21.15.192:0/3433113786 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a8060370 0x7f35a8060750 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:14.855 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.847+0000 7f35afdc4700 1 --2- 172.21.15.192:0/3433113786 >> v2:172.21.15.87:3300/0 conn(0x7f35a8154920 0x7f35a8064c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:14.855 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.847+0000 7f35afdc4700 1 -- 172.21.15.192:0/3433113786 >> 172.21.15.192:0/3433113786 conn(0x7f35a8062100 msgr2=0x7f35a80c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:14.855 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.847+0000 7f35afdc4700 1 -- 172.21.15.192:0/3433113786 shutdown_connections 2020-11-20T11:48:14.856 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.847+0000 7f35afdc4700 1 -- 172.21.15.192:0/3433113786 wait complete. 2020-11-20T11:48:14.859 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.848+0000 7f35afdc4700 1 Processor -- start 2020-11-20T11:48:14.859 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.848+0000 7f35afdc4700 1 -- start start 2020-11-20T11:48:14.859 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.849+0000 7f35afdc4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a8060370 0x7f35a80c7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:14.859 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.849+0000 7f35afdc4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35a80c2340 0x7f35a814f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:14.860 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.849+0000 7f35afdc4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35a8154920 0x7f35a81608a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:14.860 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.849+0000 7f35afdc4700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a81574f0 con 0x7f35a8154920 2020-11-20T11:48:14.860 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.849+0000 7f35afdc4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a8157790 con 0x7f35a8060370 2020-11-20T11:48:14.860 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.849+0000 7f35afdc4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a8163e50 con 0x7f35a80c2340 2020-11-20T11:48:14.861 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.849+0000 7f35ad35f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35a80c2340 0x7f35a814f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:14.861 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.849+0000 7f35ad35f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35a80c2340 0x7f35a814f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49018/0 (socket says 172.21.15.192:49018) 2020-11-20T11:48:14.861 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.849+0000 7f35ad35f700 1 -- 172.21.15.192:0/2343080348 learned_addr learned my addr 172.21.15.192:0/2343080348 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:14.861 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.849+0000 7f35adb60700 1 --2- 172.21.15.192:0/2343080348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a8060370 0x7f35a80c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:14.861 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.849+0000 7f35ae361700 1 --2- 172.21.15.192:0/2343080348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35a8154920 0x7f35a81608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:14.862 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.849+0000 7f35ad35f700 1 -- 172.21.15.192:0/2343080348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a8060370 msgr2=0x7f35a80c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:14.862 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.849+0000 7f35ad35f700 1 --2- 172.21.15.192:0/2343080348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35a8060370 0x7f35a80c7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:14.862 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.849+0000 7f35ad35f700 1 -- 172.21.15.192:0/2343080348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35a8154920 msgr2=0x7f35a81608a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:14.862 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.849+0000 7f35ad35f700 1 --2- 172.21.15.192:0/2343080348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35a8154920 0x7f35a81608a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:14.862 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.849+0000 7f35ad35f700 1 -- 172.21.15.192:0/2343080348 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a81640f0 con 0x7f35a80c2340 2020-11-20T11:48:14.863 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.849+0000 7f35ae361700 1 --2- 172.21.15.192:0/2343080348 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f35a8154920 0x7f35a81608a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:48:14.863 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.849+0000 7f35ad35f700 1 --2- 172.21.15.192:0/2343080348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35a80c2340 0x7f35a814f450 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f359800eba0 tx=0x7f3598006e30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:14.863 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.849+0000 7f3595ffb700 1 -- 172.21.15.192:0/2343080348 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359800c850 con 0x7f35a80c2340 2020-11-20T11:48:14.863 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.849+0000 7f3595ffb700 1 -- 172.21.15.192:0/2343080348 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359800c9b0 con 0x7f35a80c2340 2020-11-20T11:48:14.863 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.849+0000 7f35afdc4700 1 -- 172.21.15.192:0/2343080348 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a8164390 con 0x7f35a80c2340 2020-11-20T11:48:14.864 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.849+0000 7f3595ffb700 1 -- 172.21.15.192:0/2343080348 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359800cd30 con 0x7f35a80c2340 2020-11-20T11:48:14.864 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.850+0000 7f35afdc4700 1 -- 172.21.15.192:0/2343080348 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a8157220 con 0x7f35a80c2340 2020-11-20T11:48:14.864 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.850+0000 7f35afdc4700 1 -- 172.21.15.192:0/2343080348 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f35a80699a0 con 0x7f35a80c2340 2020-11-20T11:48:14.864 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.851+0000 7f3595ffb700 1 -- 172.21.15.192:0/2343080348 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f3598012600 con 0x7f35a80c2340 2020-11-20T11:48:14.864 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.851+0000 7f3595ffb700 1 --2- 172.21.15.192:0/2343080348 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3580080670 0x7f3580082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:14.865 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.852+0000 7f35adb60700 1 --2- 172.21.15.192:0/2343080348 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3580080670 0x7f3580082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:14.865 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.852+0000 7f3595ffb700 1 -- 172.21.15.192:0/2343080348 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f35980a2d10 con 0x7f35a80c2340 2020-11-20T11:48:14.865 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.852+0000 7f3595ffb700 1 --2- 172.21.15.192:0/2343080348 >> [v2:172.21.15.192:6826/23242,v1:172.21.15.192:6827/23242] conn(0x7f35800893a0 0x7f358008b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:14.865 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.852+0000 7f3595ffb700 1 -- 172.21.15.192:0/2343080348 --> [v2:172.21.15.192:6826/23242,v1:172.21.15.192:6827/23242] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f358008be20 con 0x7f35800893a0 2020-11-20T11:48:14.865 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.852+0000 7f3595ffb700 1 -- 172.21.15.192:0/2343080348 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35980a52f0 con 0x7f35a80c2340 2020-11-20T11:48:14.866 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.852+0000 7f35adb60700 1 --2- 172.21.15.192:0/2343080348 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3580080670 0x7f3580082b30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f35a4006f30 tx=0x7f35a4016000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:14.866 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.852+0000 7f35ae361700 1 --2- 172.21.15.192:0/2343080348 >> [v2:172.21.15.192:6826/23242,v1:172.21.15.192:6827/23242] conn(0x7f35800893a0 0x7f358008b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:14.866 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.852+0000 7f35ae361700 1 --2- 172.21.15.192:0/2343080348 >> [v2:172.21.15.192:6826/23242,v1:172.21.15.192:6827/23242] conn(0x7f35800893a0 0x7f358008b7c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:14.866 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.853+0000 7f3595ffb700 1 -- 172.21.15.192:0/2343080348 <== osd.0 v2:172.21.15.192:6826/23242 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f358008be20 con 0x7f35800893a0 2020-11-20T11:48:14.870 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.867+0000 7f35afdc4700 1 -- 172.21.15.192:0/2343080348 --> [v2:172.21.15.192:6826/23242,v1:172.21.15.192:6827/23242] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f35a814fbe0 con 0x7f35800893a0 2020-11-20T11:48:14.871 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.867+0000 7f3595ffb700 1 -- 172.21.15.192:0/2343080348 <== osd.0 v2:172.21.15.192:6826/23242 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f35a814fbe0 con 0x7f35800893a0 2020-11-20T11:48:14.871 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.867+0000 7f35afdc4700 1 -- 172.21.15.192:0/2343080348 >> [v2:172.21.15.192:6826/23242,v1:172.21.15.192:6827/23242] conn(0x7f35800893a0 msgr2=0x7f358008b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:14.872 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.867+0000 7f35afdc4700 1 --2- 172.21.15.192:0/2343080348 >> [v2:172.21.15.192:6826/23242,v1:172.21.15.192:6827/23242] conn(0x7f35800893a0 0x7f358008b7c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:14.872 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.867+0000 7f35afdc4700 1 -- 172.21.15.192:0/2343080348 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3580080670 msgr2=0x7f3580082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:14.872 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.867+0000 7f35afdc4700 1 --2- 172.21.15.192:0/2343080348 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3580080670 0x7f3580082b30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f35a4006f30 tx=0x7f35a4016000).stop 2020-11-20T11:48:14.872 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.867+0000 7f35afdc4700 1 -- 172.21.15.192:0/2343080348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35a80c2340 msgr2=0x7f35a814f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:14.872 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.867+0000 7f35afdc4700 1 --2- 172.21.15.192:0/2343080348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35a80c2340 0x7f35a814f450 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f359800eba0 tx=0x7f3598006e30).stop 2020-11-20T11:48:14.873 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.867+0000 7f35ae361700 1 -- 172.21.15.192:0/2343080348 reap_dead start 2020-11-20T11:48:14.873 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.867+0000 7f35afdc4700 1 -- 172.21.15.192:0/2343080348 shutdown_connections 2020-11-20T11:48:14.873 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.867+0000 7f35afdc4700 1 -- 172.21.15.192:0/2343080348 >> 172.21.15.192:0/2343080348 conn(0x7f35a8062100 msgr2=0x7f35a8154d90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:14.873 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.868+0000 7f35afdc4700 1 -- 172.21.15.192:0/2343080348 shutdown_connections 2020-11-20T11:48:14.873 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.868+0000 7f35afdc4700 1 -- 172.21.15.192:0/2343080348 wait complete. 2020-11-20T11:48:14.881 INFO:teuthology.orchestra.run.smithi192.stdout:73014444037 2020-11-20T11:48:14.882 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2020-11-20T11:48:14.991 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.988+0000 7fb7d1066700 1 Processor -- start 2020-11-20T11:48:14.991 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.988+0000 7fb7d1066700 1 -- start start 2020-11-20T11:48:14.994 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.989+0000 7fb7d1066700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb7cc060370 0x7fb7cc060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:14.994 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.989+0000 7fb7d1066700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7cc151e80 con 0x7fb7cc064c40 2020-11-20T11:48:14.994 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.989+0000 7fb7d1066700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7cc152120 con 0x7fb7cc154920 2020-11-20T11:48:14.994 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.989+0000 7fb7d1066700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7cc064260 con 0x7fb7cc060370 2020-11-20T11:48:14.994 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.989+0000 7fb7cb59e700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fb7cc064c40 0x7fb7cc151340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.192:38414/0 (socket says 172.21.15.192:38414) 2020-11-20T11:48:14.995 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.989+0000 7fb7cb59e700 1 -- 172.21.15.192:0/2309837656 learned_addr learned my addr 172.21.15.192:0/2309837656 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:14.995 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.989+0000 7fb7cad9d700 1 --2- 172.21.15.192:0/2309837656 >> v2:172.21.15.146:3300/0 conn(0x7fb7cc060370 0x7fb7cc060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:14.995 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.989+0000 7fb7ca59c700 1 -- 172.21.15.192:0/2309837656 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3929821710 0 0) 0x7fb7cc151e80 con 0x7fb7cc064c40 2020-11-20T11:48:14.995 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.989+0000 7fb7ca59c700 1 -- 172.21.15.192:0/2309837656 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7ac003280 con 0x7fb7cc064c40 2020-11-20T11:48:14.996 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.989+0000 7fb7cad9d700 1 -- 172.21.15.192:0/2309837656 >> v1:172.21.15.146:6789/0 conn(0x7fb7cc154920 legacy=0x7fb7cc0c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:14.996 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.989+0000 7fb7cad9d700 1 -- 172.21.15.192:0/2309837656 >> v1:172.21.15.87:6789/0 conn(0x7fb7cc064c40 legacy=0x7fb7cc151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:14.996 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.989+0000 7fb7ca59c700 1 -- 172.21.15.192:0/2309837656 <== mon.0 v1:172.21.15.87:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1380198352 0 0) 0x7fb7ac003280 con 0x7fb7cc064c40 2020-11-20T11:48:14.996 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.990+0000 7fb7cad9d700 1 -- 172.21.15.192:0/2309837656 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7cc064500 con 0x7fb7cc060370 2020-11-20T11:48:14.996 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.990+0000 7fb7cad9d700 1 --2- 172.21.15.192:0/2309837656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7cc060370 0x7fb7cc060750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fb7bc006fd0 tx=0x7fb7bc006e30).ready entity=mon.1 client_cookie=765b2cebde5981de server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:14.997 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.990+0000 7fb7ca59c700 1 -- 172.21.15.192:0/2309837656 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc00bec0 con 0x7fb7cc060370 2020-11-20T11:48:14.997 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.990+0000 7fb7ca59c700 1 -- 172.21.15.192:0/2309837656 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7bc000e90 con 0x7fb7cc060370 2020-11-20T11:48:14.997 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.990+0000 7fb7ca59c700 1 -- 172.21.15.192:0/2309837656 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc009a80 con 0x7fb7cc060370 2020-11-20T11:48:14.997 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.990+0000 7fb7d1066700 1 -- 172.21.15.192:0/2309837656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7cc060370 msgr2=0x7fb7cc060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:14.997 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.990+0000 7fb7d1066700 1 --2- 172.21.15.192:0/2309837656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7cc060370 0x7fb7cc060750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fb7bc006fd0 tx=0x7fb7bc006e30).stop 2020-11-20T11:48:14.998 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.990+0000 7fb7d1066700 1 -- 172.21.15.192:0/2309837656 shutdown_connections 2020-11-20T11:48:14.998 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.990+0000 7fb7d1066700 1 --2- 172.21.15.192:0/2309837656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7cc060370 0x7fb7cc060750 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:14.998 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.990+0000 7fb7d1066700 1 -- 172.21.15.192:0/2309837656 >> 172.21.15.192:0/2309837656 conn(0x7fb7cc062100 msgr2=0x7fb7cc0c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:15.000 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.990+0000 7fb7d1066700 1 -- 172.21.15.192:0/2309837656 shutdown_connections 2020-11-20T11:48:15.000 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.990+0000 7fb7d1066700 1 -- 172.21.15.192:0/2309837656 wait complete. 2020-11-20T11:48:15.003 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.991+0000 7fb7d1066700 1 Processor -- start 2020-11-20T11:48:15.003 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.991+0000 7fb7d1066700 1 -- start start 2020-11-20T11:48:15.003 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.992+0000 7fb7d1066700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7cc060370 0x7fb7cc164840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.004 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.992+0000 7fb7d1066700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7cc064c40 0x7fb7cc152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.004 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.992+0000 7fb7d1066700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7cc154920 0x7fb7cc155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.004 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.992+0000 7fb7d1066700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc164d30 con 0x7fb7cc064c40 2020-11-20T11:48:15.004 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.992+0000 7fb7d1066700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc155b30 con 0x7fb7cc154920 2020-11-20T11:48:15.005 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.992+0000 7fb7d1066700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc0c0420 con 0x7fb7cc060370 2020-11-20T11:48:15.005 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.992+0000 7fb7cad9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7cc060370 0x7fb7cc164840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.005 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.992+0000 7fb7cad9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7cc060370 0x7fb7cc164840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49032/0 (socket says 172.21.15.192:49032) 2020-11-20T11:48:15.006 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.992+0000 7fb7cad9d700 1 -- 172.21.15.192:0/2031563545 learned_addr learned my addr 172.21.15.192:0/2031563545 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:15.006 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.992+0000 7fb7cb59e700 1 --2- 172.21.15.192:0/2031563545 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7cc154920 0x7fb7cc155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.006 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.992+0000 7fb7c3fff700 1 --2- 172.21.15.192:0/2031563545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7cc064c40 0x7fb7cc152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.006 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.993+0000 7fb7cad9d700 1 -- 172.21.15.192:0/2031563545 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7cc154920 msgr2=0x7fb7cc155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.007 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.993+0000 7fb7cad9d700 1 --2- 172.21.15.192:0/2031563545 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7cc154920 0x7fb7cc155e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:15.007 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.993+0000 7fb7cad9d700 1 -- 172.21.15.192:0/2031563545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7cc064c40 msgr2=0x7fb7cc152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.007 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.993+0000 7fb7cad9d700 1 --2- 172.21.15.192:0/2031563545 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb7cc064c40 0x7fb7cc152b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:15.007 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.993+0000 7fb7cad9d700 1 -- 172.21.15.192:0/2031563545 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7cc0c06c0 con 0x7fb7cc060370 2020-11-20T11:48:15.007 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.993+0000 7fb7cad9d700 1 --2- 172.21.15.192:0/2031563545 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7cc060370 0x7fb7cc164840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fb7bc009340 tx=0x7fb7bc015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:15.008 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.993+0000 7fb7c2ffd700 1 -- 172.21.15.192:0/2031563545 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc011cc0 con 0x7fb7cc060370 2020-11-20T11:48:15.008 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.993+0000 7fb7c2ffd700 1 -- 172.21.15.192:0/2031563545 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7bc011e20 con 0x7fb7cc060370 2020-11-20T11:48:15.008 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.993+0000 7fb7d1066700 1 -- 172.21.15.192:0/2031563545 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7cc0c0960 con 0x7fb7cc060370 2020-11-20T11:48:15.008 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.993+0000 7fb7c2ffd700 1 -- 172.21.15.192:0/2031563545 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc01e690 con 0x7fb7cc060370 2020-11-20T11:48:15.009 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.993+0000 7fb7d1066700 1 -- 172.21.15.192:0/2031563545 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7cc0c0ea0 con 0x7fb7cc060370 2020-11-20T11:48:15.009 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.994+0000 7fb7d1066700 1 -- 172.21.15.192:0/2031563545 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb7cc0699a0 con 0x7fb7cc060370 2020-11-20T11:48:15.009 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.994+0000 7fb7c2ffd700 1 -- 172.21.15.192:0/2031563545 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fb7bc025030 con 0x7fb7cc060370 2020-11-20T11:48:15.009 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.995+0000 7fb7c2ffd700 1 --2- 172.21.15.192:0/2031563545 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fb7a8080670 0x7fb7a8082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.010 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.995+0000 7fb7c2ffd700 1 -- 172.21.15.192:0/2031563545 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fb7bc0a4020 con 0x7fb7cc060370 2020-11-20T11:48:15.010 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.995+0000 7fb7c3fff700 1 --2- 172.21.15.192:0/2031563545 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fb7a8080670 0x7fb7a8082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.010 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.995+0000 7fb7c2ffd700 1 --2- 172.21.15.192:0/2031563545 >> [v2:172.21.15.146:6800/22856,v1:172.21.15.146:6801/22856] conn(0x7fb7a80893a0 0x7fb7a808b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.010 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.995+0000 7fb7c2ffd700 1 -- 172.21.15.192:0/2031563545 --> [v2:172.21.15.146:6800/22856,v1:172.21.15.146:6801/22856] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb7a808be20 con 0x7fb7a80893a0 2020-11-20T11:48:15.010 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.995+0000 7fb7c2ffd700 1 -- 172.21.15.192:0/2031563545 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7bc0a6690 con 0x7fb7cc060370 2020-11-20T11:48:15.011 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.995+0000 7fb7c3fff700 1 --2- 172.21.15.192:0/2031563545 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fb7a8080670 0x7fb7a8082b30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fb7cc0be300 tx=0x7fb7b4009040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:15.011 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.995+0000 7fb7cb59e700 1 --2- 172.21.15.192:0/2031563545 >> [v2:172.21.15.146:6800/22856,v1:172.21.15.146:6801/22856] conn(0x7fb7a80893a0 0x7fb7a808b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.011 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.996+0000 7fb7cb59e700 1 --2- 172.21.15.192:0/2031563545 >> [v2:172.21.15.146:6800/22856,v1:172.21.15.146:6801/22856] conn(0x7fb7a80893a0 0x7fb7a808b7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:15.011 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:14.997+0000 7fb7c2ffd700 1 -- 172.21.15.192:0/2031563545 <== osd.1 v2:172.21.15.146:6800/22856 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7fb7a808be20 con 0x7fb7a80893a0 2020-11-20T11:48:15.013 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.010+0000 7fb7d1066700 1 -- 172.21.15.192:0/2031563545 --> [v2:172.21.15.146:6800/22856,v1:172.21.15.146:6801/22856] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb7cc05ca80 con 0x7fb7a80893a0 2020-11-20T11:48:15.015 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.011+0000 7fb7c2ffd700 1 -- 172.21.15.192:0/2031563545 <== osd.1 v2:172.21.15.146:6800/22856 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb7cc05ca80 con 0x7fb7a80893a0 2020-11-20T11:48:15.015 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.011+0000 7fb7d1066700 1 -- 172.21.15.192:0/2031563545 >> [v2:172.21.15.146:6800/22856,v1:172.21.15.146:6801/22856] conn(0x7fb7a80893a0 msgr2=0x7fb7a808b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.015 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.011+0000 7fb7d1066700 1 --2- 172.21.15.192:0/2031563545 >> [v2:172.21.15.146:6800/22856,v1:172.21.15.146:6801/22856] conn(0x7fb7a80893a0 0x7fb7a808b7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:15.015 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.011+0000 7fb7d1066700 1 -- 172.21.15.192:0/2031563545 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fb7a8080670 msgr2=0x7fb7a8082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.016 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.011+0000 7fb7d1066700 1 --2- 172.21.15.192:0/2031563545 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fb7a8080670 0x7fb7a8082b30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fb7cc0be300 tx=0x7fb7b4009040).stop 2020-11-20T11:48:15.016 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.011+0000 7fb7d1066700 1 -- 172.21.15.192:0/2031563545 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7cc060370 msgr2=0x7fb7cc164840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.016 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.011+0000 7fb7d1066700 1 --2- 172.21.15.192:0/2031563545 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7cc060370 0x7fb7cc164840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fb7bc009340 tx=0x7fb7bc015000).stop 2020-11-20T11:48:15.016 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.011+0000 7fb7cb59e700 1 -- 172.21.15.192:0/2031563545 reap_dead start 2020-11-20T11:48:15.017 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.011+0000 7fb7d1066700 1 -- 172.21.15.192:0/2031563545 shutdown_connections 2020-11-20T11:48:15.017 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.011+0000 7fb7d1066700 1 -- 172.21.15.192:0/2031563545 >> 172.21.15.192:0/2031563545 conn(0x7fb7cc062100 msgr2=0x7fb7cc0c40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:15.017 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.011+0000 7fb7d1066700 1 -- 172.21.15.192:0/2031563545 shutdown_connections 2020-11-20T11:48:15.018 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.011+0000 7fb7d1066700 1 -- 172.21.15.192:0/2031563545 wait complete. 2020-11-20T11:48:15.026 INFO:teuthology.orchestra.run.smithi192.stdout:73014444037 2020-11-20T11:48:15.027 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2020-11-20T11:48:15.136 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.133+0000 7f9c41627700 1 Processor -- start 2020-11-20T11:48:15.137 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.133+0000 7f9c41627700 1 -- start start 2020-11-20T11:48:15.139 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.134+0000 7f9c41627700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9c3c060370 0x7f9c3c060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.139 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.134+0000 7f9c41627700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9c3c064c40 0x7f9c3c151340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.139 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.134+0000 7f9c41627700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c3c151e80 con 0x7f9c3c154920 2020-11-20T11:48:15.140 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.134+0000 7f9c41627700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c3c152120 con 0x7f9c3c064c40 2020-11-20T11:48:15.140 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.134+0000 7f9c41627700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c3c064260 con 0x7f9c3c060370 2020-11-20T11:48:15.140 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.134+0000 7f9c3affd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9c3c060370 0x7f9c3c060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.140 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.134+0000 7f9c33fff700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f9c3c154920 0x7f9c3c0c2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51710/0 (socket says 172.21.15.192:51710) 2020-11-20T11:48:15.140 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.134+0000 7f9c33fff700 1 -- 172.21.15.192:0/4137063537 learned_addr learned my addr 172.21.15.192:0/4137063537 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:15.141 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.135+0000 7f9c3b7fe700 1 --2- 172.21.15.192:0/4137063537 >> v2:172.21.15.146:3300/0 conn(0x7f9c3c064c40 0x7f9c3c151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.141 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.135+0000 7f9c3affd700 1 -- 172.21.15.192:0/4137063537 >> v2:172.21.15.146:3300/0 conn(0x7f9c3c064c40 msgr2=0x7f9c3c151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:15.141 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.135+0000 7f9c3affd700 1 --2- 172.21.15.192:0/4137063537 >> v2:172.21.15.146:3300/0 conn(0x7f9c3c064c40 0x7f9c3c151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:15.141 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.135+0000 7f9c3affd700 1 -- 172.21.15.192:0/4137063537 >> v1:172.21.15.192:6789/0 conn(0x7f9c3c154920 legacy=0x7f9c3c0c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.141 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.135+0000 7f9c3a7fc700 1 -- 172.21.15.192:0/4137063537 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1594933707 0 0) 0x7f9c3c151e80 con 0x7f9c3c154920 2020-11-20T11:48:15.142 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.135+0000 7f9c3affd700 1 -- 172.21.15.192:0/4137063537 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3c064500 con 0x7f9c3c060370 2020-11-20T11:48:15.142 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.135+0000 7f9c3b7fe700 1 --2- 172.21.15.192:0/4137063537 >> v2:172.21.15.146:3300/0 conn(0x7f9c3c064c40 0x7f9c3c151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:48:15.142 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.135+0000 7f9c3affd700 1 --2- 172.21.15.192:0/4137063537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c3c060370 0x7f9c3c060750 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f9c3c0c5450 tx=0x7f9c2c006e30).ready entity=mon.2 client_cookie=6ea7ed89eb1a01a4 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:15.142 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.135+0000 7f9c3a7fc700 1 -- 172.21.15.192:0/4137063537 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c009840 con 0x7f9c3c060370 2020-11-20T11:48:15.142 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.135+0000 7f9c3a7fc700 1 -- 172.21.15.192:0/4137063537 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2c000e90 con 0x7f9c3c060370 2020-11-20T11:48:15.143 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.135+0000 7f9c3a7fc700 1 -- 172.21.15.192:0/4137063537 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c009bb0 con 0x7f9c3c060370 2020-11-20T11:48:15.143 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.135+0000 7f9c41627700 1 -- 172.21.15.192:0/4137063537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c3c060370 msgr2=0x7f9c3c060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.143 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.135+0000 7f9c41627700 1 --2- 172.21.15.192:0/4137063537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c3c060370 0x7f9c3c060750 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f9c3c0c5450 tx=0x7f9c2c006e30).stop 2020-11-20T11:48:15.143 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.135+0000 7f9c41627700 1 -- 172.21.15.192:0/4137063537 shutdown_connections 2020-11-20T11:48:15.143 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.135+0000 7f9c41627700 1 --2- 172.21.15.192:0/4137063537 >> v2:172.21.15.146:3300/0 conn(0x7f9c3c064c40 0x7f9c3c151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:15.144 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.135+0000 7f9c41627700 1 --2- 172.21.15.192:0/4137063537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c3c060370 0x7f9c3c060750 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:15.144 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.135+0000 7f9c41627700 1 -- 172.21.15.192:0/4137063537 >> 172.21.15.192:0/4137063537 conn(0x7f9c3c062100 msgr2=0x7f9c3c0c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:15.144 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.135+0000 7f9c41627700 1 -- 172.21.15.192:0/4137063537 shutdown_connections 2020-11-20T11:48:15.144 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.135+0000 7f9c41627700 1 -- 172.21.15.192:0/4137063537 wait complete. 2020-11-20T11:48:15.147 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.136+0000 7f9c41627700 1 Processor -- start 2020-11-20T11:48:15.147 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.137+0000 7f9c41627700 1 -- start start 2020-11-20T11:48:15.148 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.137+0000 7f9c41627700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c3c060370 0x7f9c3c0b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.148 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.137+0000 7f9c41627700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c3c064c40 0x7f9c3c161060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.148 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.137+0000 7f9c41627700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c3c154920 0x7f9c3c153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.148 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.137+0000 7f9c41627700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c158950 con 0x7f9c3c154920 2020-11-20T11:48:15.148 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.137+0000 7f9c41627700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c1532a0 con 0x7f9c3c064c40 2020-11-20T11:48:15.149 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.137+0000 7f9c41627700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c1534d0 con 0x7f9c3c060370 2020-11-20T11:48:15.149 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.137+0000 7f9c3affd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c3c060370 0x7f9c3c0b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.149 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.137+0000 7f9c3affd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c3c060370 0x7f9c3c0b0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49048/0 (socket says 172.21.15.192:49048) 2020-11-20T11:48:15.149 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.137+0000 7f9c3affd700 1 -- 172.21.15.192:0/3803979931 learned_addr learned my addr 172.21.15.192:0/3803979931 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:15.149 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.138+0000 7f9c33fff700 1 --2- 172.21.15.192:0/3803979931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c3c064c40 0x7f9c3c161060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.150 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.138+0000 7f9c3affd700 1 -- 172.21.15.192:0/3803979931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c3c064c40 msgr2=0x7f9c3c161060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.150 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.138+0000 7f9c3affd700 1 --2- 172.21.15.192:0/3803979931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c3c064c40 0x7f9c3c161060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:15.150 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.138+0000 7f9c3affd700 1 -- 172.21.15.192:0/3803979931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c3c154920 msgr2=0x7f9c3c153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.150 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.138+0000 7f9c3affd700 1 --2- 172.21.15.192:0/3803979931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9c3c154920 0x7f9c3c153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:48:15.150 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.138+0000 7f9c3affd700 1 -- 172.21.15.192:0/3803979931 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3c153770 con 0x7f9c3c060370 2020-11-20T11:48:15.151 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.138+0000 7f9c33fff700 1 --2- 172.21.15.192:0/3803979931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c3c064c40 0x7f9c3c161060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:48:15.151 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.138+0000 7f9c3affd700 1 --2- 172.21.15.192:0/3803979931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c3c060370 0x7f9c3c0b0340 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f9c2c006fd0 tx=0x7f9c2c015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:15.151 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.138+0000 7f9c32ffd700 1 -- 172.21.15.192:0/3803979931 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c011cf0 con 0x7f9c3c060370 2020-11-20T11:48:15.151 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.138+0000 7f9c32ffd700 1 -- 172.21.15.192:0/3803979931 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2c011e50 con 0x7f9c3c060370 2020-11-20T11:48:15.151 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.138+0000 7f9c41627700 1 -- 172.21.15.192:0/3803979931 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c3c1559e0 con 0x7f9c3c060370 2020-11-20T11:48:15.152 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.138+0000 7f9c32ffd700 1 -- 172.21.15.192:0/3803979931 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c01e690 con 0x7f9c3c060370 2020-11-20T11:48:15.152 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.138+0000 7f9c41627700 1 -- 172.21.15.192:0/3803979931 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c3c155f20 con 0x7f9c3c060370 2020-11-20T11:48:15.152 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.139+0000 7f9c41627700 1 -- 172.21.15.192:0/3803979931 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9c3c0699a0 con 0x7f9c3c060370 2020-11-20T11:48:15.152 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.139+0000 7f9c32ffd700 1 -- 172.21.15.192:0/3803979931 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f9c2c025030 con 0x7f9c3c060370 2020-11-20T11:48:15.152 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.140+0000 7f9c32ffd700 1 --2- 172.21.15.192:0/3803979931 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f9c18080670 0x7f9c18082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.153 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.140+0000 7f9c32ffd700 1 -- 172.21.15.192:0/3803979931 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f9c2c0a3f50 con 0x7f9c3c060370 2020-11-20T11:48:15.153 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.140+0000 7f9c33fff700 1 --2- 172.21.15.192:0/3803979931 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f9c18080670 0x7f9c18082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.153 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.140+0000 7f9c32ffd700 1 --2- 172.21.15.192:0/3803979931 >> [v2:172.21.15.87:6815/23326,v1:172.21.15.87:6817/23326] conn(0x7f9c180893a0 0x7f9c1808b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.153 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.140+0000 7f9c32ffd700 1 -- 172.21.15.192:0/3803979931 --> [v2:172.21.15.87:6815/23326,v1:172.21.15.87:6817/23326] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9c1808be20 con 0x7f9c180893a0 2020-11-20T11:48:15.154 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.140+0000 7f9c32ffd700 1 -- 172.21.15.192:0/3803979931 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c2c0a64b0 con 0x7f9c3c060370 2020-11-20T11:48:15.154 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.140+0000 7f9c33fff700 1 --2- 172.21.15.192:0/3803979931 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f9c18080670 0x7f9c18082b30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f9c3c14f3a0 tx=0x7f9c24009040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:15.154 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.141+0000 7f9c3b7fe700 1 --2- 172.21.15.192:0/3803979931 >> [v2:172.21.15.87:6815/23326,v1:172.21.15.87:6817/23326] conn(0x7f9c180893a0 0x7f9c1808b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.154 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.141+0000 7f9c3b7fe700 1 --2- 172.21.15.192:0/3803979931 >> [v2:172.21.15.87:6815/23326,v1:172.21.15.87:6817/23326] conn(0x7f9c180893a0 0x7f9c1808b7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:15.154 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.142+0000 7f9c32ffd700 1 -- 172.21.15.192:0/3803979931 <== osd.2 v2:172.21.15.87:6815/23326 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f9c1808be20 con 0x7f9c180893a0 2020-11-20T11:48:15.159 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.156+0000 7f9c41627700 1 -- 172.21.15.192:0/3803979931 --> [v2:172.21.15.87:6815/23326,v1:172.21.15.87:6817/23326] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9c3c05ca80 con 0x7f9c180893a0 2020-11-20T11:48:15.161 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.157+0000 7f9c32ffd700 1 -- 172.21.15.192:0/3803979931 <== osd.2 v2:172.21.15.87:6815/23326 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9c3c05ca80 con 0x7f9c180893a0 2020-11-20T11:48:15.161 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.157+0000 7f9c41627700 1 -- 172.21.15.192:0/3803979931 >> [v2:172.21.15.87:6815/23326,v1:172.21.15.87:6817/23326] conn(0x7f9c180893a0 msgr2=0x7f9c1808b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.161 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.157+0000 7f9c41627700 1 --2- 172.21.15.192:0/3803979931 >> [v2:172.21.15.87:6815/23326,v1:172.21.15.87:6817/23326] conn(0x7f9c180893a0 0x7f9c1808b7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:15.161 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.157+0000 7f9c41627700 1 -- 172.21.15.192:0/3803979931 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f9c18080670 msgr2=0x7f9c18082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.162 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.157+0000 7f9c41627700 1 --2- 172.21.15.192:0/3803979931 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f9c18080670 0x7f9c18082b30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f9c3c14f3a0 tx=0x7f9c24009040).stop 2020-11-20T11:48:15.162 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.157+0000 7f9c41627700 1 -- 172.21.15.192:0/3803979931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c3c060370 msgr2=0x7f9c3c0b0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.162 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.157+0000 7f9c41627700 1 --2- 172.21.15.192:0/3803979931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c3c060370 0x7f9c3c0b0340 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f9c2c006fd0 tx=0x7f9c2c015000).stop 2020-11-20T11:48:15.162 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.157+0000 7f9c3b7fe700 1 -- 172.21.15.192:0/3803979931 reap_dead start 2020-11-20T11:48:15.162 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.157+0000 7f9c41627700 1 -- 172.21.15.192:0/3803979931 shutdown_connections 2020-11-20T11:48:15.163 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.157+0000 7f9c41627700 1 -- 172.21.15.192:0/3803979931 >> 172.21.15.192:0/3803979931 conn(0x7f9c3c062100 msgr2=0x7f9c3c0c4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:15.163 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.158+0000 7f9c41627700 1 -- 172.21.15.192:0/3803979931 shutdown_connections 2020-11-20T11:48:15.163 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.158+0000 7f9c41627700 1 -- 172.21.15.192:0/3803979931 wait complete. 2020-11-20T11:48:15.171 INFO:teuthology.orchestra.run.smithi192.stdout:73014444037 2020-11-20T11:48:15.172 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2020-11-20T11:48:15.281 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.278+0000 7f0f035a7700 1 Processor -- start 2020-11-20T11:48:15.282 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.278+0000 7f0f035a7700 1 -- start start 2020-11-20T11:48:15.284 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.279+0000 7f0f035a7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0efc060370 0x7f0efc060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.285 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.279+0000 7f0f035a7700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0efc064c40 0x7f0efc151340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.285 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.279+0000 7f0f035a7700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0efc151e80 con 0x7f0efc154920 2020-11-20T11:48:15.285 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.279+0000 7f0f035a7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0efc152120 con 0x7f0efc060370 2020-11-20T11:48:15.285 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.279+0000 7f0f035a7700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0efc064260 con 0x7f0efc064c40 2020-11-20T11:48:15.285 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.279+0000 7f0f01b44700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0efc064c40 0x7f0efc151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.286 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.279+0000 7f0f01b44700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0efc064c40 0x7f0efc151340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49058/0 (socket says 172.21.15.192:49058) 2020-11-20T11:48:15.286 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.279+0000 7f0f01b44700 1 -- 172.21.15.192:0/3232585262 learned_addr learned my addr 172.21.15.192:0/3232585262 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:15.286 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.279+0000 7f0f01343700 1 --2- 172.21.15.192:0/3232585262 >> v2:172.21.15.146:3300/0 conn(0x7f0efc060370 0x7f0efc060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.286 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.279+0000 7f0f01b44700 1 -- 172.21.15.192:0/3232585262 >> v2:172.21.15.146:3300/0 conn(0x7f0efc060370 msgr2=0x7f0efc060750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:15.287 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.279+0000 7f0f01b44700 1 --2- 172.21.15.192:0/3232585262 >> v2:172.21.15.146:3300/0 conn(0x7f0efc060370 0x7f0efc060750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:15.287 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.279+0000 7f0f01b44700 1 -- 172.21.15.192:0/3232585262 >> v1:172.21.15.146:6789/0 conn(0x7f0efc154920 legacy=0x7f0efc0c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:15.287 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.279+0000 7f0f01b44700 1 -- 172.21.15.192:0/3232585262 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0efc064500 con 0x7f0efc064c40 2020-11-20T11:48:15.287 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.280+0000 7f0f01343700 1 --2- 172.21.15.192:0/3232585262 >> v2:172.21.15.146:3300/0 conn(0x7f0efc060370 0x7f0efc060750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:48:15.287 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.280+0000 7f0f01b44700 1 --2- 172.21.15.192:0/3232585262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0efc064c40 0x7f0efc151340 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f0efc065700 tx=0x7f0ef40092d0).ready entity=mon.2 client_cookie=dd25b5dfb8fba615 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:15.288 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.280+0000 7f0eebfff700 1 -- 172.21.15.192:0/3232585262 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef400bc40 con 0x7f0efc064c40 2020-11-20T11:48:15.288 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.280+0000 7f0eebfff700 1 -- 172.21.15.192:0/3232585262 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef400bda0 con 0x7f0efc064c40 2020-11-20T11:48:15.288 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.280+0000 7f0eebfff700 1 -- 172.21.15.192:0/3232585262 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef4011610 con 0x7f0efc064c40 2020-11-20T11:48:15.288 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.280+0000 7f0f035a7700 1 -- 172.21.15.192:0/3232585262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0efc064c40 msgr2=0x7f0efc151340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.289 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.280+0000 7f0f035a7700 1 --2- 172.21.15.192:0/3232585262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0efc064c40 0x7f0efc151340 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f0efc065700 tx=0x7f0ef40092d0).stop 2020-11-20T11:48:15.289 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.280+0000 7f0f035a7700 1 -- 172.21.15.192:0/3232585262 shutdown_connections 2020-11-20T11:48:15.289 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.280+0000 7f0f035a7700 1 --2- 172.21.15.192:0/3232585262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0efc064c40 0x7f0efc151340 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:15.289 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.280+0000 7f0f035a7700 1 --2- 172.21.15.192:0/3232585262 >> v2:172.21.15.146:3300/0 conn(0x7f0efc060370 0x7f0efc060750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:15.290 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.280+0000 7f0f035a7700 1 -- 172.21.15.192:0/3232585262 >> 172.21.15.192:0/3232585262 conn(0x7f0efc062100 msgr2=0x7f0efc0c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:15.290 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.280+0000 7f0f035a7700 1 -- 172.21.15.192:0/3232585262 shutdown_connections 2020-11-20T11:48:15.290 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.280+0000 7f0f035a7700 1 -- 172.21.15.192:0/3232585262 wait complete. 2020-11-20T11:48:15.290 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.281+0000 7f0f035a7700 1 Processor -- start 2020-11-20T11:48:15.290 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.281+0000 7f0f035a7700 1 -- start start 2020-11-20T11:48:15.293 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.282+0000 7f0f035a7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0efc060370 0x7f0efc1542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.294 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.282+0000 7f0f035a7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0efc064c40 0x7f0efc14baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.294 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.282+0000 7f0f035a7700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0efc154920 0x7f0efc0bf940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.294 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.282+0000 7f0f035a7700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0efc164cb0 con 0x7f0efc154920 2020-11-20T11:48:15.294 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.282+0000 7f0f035a7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0efc14ae20 con 0x7f0efc064c40 2020-11-20T11:48:15.295 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.282+0000 7f0f035a7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0efc14b0c0 con 0x7f0efc060370 2020-11-20T11:48:15.295 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.282+0000 7f0f01343700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0efc060370 0x7f0efc1542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.295 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.282+0000 7f0f01343700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0efc060370 0x7f0efc1542f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49062/0 (socket says 172.21.15.192:49062) 2020-11-20T11:48:15.295 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.282+0000 7f0f01343700 1 -- 172.21.15.192:0/2993602120 learned_addr learned my addr 172.21.15.192:0/2993602120 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:15.296 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.282+0000 7f0f00b42700 1 --2- 172.21.15.192:0/2993602120 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0efc064c40 0x7f0efc14baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.296 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.283+0000 7f0f01b44700 1 --2- 172.21.15.192:0/2993602120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0efc154920 0x7f0efc0bf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.296 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.283+0000 7f0f01343700 1 -- 172.21.15.192:0/2993602120 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0efc064c40 msgr2=0x7f0efc14baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.296 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.283+0000 7f0f01343700 1 --2- 172.21.15.192:0/2993602120 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0efc064c40 0x7f0efc14baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:15.296 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.283+0000 7f0f01343700 1 -- 172.21.15.192:0/2993602120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0efc154920 msgr2=0x7f0efc0bf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.297 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.283+0000 7f0f01343700 1 --2- 172.21.15.192:0/2993602120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0efc154920 0x7f0efc0bf940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:15.297 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.283+0000 7f0f01343700 1 -- 172.21.15.192:0/2993602120 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0efc14b360 con 0x7f0efc060370 2020-11-20T11:48:15.297 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.283+0000 7f0f01b44700 1 --2- 172.21.15.192:0/2993602120 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0efc154920 0x7f0efc0bf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:48:15.297 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.283+0000 7f0f01343700 1 --2- 172.21.15.192:0/2993602120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0efc060370 0x7f0efc1542f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f0ef800cb20 tx=0x7f0ef8008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:15.298 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.283+0000 7f0ee97fa700 1 -- 172.21.15.192:0/2993602120 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef8007740 con 0x7f0efc060370 2020-11-20T11:48:15.298 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.283+0000 7f0ee97fa700 1 -- 172.21.15.192:0/2993602120 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef80078a0 con 0x7f0efc060370 2020-11-20T11:48:15.298 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.283+0000 7f0f035a7700 1 -- 172.21.15.192:0/2993602120 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0efc14b600 con 0x7f0efc060370 2020-11-20T11:48:15.298 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.283+0000 7f0ee97fa700 1 -- 172.21.15.192:0/2993602120 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef8007c40 con 0x7f0efc060370 2020-11-20T11:48:15.298 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.283+0000 7f0f035a7700 1 -- 172.21.15.192:0/2993602120 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0efc0c0070 con 0x7f0efc060370 2020-11-20T11:48:15.299 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.284+0000 7f0f035a7700 1 -- 172.21.15.192:0/2993602120 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0efc0699a0 con 0x7f0efc060370 2020-11-20T11:48:15.299 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.285+0000 7f0ee97fa700 1 -- 172.21.15.192:0/2993602120 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f0ef8011620 con 0x7f0efc060370 2020-11-20T11:48:15.299 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.285+0000 7f0ee97fa700 1 --2- 172.21.15.192:0/2993602120 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f0ed4080670 0x7f0ed4082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.299 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.285+0000 7f0ee97fa700 1 -- 172.21.15.192:0/2993602120 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f0ef80a3310 con 0x7f0efc060370 2020-11-20T11:48:15.300 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.285+0000 7f0f00b42700 1 --2- 172.21.15.192:0/2993602120 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f0ed4080670 0x7f0ed4082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.300 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.285+0000 7f0ee97fa700 1 --2- 172.21.15.192:0/2993602120 >> [v2:172.21.15.192:6802/23243,v1:172.21.15.192:6803/23243] conn(0x7f0ed40893a0 0x7f0ed408b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.300 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.285+0000 7f0ee97fa700 1 -- 172.21.15.192:0/2993602120 --> [v2:172.21.15.192:6802/23243,v1:172.21.15.192:6803/23243] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0ed408be20 con 0x7f0ed40893a0 2020-11-20T11:48:15.300 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.285+0000 7f0ee97fa700 1 -- 172.21.15.192:0/2993602120 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ef80a3680 con 0x7f0efc060370 2020-11-20T11:48:15.300 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.285+0000 7f0f01b44700 1 --2- 172.21.15.192:0/2993602120 >> [v2:172.21.15.192:6802/23243,v1:172.21.15.192:6803/23243] conn(0x7f0ed40893a0 0x7f0ed408b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.301 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.285+0000 7f0f00b42700 1 --2- 172.21.15.192:0/2993602120 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f0ed4080670 0x7f0ed4082b30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f0efc14c010 tx=0x7f0eec007bb0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:15.301 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.286+0000 7f0f01b44700 1 --2- 172.21.15.192:0/2993602120 >> [v2:172.21.15.192:6802/23243,v1:172.21.15.192:6803/23243] conn(0x7f0ed40893a0 0x7f0ed408b7c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:15.301 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.286+0000 7f0ee97fa700 1 -- 172.21.15.192:0/2993602120 <== osd.3 v2:172.21.15.192:6802/23243 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f0ed408be20 con 0x7f0ed40893a0 2020-11-20T11:48:15.303 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.300+0000 7f0f035a7700 1 -- 172.21.15.192:0/2993602120 --> [v2:172.21.15.192:6802/23243,v1:172.21.15.192:6803/23243] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0efc061140 con 0x7f0ed40893a0 2020-11-20T11:48:15.304 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.300+0000 7f0ee97fa700 1 -- 172.21.15.192:0/2993602120 <== osd.3 v2:172.21.15.192:6802/23243 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0efc061140 con 0x7f0ed40893a0 2020-11-20T11:48:15.304 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.300+0000 7f0f035a7700 1 -- 172.21.15.192:0/2993602120 >> [v2:172.21.15.192:6802/23243,v1:172.21.15.192:6803/23243] conn(0x7f0ed40893a0 msgr2=0x7f0ed408b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.304 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.300+0000 7f0f035a7700 1 --2- 172.21.15.192:0/2993602120 >> [v2:172.21.15.192:6802/23243,v1:172.21.15.192:6803/23243] conn(0x7f0ed40893a0 0x7f0ed408b7c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:15.305 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.300+0000 7f0f035a7700 1 -- 172.21.15.192:0/2993602120 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f0ed4080670 msgr2=0x7f0ed4082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.305 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.300+0000 7f0f035a7700 1 --2- 172.21.15.192:0/2993602120 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f0ed4080670 0x7f0ed4082b30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f0efc14c010 tx=0x7f0eec007bb0).stop 2020-11-20T11:48:15.305 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.300+0000 7f0f035a7700 1 -- 172.21.15.192:0/2993602120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0efc060370 msgr2=0x7f0efc1542f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.307 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.300+0000 7f0f035a7700 1 --2- 172.21.15.192:0/2993602120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0efc060370 0x7f0efc1542f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f0ef800cb20 tx=0x7f0ef8008040).stop 2020-11-20T11:48:15.308 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.300+0000 7f0f01b44700 1 -- 172.21.15.192:0/2993602120 reap_dead start 2020-11-20T11:48:15.308 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.300+0000 7f0f035a7700 1 -- 172.21.15.192:0/2993602120 shutdown_connections 2020-11-20T11:48:15.308 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.300+0000 7f0f035a7700 1 -- 172.21.15.192:0/2993602120 >> 172.21.15.192:0/2993602120 conn(0x7f0efc062100 msgr2=0x7f0efc0c2340 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:15.308 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.301+0000 7f0f035a7700 1 -- 172.21.15.192:0/2993602120 shutdown_connections 2020-11-20T11:48:15.308 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.301+0000 7f0f035a7700 1 -- 172.21.15.192:0/2993602120 wait complete. 2020-11-20T11:48:15.314 INFO:teuthology.orchestra.run.smithi192.stdout:73014444038 2020-11-20T11:48:15.315 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2020-11-20T11:48:15.425 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.422+0000 7f0a3654b700 1 Processor -- start 2020-11-20T11:48:15.426 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.422+0000 7f0a3654b700 1 -- start start 2020-11-20T11:48:15.427 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.423+0000 7f0a3654b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0a30154920 0x7f0a30060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.428 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.423+0000 7f0a3654b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a30151e80 con 0x7f0a30064c40 2020-11-20T11:48:15.428 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.423+0000 7f0a3654b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a30152120 con 0x7f0a30060370 2020-11-20T11:48:15.428 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.423+0000 7f0a3654b700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a30064260 con 0x7f0a30154920 2020-11-20T11:48:15.428 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.423+0000 7f0a2f7fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0a30154920 0x7f0a30060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.428 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.423+0000 7f0a2f7fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0a30154920 0x7f0a30060750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49074/0 (socket says 172.21.15.192:49074) 2020-11-20T11:48:15.429 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.423+0000 7f0a2ffff700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f0a30060370 0x7f0a300c2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51740/0 (socket says 172.21.15.192:51740) 2020-11-20T11:48:15.430 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.423+0000 7f0a2f7fe700 1 -- 172.21.15.192:0/2120364228 learned_addr learned my addr 172.21.15.192:0/2120364228 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:15.430 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.423+0000 7f0a2f7fe700 1 -- 172.21.15.192:0/2120364228 >> v1:172.21.15.192:6789/0 conn(0x7f0a30060370 legacy=0x7f0a300c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.430 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.423+0000 7f0a2f7fe700 1 -- 172.21.15.192:0/2120364228 >> v1:172.21.15.146:6789/0 conn(0x7f0a30064c40 legacy=0x7f0a30151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.430 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.423+0000 7f0a2effd700 1 -- 172.21.15.192:0/2120364228 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3447110501 0 0) 0x7f0a30151e80 con 0x7f0a30064c40 2020-11-20T11:48:15.430 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.423+0000 7f0a2f7fe700 1 -- 172.21.15.192:0/2120364228 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a30064500 con 0x7f0a30154920 2020-11-20T11:48:15.431 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.423+0000 7f0a2f7fe700 1 --2- 172.21.15.192:0/2120364228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a30154920 0x7f0a30060750 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f0a24009990 tx=0x7f0a24006ef0).ready entity=mon.2 client_cookie=d732406ceb84e79 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:15.431 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.423+0000 7f0a2effd700 1 -- 172.21.15.192:0/2120364228 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2400b7e0 con 0x7f0a30154920 2020-11-20T11:48:15.431 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.423+0000 7f0a2effd700 1 -- 172.21.15.192:0/2120364228 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a24000e90 con 0x7f0a30154920 2020-11-20T11:48:15.431 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.423+0000 7f0a2effd700 1 -- 172.21.15.192:0/2120364228 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2400bb50 con 0x7f0a30154920 2020-11-20T11:48:15.431 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.424+0000 7f0a3654b700 1 -- 172.21.15.192:0/2120364228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a30154920 msgr2=0x7f0a30060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.432 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.424+0000 7f0a3654b700 1 --2- 172.21.15.192:0/2120364228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a30154920 0x7f0a30060750 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f0a24009990 tx=0x7f0a24006ef0).stop 2020-11-20T11:48:15.432 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.424+0000 7f0a3654b700 1 -- 172.21.15.192:0/2120364228 shutdown_connections 2020-11-20T11:48:15.432 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.424+0000 7f0a3654b700 1 --2- 172.21.15.192:0/2120364228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a30154920 0x7f0a30060750 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:15.432 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.424+0000 7f0a3654b700 1 -- 172.21.15.192:0/2120364228 >> 172.21.15.192:0/2120364228 conn(0x7f0a30062100 msgr2=0x7f0a300c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:15.432 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.424+0000 7f0a3654b700 1 -- 172.21.15.192:0/2120364228 shutdown_connections 2020-11-20T11:48:15.432 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.424+0000 7f0a3654b700 1 -- 172.21.15.192:0/2120364228 wait complete. 2020-11-20T11:48:15.435 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.425+0000 7f0a3654b700 1 Processor -- start 2020-11-20T11:48:15.435 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.425+0000 7f0a3654b700 1 -- start start 2020-11-20T11:48:15.436 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.426+0000 7f0a3654b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a30060370 0x7f0a30154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.436 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.426+0000 7f0a3654b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a30064c40 0x7f0a30152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.436 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.426+0000 7f0a3654b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a30154920 0x7f0a30153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.436 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.426+0000 7f0a3654b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a30154750 con 0x7f0a30154920 2020-11-20T11:48:15.436 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.426+0000 7f0a3654b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a300c3290 con 0x7f0a30064c40 2020-11-20T11:48:15.437 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.426+0000 7f0a3654b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a300b0810 con 0x7f0a30060370 2020-11-20T11:48:15.437 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.426+0000 7f0a2ffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a30060370 0x7f0a30154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.437 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.426+0000 7f0a2ffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a30060370 0x7f0a30154260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49078/0 (socket says 172.21.15.192:49078) 2020-11-20T11:48:15.437 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.426+0000 7f0a2ffff700 1 -- 172.21.15.192:0/718726404 learned_addr learned my addr 172.21.15.192:0/718726404 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:15.438 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.426+0000 7f0a34ae8700 1 --2- 172.21.15.192:0/718726404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a30154920 0x7f0a30153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.438 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.426+0000 7f0a2ffff700 1 -- 172.21.15.192:0/718726404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a30064c40 msgr2=0x7f0a30152f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.438 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.426+0000 7f0a2ffff700 1 --2- 172.21.15.192:0/718726404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a30064c40 0x7f0a30152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:48:15.438 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.426+0000 7f0a2ffff700 1 -- 172.21.15.192:0/718726404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a30154920 msgr2=0x7f0a30153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.438 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.426+0000 7f0a2ffff700 1 --2- 172.21.15.192:0/718726404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a30154920 0x7f0a30153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:15.439 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.426+0000 7f0a2ffff700 1 -- 172.21.15.192:0/718726404 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a300b0ab0 con 0x7f0a30060370 2020-11-20T11:48:15.439 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.426+0000 7f0a34ae8700 1 --2- 172.21.15.192:0/718726404 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0a30154920 0x7f0a30153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:48:15.439 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.426+0000 7f0a2ffff700 1 --2- 172.21.15.192:0/718726404 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a30060370 0x7f0a30154260 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f0a2000c760 tx=0x7f0a20007c80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:15.439 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.427+0000 7f0a0ffff700 1 -- 172.21.15.192:0/718726404 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a20007320 con 0x7f0a30060370 2020-11-20T11:48:15.439 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.427+0000 7f0a0ffff700 1 -- 172.21.15.192:0/718726404 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a20005570 con 0x7f0a30060370 2020-11-20T11:48:15.440 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.427+0000 7f0a3654b700 1 -- 172.21.15.192:0/718726404 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a300b0d50 con 0x7f0a30060370 2020-11-20T11:48:15.440 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.427+0000 7f0a0ffff700 1 -- 172.21.15.192:0/718726404 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a200058f0 con 0x7f0a30060370 2020-11-20T11:48:15.440 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.427+0000 7f0a3654b700 1 -- 172.21.15.192:0/718726404 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a300b0500 con 0x7f0a30060370 2020-11-20T11:48:15.440 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.427+0000 7f0a3654b700 1 -- 172.21.15.192:0/718726404 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0a300699a0 con 0x7f0a30060370 2020-11-20T11:48:15.440 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.428+0000 7f0a0ffff700 1 -- 172.21.15.192:0/718726404 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f0a20010030 con 0x7f0a30060370 2020-11-20T11:48:15.441 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.429+0000 7f0a0ffff700 1 --2- 172.21.15.192:0/718726404 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f0a08080670 0x7f0a08082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.441 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.429+0000 7f0a2f7fe700 1 --2- 172.21.15.192:0/718726404 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f0a08080670 0x7f0a08082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.441 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.429+0000 7f0a0ffff700 1 -- 172.21.15.192:0/718726404 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f0a200a30d0 con 0x7f0a30060370 2020-11-20T11:48:15.441 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.429+0000 7f0a0ffff700 1 --2- 172.21.15.192:0/718726404 >> [v2:172.21.15.146:6808/22857,v1:172.21.15.146:6809/22857] conn(0x7f0a080893a0 0x7f0a0808b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.442 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.429+0000 7f0a0ffff700 1 -- 172.21.15.192:0/718726404 --> [v2:172.21.15.146:6808/22857,v1:172.21.15.146:6809/22857] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0a0808be20 con 0x7f0a080893a0 2020-11-20T11:48:15.442 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.429+0000 7f0a0ffff700 1 -- 172.21.15.192:0/718726404 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a200a3440 con 0x7f0a30060370 2020-11-20T11:48:15.442 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.429+0000 7f0a2f7fe700 1 --2- 172.21.15.192:0/718726404 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f0a08080670 0x7f0a08082b30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f0a24009990 tx=0x7f0a24016000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:15.442 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.429+0000 7f0a34ae8700 1 --2- 172.21.15.192:0/718726404 >> [v2:172.21.15.146:6808/22857,v1:172.21.15.146:6809/22857] conn(0x7f0a080893a0 0x7f0a0808b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.443 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.430+0000 7f0a34ae8700 1 --2- 172.21.15.192:0/718726404 >> [v2:172.21.15.146:6808/22857,v1:172.21.15.146:6809/22857] conn(0x7f0a080893a0 0x7f0a0808b7c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:15.443 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.431+0000 7f0a0ffff700 1 -- 172.21.15.192:0/718726404 <== osd.4 v2:172.21.15.146:6808/22857 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f0a0808be20 con 0x7f0a080893a0 2020-11-20T11:48:15.447 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.444+0000 7f0a3654b700 1 -- 172.21.15.192:0/718726404 --> [v2:172.21.15.146:6808/22857,v1:172.21.15.146:6809/22857] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0a30152cb0 con 0x7f0a080893a0 2020-11-20T11:48:15.449 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.445+0000 7f0a0ffff700 1 -- 172.21.15.192:0/718726404 <== osd.4 v2:172.21.15.146:6808/22857 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0a30152cb0 con 0x7f0a080893a0 2020-11-20T11:48:15.449 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.445+0000 7f0a3654b700 1 -- 172.21.15.192:0/718726404 >> [v2:172.21.15.146:6808/22857,v1:172.21.15.146:6809/22857] conn(0x7f0a080893a0 msgr2=0x7f0a0808b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.450 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.445+0000 7f0a3654b700 1 --2- 172.21.15.192:0/718726404 >> [v2:172.21.15.146:6808/22857,v1:172.21.15.146:6809/22857] conn(0x7f0a080893a0 0x7f0a0808b7c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:15.450 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.445+0000 7f0a3654b700 1 -- 172.21.15.192:0/718726404 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f0a08080670 msgr2=0x7f0a08082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.450 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.445+0000 7f0a3654b700 1 --2- 172.21.15.192:0/718726404 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f0a08080670 0x7f0a08082b30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f0a24009990 tx=0x7f0a24016000).stop 2020-11-20T11:48:15.450 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.445+0000 7f0a3654b700 1 -- 172.21.15.192:0/718726404 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a30060370 msgr2=0x7f0a30154260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.450 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.445+0000 7f0a3654b700 1 --2- 172.21.15.192:0/718726404 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a30060370 0x7f0a30154260 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f0a2000c760 tx=0x7f0a20007c80).stop 2020-11-20T11:48:15.451 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.445+0000 7f0a34ae8700 1 -- 172.21.15.192:0/718726404 reap_dead start 2020-11-20T11:48:15.451 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.445+0000 7f0a3654b700 1 -- 172.21.15.192:0/718726404 shutdown_connections 2020-11-20T11:48:15.451 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.445+0000 7f0a3654b700 1 -- 172.21.15.192:0/718726404 >> 172.21.15.192:0/718726404 conn(0x7f0a30062100 msgr2=0x7f0a300c70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:15.451 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.446+0000 7f0a3654b700 1 -- 172.21.15.192:0/718726404 shutdown_connections 2020-11-20T11:48:15.451 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.446+0000 7f0a3654b700 1 -- 172.21.15.192:0/718726404 wait complete. 2020-11-20T11:48:15.460 INFO:teuthology.orchestra.run.smithi192.stdout:73014444038 2020-11-20T11:48:15.461 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2020-11-20T11:48:15.571 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.568+0000 7f912a33e700 1 Processor -- start 2020-11-20T11:48:15.572 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.568+0000 7f912a33e700 1 -- start start 2020-11-20T11:48:15.574 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.569+0000 7f912a33e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9124060370 0x7f9124060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.575 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.569+0000 7f912a33e700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9124151e80 con 0x7f9124154920 2020-11-20T11:48:15.575 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.569+0000 7f912a33e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9124152120 con 0x7f9124064c40 2020-11-20T11:48:15.575 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.569+0000 7f912a33e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9124064260 con 0x7f9124060370 2020-11-20T11:48:15.575 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.569+0000 7f9123fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9124060370 0x7f9124060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.576 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.569+0000 7f9123fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9124060370 0x7f9124060750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49092/0 (socket says 172.21.15.192:49092) 2020-11-20T11:48:15.576 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.569+0000 7f9123fff700 1 -- 172.21.15.192:0/3376351126 learned_addr learned my addr 172.21.15.192:0/3376351126 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:15.576 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.569+0000 7f9123fff700 1 -- 172.21.15.192:0/3376351126 >> v1:172.21.15.146:6789/0 conn(0x7f9124064c40 legacy=0x7f9124151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.576 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.569+0000 7f9123fff700 1 -- 172.21.15.192:0/3376351126 >> v1:172.21.15.87:6789/0 conn(0x7f9124154920 legacy=0x7f91240c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.577 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.569+0000 7f9123fff700 1 -- 172.21.15.192:0/3376351126 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9124064500 con 0x7f9124060370 2020-11-20T11:48:15.577 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.569+0000 7f9123fff700 1 --2- 172.21.15.192:0/3376351126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9124060370 0x7f9124060750 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f9114009a10 tx=0x7f9114006ef0).ready entity=mon.2 client_cookie=c3dddf0aa74831ef server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:15.577 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.569+0000 7f9122ffd700 1 -- 172.21.15.192:0/3376351126 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911400b8f0 con 0x7f9124060370 2020-11-20T11:48:15.577 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.570+0000 7f9122ffd700 1 -- 172.21.15.192:0/3376351126 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9114000e90 con 0x7f9124060370 2020-11-20T11:48:15.577 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.570+0000 7f9122ffd700 1 -- 172.21.15.192:0/3376351126 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911400bc60 con 0x7f9124060370 2020-11-20T11:48:15.578 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.570+0000 7f912a33e700 1 -- 172.21.15.192:0/3376351126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9124060370 msgr2=0x7f9124060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.578 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.570+0000 7f912a33e700 1 --2- 172.21.15.192:0/3376351126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9124060370 0x7f9124060750 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f9114009a10 tx=0x7f9114006ef0).stop 2020-11-20T11:48:15.578 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.570+0000 7f912a33e700 1 -- 172.21.15.192:0/3376351126 shutdown_connections 2020-11-20T11:48:15.578 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.570+0000 7f912a33e700 1 --2- 172.21.15.192:0/3376351126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9124060370 0x7f9124060750 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:15.578 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.570+0000 7f912a33e700 1 -- 172.21.15.192:0/3376351126 >> 172.21.15.192:0/3376351126 conn(0x7f9124062100 msgr2=0x7f91240c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:15.579 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.570+0000 7f912a33e700 1 -- 172.21.15.192:0/3376351126 shutdown_connections 2020-11-20T11:48:15.579 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.570+0000 7f912a33e700 1 -- 172.21.15.192:0/3376351126 wait complete. 2020-11-20T11:48:15.579 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.571+0000 7f912a33e700 1 Processor -- start 2020-11-20T11:48:15.579 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.571+0000 7f912a33e700 1 -- start start 2020-11-20T11:48:15.582 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.572+0000 7f912a33e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9124060370 0x7f91240c19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.582 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.572+0000 7f912a33e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9124064c40 0x7f91240bfe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.583 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.572+0000 7f912a33e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9124154920 0x7f9124161260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.583 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.572+0000 7f912a33e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91240c0b50 con 0x7f9124154920 2020-11-20T11:48:15.583 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.572+0000 7f912a33e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91240c0500 con 0x7f9124060370 2020-11-20T11:48:15.583 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.572+0000 7f912a33e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91240c0d50 con 0x7f9124064c40 2020-11-20T11:48:15.583 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.572+0000 7f91237fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9124064c40 0x7f91240bfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.584 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.572+0000 7f91237fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9124064c40 0x7f91240bfe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49096/0 (socket says 172.21.15.192:49096) 2020-11-20T11:48:15.584 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.572+0000 7f91237fe700 1 -- 172.21.15.192:0/1588793509 learned_addr learned my addr 172.21.15.192:0/1588793509 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:15.584 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.572+0000 7f91288db700 1 --2- 172.21.15.192:0/1588793509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9124154920 0x7f9124161260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.584 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.572+0000 7f9123fff700 1 --2- 172.21.15.192:0/1588793509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9124060370 0x7f91240c19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.585 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.572+0000 7f91237fe700 1 -- 172.21.15.192:0/1588793509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9124060370 msgr2=0x7f91240c19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.585 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.572+0000 7f91237fe700 1 --2- 172.21.15.192:0/1588793509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9124060370 0x7f91240c19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:15.585 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.572+0000 7f91237fe700 1 -- 172.21.15.192:0/1588793509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9124154920 msgr2=0x7f9124161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.585 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.573+0000 7f91237fe700 1 --2- 172.21.15.192:0/1588793509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9124154920 0x7f9124161260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:15.585 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.573+0000 7f91237fe700 1 -- 172.21.15.192:0/1588793509 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91240c0ff0 con 0x7f9124064c40 2020-11-20T11:48:15.586 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.573+0000 7f91288db700 1 --2- 172.21.15.192:0/1588793509 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9124154920 0x7f9124161260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:48:15.586 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.573+0000 7f9123fff700 1 --2- 172.21.15.192:0/1588793509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9124060370 0x7f91240c19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:48:15.586 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.573+0000 7f91237fe700 1 --2- 172.21.15.192:0/1588793509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9124064c40 0x7f91240bfe40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f911800c710 tx=0x7f9118007c20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:15.586 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.573+0000 7f9103fff700 1 -- 172.21.15.192:0/1588793509 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911800e4a0 con 0x7f9124064c40 2020-11-20T11:48:15.586 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.573+0000 7f9103fff700 1 -- 172.21.15.192:0/1588793509 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9118001e90 con 0x7f9124064c40 2020-11-20T11:48:15.587 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.573+0000 7f912a33e700 1 -- 172.21.15.192:0/1588793509 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91240c1290 con 0x7f9124064c40 2020-11-20T11:48:15.587 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.573+0000 7f9103fff700 1 -- 172.21.15.192:0/1588793509 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911800e830 con 0x7f9124064c40 2020-11-20T11:48:15.587 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.573+0000 7f912a33e700 1 -- 172.21.15.192:0/1588793509 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9124161750 con 0x7f9124064c40 2020-11-20T11:48:15.587 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.574+0000 7f912a33e700 1 -- 172.21.15.192:0/1588793509 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f91240699a0 con 0x7f9124064c40 2020-11-20T11:48:15.587 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.574+0000 7f9103fff700 1 -- 172.21.15.192:0/1588793509 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f9118019030 con 0x7f9124064c40 2020-11-20T11:48:15.588 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.575+0000 7f9103fff700 1 --2- 172.21.15.192:0/1588793509 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f90fc080670 0x7f90fc082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.588 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.575+0000 7f9103fff700 1 -- 172.21.15.192:0/1588793509 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f91180a1e40 con 0x7f9124064c40 2020-11-20T11:48:15.588 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.575+0000 7f9123fff700 1 --2- 172.21.15.192:0/1588793509 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f90fc080670 0x7f90fc082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.588 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.575+0000 7f9103fff700 1 --2- 172.21.15.192:0/1588793509 >> [v2:172.21.15.87:6800/23316,v1:172.21.15.87:6801/23316] conn(0x7f90fc0893a0 0x7f90fc08b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.588 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.575+0000 7f9103fff700 1 -- 172.21.15.192:0/1588793509 --> [v2:172.21.15.87:6800/23316,v1:172.21.15.87:6801/23316] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f90fc08be20 con 0x7f90fc0893a0 2020-11-20T11:48:15.589 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.575+0000 7f9103fff700 1 -- 172.21.15.192:0/1588793509 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91180a4420 con 0x7f9124064c40 2020-11-20T11:48:15.589 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.575+0000 7f9123fff700 1 --2- 172.21.15.192:0/1588793509 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f90fc080670 0x7f90fc082b30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f9114006f30 tx=0x7f9114016000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:15.589 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.575+0000 7f91288db700 1 --2- 172.21.15.192:0/1588793509 >> [v2:172.21.15.87:6800/23316,v1:172.21.15.87:6801/23316] conn(0x7f90fc0893a0 0x7f90fc08b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.589 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.576+0000 7f91288db700 1 --2- 172.21.15.192:0/1588793509 >> [v2:172.21.15.87:6800/23316,v1:172.21.15.87:6801/23316] conn(0x7f90fc0893a0 0x7f90fc08b7c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:15.590 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.576+0000 7f9103fff700 1 -- 172.21.15.192:0/1588793509 <== osd.5 v2:172.21.15.87:6800/23316 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f90fc08be20 con 0x7f90fc0893a0 2020-11-20T11:48:15.595 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.590+0000 7f912a33e700 1 -- 172.21.15.192:0/1588793509 --> [v2:172.21.15.87:6800/23316,v1:172.21.15.87:6801/23316] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f912405ca80 con 0x7f90fc0893a0 2020-11-20T11:48:15.595 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.591+0000 7f9103fff700 1 -- 172.21.15.192:0/1588793509 <== osd.5 v2:172.21.15.87:6800/23316 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f912405ca80 con 0x7f90fc0893a0 2020-11-20T11:48:15.595 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.591+0000 7f912a33e700 1 -- 172.21.15.192:0/1588793509 >> [v2:172.21.15.87:6800/23316,v1:172.21.15.87:6801/23316] conn(0x7f90fc0893a0 msgr2=0x7f90fc08b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.595 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.591+0000 7f912a33e700 1 --2- 172.21.15.192:0/1588793509 >> [v2:172.21.15.87:6800/23316,v1:172.21.15.87:6801/23316] conn(0x7f90fc0893a0 0x7f90fc08b7c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:15.596 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.591+0000 7f912a33e700 1 -- 172.21.15.192:0/1588793509 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f90fc080670 msgr2=0x7f90fc082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.596 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.591+0000 7f912a33e700 1 --2- 172.21.15.192:0/1588793509 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f90fc080670 0x7f90fc082b30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f9114006f30 tx=0x7f9114016000).stop 2020-11-20T11:48:15.596 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.591+0000 7f912a33e700 1 -- 172.21.15.192:0/1588793509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9124064c40 msgr2=0x7f91240bfe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.596 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.591+0000 7f912a33e700 1 --2- 172.21.15.192:0/1588793509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9124064c40 0x7f91240bfe40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f911800c710 tx=0x7f9118007c20).stop 2020-11-20T11:48:15.596 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.591+0000 7f91288db700 1 -- 172.21.15.192:0/1588793509 reap_dead start 2020-11-20T11:48:15.597 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.591+0000 7f912a33e700 1 -- 172.21.15.192:0/1588793509 shutdown_connections 2020-11-20T11:48:15.597 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.591+0000 7f912a33e700 1 -- 172.21.15.192:0/1588793509 >> 172.21.15.192:0/1588793509 conn(0x7f9124062100 msgr2=0x7f91240c2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:15.597 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.591+0000 7f912a33e700 1 -- 172.21.15.192:0/1588793509 shutdown_connections 2020-11-20T11:48:15.597 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.591+0000 7f912a33e700 1 -- 172.21.15.192:0/1588793509 wait complete. 2020-11-20T11:48:15.605 INFO:teuthology.orchestra.run.smithi192.stdout:73014444039 2020-11-20T11:48:15.606 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2020-11-20T11:48:15.717 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.713+0000 7f586b59e700 1 Processor -- start 2020-11-20T11:48:15.717 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.713+0000 7f586b59e700 1 -- start start 2020-11-20T11:48:15.724 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.714+0000 7f586b59e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5864060370 0x7f5864060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.724 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.714+0000 7f586b59e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58640c26a0 con 0x7f5864067470 2020-11-20T11:48:15.724 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.714+0000 7f586b59e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58640c39f0 con 0x7f58641547b0 2020-11-20T11:48:15.725 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.714+0000 7f586b59e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5864060ea0 con 0x7f5864060370 2020-11-20T11:48:15.725 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.714+0000 7f5869d9b700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f58641547b0 0x7f58640c32e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51774/0 (socket says 172.21.15.192:51774) 2020-11-20T11:48:15.726 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.714+0000 7f5869d9b700 1 -- 172.21.15.192:0/4247581859 learned_addr learned my addr 172.21.15.192:0/4247581859 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:15.726 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.714+0000 7f586a59c700 1 --2- 172.21.15.192:0/4247581859 >> v2:172.21.15.87:3300/0 conn(0x7f5864060370 0x7f5864060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.726 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.714+0000 7f586959a700 1 -- 172.21.15.192:0/4247581859 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 81678407 0 0) 0x7f58640c39f0 con 0x7f58641547b0 2020-11-20T11:48:15.727 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.714+0000 7f586959a700 1 -- 172.21.15.192:0/4247581859 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f584c003280 con 0x7f58641547b0 2020-11-20T11:48:15.727 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.715+0000 7f586959a700 1 -- 172.21.15.192:0/4247581859 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3330807709 0 0) 0x7f58640c26a0 con 0x7f5864067470 2020-11-20T11:48:15.727 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.715+0000 7f586a59c700 1 -- 172.21.15.192:0/4247581859 >> v1:172.21.15.192:6789/0 conn(0x7f58641547b0 legacy=0x7f58640c32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.727 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.715+0000 7f586a59c700 1 -- 172.21.15.192:0/4247581859 >> v1:172.21.15.146:6789/0 conn(0x7f5864067470 legacy=0x7f5864150690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.728 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.715+0000 7f586a59c700 1 -- 172.21.15.192:0/4247581859 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5864151e30 con 0x7f5864060370 2020-11-20T11:48:15.728 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.715+0000 7f586a59c700 1 --2- 172.21.15.192:0/4247581859 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5864060370 0x7f5864060750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f5858006fd0 tx=0x7f5858006e30).ready entity=mon.0 client_cookie=457a2ff79bded1e8 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:15.728 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.715+0000 7f586959a700 1 -- 172.21.15.192:0/4247581859 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585800bec0 con 0x7f5864060370 2020-11-20T11:48:15.729 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.715+0000 7f586959a700 1 -- 172.21.15.192:0/4247581859 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5858000e90 con 0x7f5864060370 2020-11-20T11:48:15.729 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.715+0000 7f586959a700 1 -- 172.21.15.192:0/4247581859 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58580099f0 con 0x7f5864060370 2020-11-20T11:48:15.729 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.715+0000 7f586b59e700 1 -- 172.21.15.192:0/4247581859 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5864060370 msgr2=0x7f5864060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.730 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.715+0000 7f586b59e700 1 --2- 172.21.15.192:0/4247581859 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5864060370 0x7f5864060750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f5858006fd0 tx=0x7f5858006e30).stop 2020-11-20T11:48:15.730 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.715+0000 7f586b59e700 1 -- 172.21.15.192:0/4247581859 shutdown_connections 2020-11-20T11:48:15.730 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.715+0000 7f586b59e700 1 --2- 172.21.15.192:0/4247581859 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5864060370 0x7f5864060750 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:15.731 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.715+0000 7f586b59e700 1 -- 172.21.15.192:0/4247581859 >> 172.21.15.192:0/4247581859 conn(0x7f58640c7820 msgr2=0x7f58640c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:15.731 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.715+0000 7f586b59e700 1 -- 172.21.15.192:0/4247581859 shutdown_connections 2020-11-20T11:48:15.731 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.716+0000 7f586b59e700 1 -- 172.21.15.192:0/4247581859 wait complete. 2020-11-20T11:48:15.732 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.717+0000 7f586b59e700 1 Processor -- start 2020-11-20T11:48:15.732 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.717+0000 7f586b59e700 1 -- start start 2020-11-20T11:48:15.732 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.717+0000 7f586b59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5864060370 0x7f586414c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.733 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.717+0000 7f586b59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5864067470 0x7f58641492a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.733 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.717+0000 7f586b59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58641547b0 0x7f5864149790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.733 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.717+0000 7f586b59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5864157220 con 0x7f5864067470 2020-11-20T11:48:15.734 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.717+0000 7f586b59e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58641574c0 con 0x7f5864060370 2020-11-20T11:48:15.734 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.717+0000 7f586b59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5864157760 con 0x7f58641547b0 2020-11-20T11:48:15.734 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.717+0000 7f586ad9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58641547b0 0x7f5864149790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.735 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.717+0000 7f586ad9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58641547b0 0x7f5864149790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49110/0 (socket says 172.21.15.192:49110) 2020-11-20T11:48:15.735 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.717+0000 7f586ad9d700 1 -- 172.21.15.192:0/221565288 learned_addr learned my addr 172.21.15.192:0/221565288 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:15.735 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.717+0000 7f5869d9b700 1 --2- 172.21.15.192:0/221565288 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5864067470 0x7f58641492a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.736 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.718+0000 7f586a59c700 1 --2- 172.21.15.192:0/221565288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5864060370 0x7f586414c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.736 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.718+0000 7f586ad9d700 1 -- 172.21.15.192:0/221565288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5864060370 msgr2=0x7f586414c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.736 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.718+0000 7f586ad9d700 1 --2- 172.21.15.192:0/221565288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5864060370 0x7f586414c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:15.737 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.718+0000 7f586ad9d700 1 -- 172.21.15.192:0/221565288 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5864067470 msgr2=0x7f58641492a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.737 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.718+0000 7f586ad9d700 1 --2- 172.21.15.192:0/221565288 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5864067470 0x7f58641492a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:15.737 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.718+0000 7f586ad9d700 1 -- 172.21.15.192:0/221565288 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5864157a00 con 0x7f58641547b0 2020-11-20T11:48:15.738 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.718+0000 7f586a59c700 1 --2- 172.21.15.192:0/221565288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5864060370 0x7f586414c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:48:15.742 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.718+0000 7f586ad9d700 1 --2- 172.21.15.192:0/221565288 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58641547b0 0x7f5864149790 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f586000cae0 tx=0x7f5860007da0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:15.742 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.718+0000 7f58567fc700 1 -- 172.21.15.192:0/221565288 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586000a760 con 0x7f58641547b0 2020-11-20T11:48:15.743 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.718+0000 7f58567fc700 1 -- 172.21.15.192:0/221565288 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586000a8e0 con 0x7f58641547b0 2020-11-20T11:48:15.743 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.718+0000 7f586b59e700 1 -- 172.21.15.192:0/221565288 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5864157ca0 con 0x7f58641547b0 2020-11-20T11:48:15.743 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.718+0000 7f58567fc700 1 -- 172.21.15.192:0/221565288 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586000aca0 con 0x7f58641547b0 2020-11-20T11:48:15.744 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.718+0000 7f586b59e700 1 -- 172.21.15.192:0/221565288 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f586414c570 con 0x7f58641547b0 2020-11-20T11:48:15.744 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.719+0000 7f586b59e700 1 -- 172.21.15.192:0/221565288 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f58640699a0 con 0x7f58641547b0 2020-11-20T11:48:15.744 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.719+0000 7f58567fc700 1 -- 172.21.15.192:0/221565288 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f5860019030 con 0x7f58641547b0 2020-11-20T11:48:15.745 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.720+0000 7f58567fc700 1 --2- 172.21.15.192:0/221565288 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f583c080670 0x7f583c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.745 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.720+0000 7f58567fc700 1 -- 172.21.15.192:0/221565288 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f58600a2cc0 con 0x7f58641547b0 2020-11-20T11:48:15.745 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.720+0000 7f586a59c700 1 --2- 172.21.15.192:0/221565288 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f583c080670 0x7f583c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.746 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.720+0000 7f58567fc700 1 --2- 172.21.15.192:0/221565288 >> [v2:172.21.15.192:6810/23246,v1:172.21.15.192:6811/23246] conn(0x7f583c0893a0 0x7f583c08b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.746 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.720+0000 7f58567fc700 1 -- 172.21.15.192:0/221565288 --> [v2:172.21.15.192:6810/23246,v1:172.21.15.192:6811/23246] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f583c08be20 con 0x7f583c0893a0 2020-11-20T11:48:15.746 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.720+0000 7f58567fc700 1 -- 172.21.15.192:0/221565288 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58600a3030 con 0x7f58641547b0 2020-11-20T11:48:15.747 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.720+0000 7f5869d9b700 1 --2- 172.21.15.192:0/221565288 >> [v2:172.21.15.192:6810/23246,v1:172.21.15.192:6811/23246] conn(0x7f583c0893a0 0x7f583c08b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.747 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.720+0000 7f586a59c700 1 --2- 172.21.15.192:0/221565288 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f583c080670 0x7f583c082b30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f5858006e70 tx=0x7f5858015000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:15.748 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.721+0000 7f5869d9b700 1 --2- 172.21.15.192:0/221565288 >> [v2:172.21.15.192:6810/23246,v1:172.21.15.192:6811/23246] conn(0x7f583c0893a0 0x7f583c08b7c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:15.748 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.721+0000 7f58567fc700 1 -- 172.21.15.192:0/221565288 <== osd.6 v2:172.21.15.192:6810/23246 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f583c08be20 con 0x7f583c0893a0 2020-11-20T11:48:15.749 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.735+0000 7f586b59e700 1 -- 172.21.15.192:0/221565288 --> [v2:172.21.15.192:6810/23246,v1:172.21.15.192:6811/23246] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f58641612d0 con 0x7f583c0893a0 2020-11-20T11:48:15.749 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.735+0000 7f58567fc700 1 -- 172.21.15.192:0/221565288 <== osd.6 v2:172.21.15.192:6810/23246 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f58641612d0 con 0x7f583c0893a0 2020-11-20T11:48:15.749 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.736+0000 7f586b59e700 1 -- 172.21.15.192:0/221565288 >> [v2:172.21.15.192:6810/23246,v1:172.21.15.192:6811/23246] conn(0x7f583c0893a0 msgr2=0x7f583c08b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.750 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.736+0000 7f586b59e700 1 --2- 172.21.15.192:0/221565288 >> [v2:172.21.15.192:6810/23246,v1:172.21.15.192:6811/23246] conn(0x7f583c0893a0 0x7f583c08b7c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:15.750 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.736+0000 7f586b59e700 1 -- 172.21.15.192:0/221565288 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f583c080670 msgr2=0x7f583c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.750 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.736+0000 7f586b59e700 1 --2- 172.21.15.192:0/221565288 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f583c080670 0x7f583c082b30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f5858006e70 tx=0x7f5858015000).stop 2020-11-20T11:48:15.751 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.736+0000 7f586b59e700 1 -- 172.21.15.192:0/221565288 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58641547b0 msgr2=0x7f5864149790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.752 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.736+0000 7f586b59e700 1 --2- 172.21.15.192:0/221565288 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58641547b0 0x7f5864149790 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f586000cae0 tx=0x7f5860007da0).stop 2020-11-20T11:48:15.752 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.736+0000 7f586ad9d700 1 -- 172.21.15.192:0/221565288 reap_dead start 2020-11-20T11:48:15.752 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.736+0000 7f586b59e700 1 -- 172.21.15.192:0/221565288 shutdown_connections 2020-11-20T11:48:15.753 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.736+0000 7f586b59e700 1 -- 172.21.15.192:0/221565288 >> 172.21.15.192:0/221565288 conn(0x7f58640c7820 msgr2=0x7f58640c3200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:15.753 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.736+0000 7f586b59e700 1 -- 172.21.15.192:0/221565288 shutdown_connections 2020-11-20T11:48:15.753 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.736+0000 7f586b59e700 1 -- 172.21.15.192:0/221565288 wait complete. 2020-11-20T11:48:15.754 INFO:teuthology.orchestra.run.smithi192.stdout:73014444038 2020-11-20T11:48:15.755 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2020-11-20T11:48:15.903 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.897+0000 7f42792b5700 1 Processor -- start 2020-11-20T11:48:15.904 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.897+0000 7f42792b5700 1 -- start start 2020-11-20T11:48:15.904 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.898+0000 7f42792b5700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f4274063b60 0x7f4274063f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.904 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.898+0000 7f42792b5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4274151c90 0x7f42740c01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.904 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.898+0000 7f42792b5700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4274065c30 con 0x7f42740c06e0 2020-11-20T11:48:15.905 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.898+0000 7f42792b5700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4274065e60 con 0x7f4274063b60 2020-11-20T11:48:15.905 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.898+0000 7f42792b5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4274066100 con 0x7f4274151c90 2020-11-20T11:48:15.905 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.898+0000 7f42737fe700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f42740c06e0 0x7f427414e320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51788/0 (socket says 172.21.15.192:51788) 2020-11-20T11:48:15.905 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.898+0000 7f42737fe700 1 -- 172.21.15.192:0/2377856523 learned_addr learned my addr 172.21.15.192:0/2377856523 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:15.905 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.898+0000 7f4272ffd700 1 --2- 172.21.15.192:0/2377856523 >> v2:172.21.15.87:3300/0 conn(0x7f4274063b60 0x7f4274063f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.906 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.898+0000 7f42727fc700 1 --2- 172.21.15.192:0/2377856523 >> v2:172.21.15.146:3300/0 conn(0x7f4274151c90 0x7f42740c01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.906 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.898+0000 7f4271ffb700 1 -- 172.21.15.192:0/2377856523 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3520934959 0 0) 0x7f4274065c30 con 0x7f42740c06e0 2020-11-20T11:48:15.906 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.898+0000 7f4271ffb700 1 -- 172.21.15.192:0/2377856523 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4260003280 con 0x7f42740c06e0 2020-11-20T11:48:15.906 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.898+0000 7f4272ffd700 1 -- 172.21.15.192:0/2377856523 >> v2:172.21.15.146:3300/0 conn(0x7f4274151c90 msgr2=0x7f42740c01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:15.906 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.898+0000 7f4272ffd700 1 --2- 172.21.15.192:0/2377856523 >> v2:172.21.15.146:3300/0 conn(0x7f4274151c90 0x7f42740c01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:15.907 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.898+0000 7f4272ffd700 1 -- 172.21.15.192:0/2377856523 >> v1:172.21.15.192:6789/0 conn(0x7f42740c06e0 legacy=0x7f427414e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.907 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.898+0000 7f4272ffd700 1 -- 172.21.15.192:0/2377856523 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4274066b80 con 0x7f4274063b60 2020-11-20T11:48:15.907 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.898+0000 7f42727fc700 1 --2- 172.21.15.192:0/2377856523 >> v2:172.21.15.146:3300/0 conn(0x7f4274151c90 0x7f42740c01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:48:15.907 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.898+0000 7f4272ffd700 1 --2- 172.21.15.192:0/2377856523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4274063b60 0x7f4274063f40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f42740621a0 tx=0x7f4264006e30).ready entity=mon.0 client_cookie=5512b7312b286506 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:15.908 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.898+0000 7f4271ffb700 1 -- 172.21.15.192:0/2377856523 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42640095c0 con 0x7f4274063b60 2020-11-20T11:48:15.908 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.899+0000 7f4271ffb700 1 -- 172.21.15.192:0/2377856523 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4264000e90 con 0x7f4274063b60 2020-11-20T11:48:15.908 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.899+0000 7f4271ffb700 1 -- 172.21.15.192:0/2377856523 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4264009930 con 0x7f4274063b60 2020-11-20T11:48:15.908 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.899+0000 7f42792b5700 1 -- 172.21.15.192:0/2377856523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4274063b60 msgr2=0x7f4274063f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.908 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.899+0000 7f42792b5700 1 --2- 172.21.15.192:0/2377856523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4274063b60 0x7f4274063f40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f42740621a0 tx=0x7f4264006e30).stop 2020-11-20T11:48:15.909 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.899+0000 7f42792b5700 1 -- 172.21.15.192:0/2377856523 shutdown_connections 2020-11-20T11:48:15.909 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.899+0000 7f42792b5700 1 --2- 172.21.15.192:0/2377856523 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4274063b60 0x7f4274063f40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:15.909 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.899+0000 7f42792b5700 1 --2- 172.21.15.192:0/2377856523 >> v2:172.21.15.146:3300/0 conn(0x7f4274151c90 0x7f42740c01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:15.909 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.899+0000 7f42792b5700 1 -- 172.21.15.192:0/2377856523 >> 172.21.15.192:0/2377856523 conn(0x7f4274060c40 msgr2=0x7f42740c5640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:15.909 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.899+0000 7f42792b5700 1 -- 172.21.15.192:0/2377856523 shutdown_connections 2020-11-20T11:48:15.910 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.899+0000 7f42792b5700 1 -- 172.21.15.192:0/2377856523 wait complete. 2020-11-20T11:48:15.910 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.900+0000 7f42792b5700 1 Processor -- start 2020-11-20T11:48:15.910 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.900+0000 7f42792b5700 1 -- start start 2020-11-20T11:48:15.913 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.901+0000 7f42792b5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4274063b60 0x7f4274164750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.913 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.901+0000 7f42792b5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42740c06e0 0x7f42740c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.913 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.901+0000 7f42792b5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4274151c90 0x7f42740bea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.914 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.901+0000 7f42792b5700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4274164c40 con 0x7f4274151c90 2020-11-20T11:48:15.914 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.901+0000 7f42792b5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4274160980 con 0x7f4274063b60 2020-11-20T11:48:15.914 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.901+0000 7f42792b5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4274160c20 con 0x7f42740c06e0 2020-11-20T11:48:15.914 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.901+0000 7f42727fc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42740c06e0 0x7f42740c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.914 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.901+0000 7f42727fc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42740c06e0 0x7f42740c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49126/0 (socket says 172.21.15.192:49126) 2020-11-20T11:48:15.915 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.901+0000 7f42727fc700 1 -- 172.21.15.192:0/1372077171 learned_addr learned my addr 172.21.15.192:0/1372077171 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:15.915 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.901+0000 7f4272ffd700 1 --2- 172.21.15.192:0/1372077171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4274063b60 0x7f4274164750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.915 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.901+0000 7f42737fe700 1 --2- 172.21.15.192:0/1372077171 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4274151c90 0x7f42740bea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.915 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.901+0000 7f42727fc700 1 -- 172.21.15.192:0/1372077171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4274063b60 msgr2=0x7f4274164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.916 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.901+0000 7f42727fc700 1 --2- 172.21.15.192:0/1372077171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4274063b60 0x7f4274164750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:15.916 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.901+0000 7f42727fc700 1 -- 172.21.15.192:0/1372077171 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4274151c90 msgr2=0x7f42740bea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.916 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.901+0000 7f42727fc700 1 --2- 172.21.15.192:0/1372077171 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4274151c90 0x7f42740bea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:15.916 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.901+0000 7f42727fc700 1 -- 172.21.15.192:0/1372077171 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4274160ec0 con 0x7f42740c06e0 2020-11-20T11:48:15.916 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.901+0000 7f42727fc700 1 --2- 172.21.15.192:0/1372077171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42740c06e0 0x7f42740c5c00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f426800ed20 tx=0x7f4268006e30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:15.917 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.902+0000 7f425affd700 1 -- 172.21.15.192:0/1372077171 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426800cc10 con 0x7f42740c06e0 2020-11-20T11:48:15.917 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.902+0000 7f425affd700 1 -- 172.21.15.192:0/1372077171 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426800cd70 con 0x7f42740c06e0 2020-11-20T11:48:15.917 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.902+0000 7f42792b5700 1 -- 172.21.15.192:0/1372077171 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4274161160 con 0x7f42740c06e0 2020-11-20T11:48:15.921 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.902+0000 7f425affd700 1 -- 172.21.15.192:0/1372077171 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4268012600 con 0x7f42740c06e0 2020-11-20T11:48:15.921 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.902+0000 7f42792b5700 1 -- 172.21.15.192:0/1372077171 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42741616a0 con 0x7f42740c06e0 2020-11-20T11:48:15.922 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.902+0000 7f42792b5700 1 -- 172.21.15.192:0/1372077171 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f427405c470 con 0x7f42740c06e0 2020-11-20T11:48:15.922 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.903+0000 7f425affd700 1 -- 172.21.15.192:0/1372077171 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f42680129b0 con 0x7f42740c06e0 2020-11-20T11:48:15.922 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.904+0000 7f425affd700 1 --2- 172.21.15.192:0/1372077171 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f4250080670 0x7f4250082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.922 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.904+0000 7f4272ffd700 1 --2- 172.21.15.192:0/1372077171 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f4250080670 0x7f4250082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.922 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.904+0000 7f425affd700 1 -- 172.21.15.192:0/1372077171 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f42680a3ae0 con 0x7f42740c06e0 2020-11-20T11:48:15.923 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.904+0000 7f425affd700 1 --2- 172.21.15.192:0/1372077171 >> [v2:172.21.15.146:6816/22858,v1:172.21.15.146:6818/22858] conn(0x7f4250089320 0x7f425008b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:15.923 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.904+0000 7f425affd700 1 -- 172.21.15.192:0/1372077171 --> [v2:172.21.15.146:6816/22858,v1:172.21.15.146:6818/22858] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f425008bda0 con 0x7f4250089320 2020-11-20T11:48:15.923 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.904+0000 7f425affd700 1 -- 172.21.15.192:0/1372077171 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42680a3e50 con 0x7f42740c06e0 2020-11-20T11:48:15.923 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.904+0000 7f4272ffd700 1 --2- 172.21.15.192:0/1372077171 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f4250080670 0x7f4250082b30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f4264006e70 tx=0x7f4264015000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:15.924 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.904+0000 7f42737fe700 1 --2- 172.21.15.192:0/1372077171 >> [v2:172.21.15.146:6816/22858,v1:172.21.15.146:6818/22858] conn(0x7f4250089320 0x7f425008b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:15.924 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.905+0000 7f42737fe700 1 --2- 172.21.15.192:0/1372077171 >> [v2:172.21.15.146:6816/22858,v1:172.21.15.146:6818/22858] conn(0x7f4250089320 0x7f425008b740 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:15.924 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.905+0000 7f425affd700 1 -- 172.21.15.192:0/1372077171 <== osd.7 v2:172.21.15.146:6816/22858 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f425008bda0 con 0x7f4250089320 2020-11-20T11:48:15.926 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.919+0000 7f42792b5700 1 -- 172.21.15.192:0/1372077171 --> [v2:172.21.15.146:6816/22858,v1:172.21.15.146:6818/22858] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4274044fa0 con 0x7f4250089320 2020-11-20T11:48:15.926 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.919+0000 7f425affd700 1 -- 172.21.15.192:0/1372077171 <== osd.7 v2:172.21.15.146:6816/22858 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4274044fa0 con 0x7f4250089320 2020-11-20T11:48:15.926 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.920+0000 7f42792b5700 1 -- 172.21.15.192:0/1372077171 >> [v2:172.21.15.146:6816/22858,v1:172.21.15.146:6818/22858] conn(0x7f4250089320 msgr2=0x7f425008b740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.926 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.920+0000 7f42792b5700 1 --2- 172.21.15.192:0/1372077171 >> [v2:172.21.15.146:6816/22858,v1:172.21.15.146:6818/22858] conn(0x7f4250089320 0x7f425008b740 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:15.927 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.920+0000 7f42792b5700 1 -- 172.21.15.192:0/1372077171 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f4250080670 msgr2=0x7f4250082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.927 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.920+0000 7f42792b5700 1 --2- 172.21.15.192:0/1372077171 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f4250080670 0x7f4250082b30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f4264006e70 tx=0x7f4264015000).stop 2020-11-20T11:48:15.927 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.920+0000 7f42792b5700 1 -- 172.21.15.192:0/1372077171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42740c06e0 msgr2=0x7f42740c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:15.927 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.920+0000 7f42792b5700 1 --2- 172.21.15.192:0/1372077171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42740c06e0 0x7f42740c5c00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f426800ed20 tx=0x7f4268006e30).stop 2020-11-20T11:48:15.927 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.920+0000 7f42737fe700 1 -- 172.21.15.192:0/1372077171 reap_dead start 2020-11-20T11:48:15.928 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.920+0000 7f42792b5700 1 -- 172.21.15.192:0/1372077171 shutdown_connections 2020-11-20T11:48:15.928 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.920+0000 7f42792b5700 1 -- 172.21.15.192:0/1372077171 >> 172.21.15.192:0/1372077171 conn(0x7f4274060c40 msgr2=0x7f427414d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:15.928 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.920+0000 7f42792b5700 1 -- 172.21.15.192:0/1372077171 shutdown_connections 2020-11-20T11:48:15.928 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:15.920+0000 7f42792b5700 1 -- 172.21.15.192:0/1372077171 wait complete. 2020-11-20T11:48:15.934 INFO:teuthology.orchestra.run.smithi192.stdout:73014444038 2020-11-20T11:48:15.935 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2020-11-20T11:48:16.050 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.047+0000 7f2b7f8c6700 1 Processor -- start 2020-11-20T11:48:16.050 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.047+0000 7f2b7f8c6700 1 -- start start 2020-11-20T11:48:16.054 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.048+0000 7f2b7f8c6700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b781520a0 con 0x7f2b78060370 2020-11-20T11:48:16.054 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.048+0000 7f2b7f8c6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b78065490 con 0x7f2b78060750 2020-11-20T11:48:16.055 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.048+0000 7f2b7f8c6700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b78065730 con 0x7f2b78151b30 2020-11-20T11:48:16.055 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.048+0000 7f2b7de63700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f2b78151b30 0x7f2b7815bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51806/0 (socket says 172.21.15.192:51806) 2020-11-20T11:48:16.055 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.048+0000 7f2b7de63700 1 -- 172.21.15.192:0/2017382830 learned_addr learned my addr 172.21.15.192:0/2017382830 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:16.055 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.048+0000 7f2b67fff700 1 -- 172.21.15.192:0/2017382830 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1812709759 0 0) 0x7f2b78065730 con 0x7f2b78151b30 2020-11-20T11:48:16.055 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.048+0000 7f2b67fff700 1 -- 172.21.15.192:0/2017382830 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b60003280 con 0x7f2b78151b30 2020-11-20T11:48:16.056 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.048+0000 7f2b67fff700 1 -- 172.21.15.192:0/2017382830 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1003836736 0 0) 0x7f2b781520a0 con 0x7f2b78060370 2020-11-20T11:48:16.056 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.048+0000 7f2b67fff700 1 -- 172.21.15.192:0/2017382830 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b78065730 con 0x7f2b78060370 2020-11-20T11:48:16.056 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.048+0000 7f2b67fff700 1 -- 172.21.15.192:0/2017382830 <== mon.2 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 886472269 0 0) 0x7f2b60003280 con 0x7f2b78151b30 2020-11-20T11:48:16.056 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.048+0000 7f2b67fff700 1 -- 172.21.15.192:0/2017382830 >> v1:172.21.15.146:6789/0 conn(0x7f2b78060750 legacy=0x7f2b78150410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.056 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.048+0000 7f2b67fff700 1 -- 172.21.15.192:0/2017382830 >> v1:172.21.15.87:6789/0 conn(0x7f2b78060370 legacy=0x7f2b780bfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.057 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.048+0000 7f2b67fff700 1 -- 172.21.15.192:0/2017382830 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b780659d0 con 0x7f2b78151b30 2020-11-20T11:48:16.057 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.048+0000 7f2b67fff700 1 -- 172.21.15.192:0/2017382830 <== mon.2 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3985397220 0 0) 0x7f2b700018e0 con 0x7f2b78151b30 2020-11-20T11:48:16.057 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.048+0000 7f2b67fff700 1 -- 172.21.15.192:0/2017382830 >> v1:172.21.15.192:6789/0 conn(0x7f2b78151b30 legacy=0x7f2b7815bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.057 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.048+0000 7f2b67fff700 1 --2- 172.21.15.192:0/2017382830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b60003950 0x7f2b60003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:16.058 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.048+0000 7f2b67fff700 1 --2- 172.21.15.192:0/2017382830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b60004520 0x7f2b600049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:16.058 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.048+0000 7f2b67fff700 1 --2- 172.21.15.192:0/2017382830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b60004e90 0x7f2b6000b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:16.058 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.048+0000 7f2b67fff700 1 -- 172.21.15.192:0/2017382830 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6000bc60 con 0x7f2b60003950 2020-11-20T11:48:16.058 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.048+0000 7f2b67fff700 1 -- 172.21.15.192:0/2017382830 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6000bda0 con 0x7f2b60004520 2020-11-20T11:48:16.058 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.048+0000 7f2b67fff700 1 -- 172.21.15.192:0/2017382830 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6000bee0 con 0x7f2b60004e90 2020-11-20T11:48:16.059 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.049+0000 7f2b7de63700 1 --2- 172.21.15.192:0/2017382830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b60004e90 0x7f2b6000b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:16.059 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.049+0000 7f2b7d662700 1 --2- 172.21.15.192:0/2017382830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b60003950 0x7f2b60003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:16.059 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.049+0000 7f2b7ce61700 1 --2- 172.21.15.192:0/2017382830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b60004520 0x7f2b600049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:16.059 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.049+0000 7f2b7de63700 1 -- 172.21.15.192:0/2017382830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b60004520 msgr2=0x7f2b600049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:16.059 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.049+0000 7f2b7de63700 1 --2- 172.21.15.192:0/2017382830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b60004520 0x7f2b600049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:16.060 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.049+0000 7f2b7de63700 1 -- 172.21.15.192:0/2017382830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b60003950 msgr2=0x7f2b60003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:16.060 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.049+0000 7f2b7de63700 1 --2- 172.21.15.192:0/2017382830 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b60003950 0x7f2b60003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:16.060 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.049+0000 7f2b7de63700 1 -- 172.21.15.192:0/2017382830 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b60003280 con 0x7f2b60004e90 2020-11-20T11:48:16.060 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.049+0000 7f2b7de63700 1 -- 172.21.15.192:0/2017382830 reap_dead start 2020-11-20T11:48:16.061 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.049+0000 7f2b7de63700 1 --2- 172.21.15.192:0/2017382830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b60004e90 0x7f2b6000b770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f2b7000c840 tx=0x7f2b78065620).ready entity=mon.2 client_cookie=f3bd5f68dc941b81 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:16.061 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.049+0000 7f2b67fff700 1 -- 172.21.15.192:0/2017382830 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b70005bc0 con 0x7f2b60004e90 2020-11-20T11:48:16.061 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.049+0000 7f2b67fff700 1 -- 172.21.15.192:0/2017382830 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b70005d20 con 0x7f2b60004e90 2020-11-20T11:48:16.061 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.049+0000 7f2b67fff700 1 -- 172.21.15.192:0/2017382830 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b70007300 con 0x7f2b60004e90 2020-11-20T11:48:16.061 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.050+0000 7f2b7f8c6700 1 -- 172.21.15.192:0/2017382830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b60004e90 msgr2=0x7f2b6000b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.062 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.050+0000 7f2b7f8c6700 1 --2- 172.21.15.192:0/2017382830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b60004e90 0x7f2b6000b770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f2b7000c840 tx=0x7f2b78065620).stop 2020-11-20T11:48:16.062 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.050+0000 7f2b7f8c6700 1 -- 172.21.15.192:0/2017382830 shutdown_connections 2020-11-20T11:48:16.062 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.050+0000 7f2b7f8c6700 1 --2- 172.21.15.192:0/2017382830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b60004e90 0x7f2b6000b770 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:16.062 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.050+0000 7f2b7f8c6700 1 -- 172.21.15.192:0/2017382830 >> 172.21.15.192:0/2017382830 conn(0x7f2b780c46a0 msgr2=0x7f2b780c4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:16.062 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.050+0000 7f2b7f8c6700 1 -- 172.21.15.192:0/2017382830 shutdown_connections 2020-11-20T11:48:16.063 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.050+0000 7f2b7f8c6700 1 -- 172.21.15.192:0/2017382830 wait complete. 2020-11-20T11:48:16.063 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.051+0000 7f2b7f8c6700 1 Processor -- start 2020-11-20T11:48:16.063 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.051+0000 7f2b7f8c6700 1 -- start start 2020-11-20T11:48:16.066 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.052+0000 7f2b7f8c6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b60004e90 0x7f2b78114fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:16.067 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.052+0000 7f2b7f8c6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b78114260 0x7f2b781639a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:16.067 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.052+0000 7f2b7f8c6700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b78163e90 0x7f2b78115e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:16.067 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.052+0000 7f2b7f8c6700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b781155f0 con 0x7f2b78163e90 2020-11-20T11:48:16.067 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.052+0000 7f2b7f8c6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b78118170 con 0x7f2b60004e90 2020-11-20T11:48:16.067 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.052+0000 7f2b7f8c6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b78118410 con 0x7f2b78114260 2020-11-20T11:48:16.068 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.052+0000 7f2b7ce61700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b78114260 0x7f2b781639a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:16.068 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.052+0000 7f2b7ce61700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b78114260 0x7f2b781639a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49148/0 (socket says 172.21.15.192:49148) 2020-11-20T11:48:16.068 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.052+0000 7f2b7ce61700 1 -- 172.21.15.192:0/2311356730 learned_addr learned my addr 172.21.15.192:0/2311356730 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:16.068 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.052+0000 7f2b7de63700 1 --2- 172.21.15.192:0/2311356730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b78163e90 0x7f2b78115e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:16.068 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.052+0000 7f2b7d662700 1 --2- 172.21.15.192:0/2311356730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b60004e90 0x7f2b78114fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:16.069 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.052+0000 7f2b7ce61700 1 -- 172.21.15.192:0/2311356730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b60004e90 msgr2=0x7f2b78114fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.069 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.052+0000 7f2b7ce61700 1 --2- 172.21.15.192:0/2311356730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b60004e90 0x7f2b78114fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:16.069 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.052+0000 7f2b7ce61700 1 -- 172.21.15.192:0/2311356730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b78163e90 msgr2=0x7f2b78115e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.069 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.052+0000 7f2b7ce61700 1 --2- 172.21.15.192:0/2311356730 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2b78163e90 0x7f2b78115e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:16.070 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.052+0000 7f2b7ce61700 1 -- 172.21.15.192:0/2311356730 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b781186b0 con 0x7f2b78114260 2020-11-20T11:48:16.070 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.052+0000 7f2b7ce61700 1 --2- 172.21.15.192:0/2311356730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b78114260 0x7f2b781639a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f2b74007ba0 tx=0x7f2b74007bd0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:16.070 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.052+0000 7f2b657fa700 1 -- 172.21.15.192:0/2311356730 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7400f960 con 0x7f2b78114260 2020-11-20T11:48:16.070 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.052+0000 7f2b657fa700 1 -- 172.21.15.192:0/2311356730 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7400fac0 con 0x7f2b78114260 2020-11-20T11:48:16.070 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.052+0000 7f2b7f8c6700 1 -- 172.21.15.192:0/2311356730 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b78115990 con 0x7f2b78114260 2020-11-20T11:48:16.071 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.052+0000 7f2b657fa700 1 -- 172.21.15.192:0/2311356730 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7400fe40 con 0x7f2b78114260 2020-11-20T11:48:16.071 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.052+0000 7f2b7f8c6700 1 -- 172.21.15.192:0/2311356730 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b781146e0 con 0x7f2b78114260 2020-11-20T11:48:16.071 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.053+0000 7f2b7f8c6700 1 -- 172.21.15.192:0/2311356730 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2b78115810 con 0x7f2b78114260 2020-11-20T11:48:16.071 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.054+0000 7f2b657fa700 1 -- 172.21.15.192:0/2311356730 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f2b74025070 con 0x7f2b78114260 2020-11-20T11:48:16.071 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.054+0000 7f2b657fa700 1 --2- 172.21.15.192:0/2311356730 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f2b50080670 0x7f2b50082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:16.072 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.054+0000 7f2b657fa700 1 -- 172.21.15.192:0/2311356730 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f2b740a33f0 con 0x7f2b78114260 2020-11-20T11:48:16.072 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.054+0000 7f2b7d662700 1 --2- 172.21.15.192:0/2311356730 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f2b50080670 0x7f2b50082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:16.072 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.054+0000 7f2b657fa700 1 --2- 172.21.15.192:0/2311356730 >> [v2:172.21.15.87:6824/23333,v1:172.21.15.87:6825/23333] conn(0x7f2b500893a0 0x7f2b5008b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:16.072 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.054+0000 7f2b657fa700 1 -- 172.21.15.192:0/2311356730 --> [v2:172.21.15.87:6824/23333,v1:172.21.15.87:6825/23333] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b5008be20 con 0x7f2b500893a0 2020-11-20T11:48:16.072 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.054+0000 7f2b657fa700 1 -- 172.21.15.192:0/2311356730 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b740a3760 con 0x7f2b78114260 2020-11-20T11:48:16.073 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.055+0000 7f2b7d662700 1 --2- 172.21.15.192:0/2311356730 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f2b50080670 0x7f2b50082b30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f2b68000c00 tx=0x7f2b68009040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:16.073 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.055+0000 7f2b7de63700 1 --2- 172.21.15.192:0/2311356730 >> [v2:172.21.15.87:6824/23333,v1:172.21.15.87:6825/23333] conn(0x7f2b500893a0 0x7f2b5008b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:16.073 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.055+0000 7f2b7de63700 1 --2- 172.21.15.192:0/2311356730 >> [v2:172.21.15.87:6824/23333,v1:172.21.15.87:6825/23333] conn(0x7f2b500893a0 0x7f2b5008b7c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:16.073 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.056+0000 7f2b657fa700 1 -- 172.21.15.192:0/2311356730 <== osd.8 v2:172.21.15.87:6824/23333 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f2b5008be20 con 0x7f2b500893a0 2020-11-20T11:48:16.075 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.070+0000 7f2b7f8c6700 1 -- 172.21.15.192:0/2311356730 --> [v2:172.21.15.87:6824/23333,v1:172.21.15.87:6825/23333] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2b7814e9f0 con 0x7f2b500893a0 2020-11-20T11:48:16.075 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.070+0000 7f2b657fa700 1 -- 172.21.15.192:0/2311356730 <== osd.8 v2:172.21.15.87:6824/23333 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2b7814e9f0 con 0x7f2b500893a0 2020-11-20T11:48:16.075 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.071+0000 7f2b7f8c6700 1 -- 172.21.15.192:0/2311356730 >> [v2:172.21.15.87:6824/23333,v1:172.21.15.87:6825/23333] conn(0x7f2b500893a0 msgr2=0x7f2b5008b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.075 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.071+0000 7f2b7f8c6700 1 --2- 172.21.15.192:0/2311356730 >> [v2:172.21.15.87:6824/23333,v1:172.21.15.87:6825/23333] conn(0x7f2b500893a0 0x7f2b5008b7c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:16.076 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.071+0000 7f2b7f8c6700 1 -- 172.21.15.192:0/2311356730 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f2b50080670 msgr2=0x7f2b50082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.076 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.071+0000 7f2b7f8c6700 1 --2- 172.21.15.192:0/2311356730 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f2b50080670 0x7f2b50082b30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f2b68000c00 tx=0x7f2b68009040).stop 2020-11-20T11:48:16.076 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.071+0000 7f2b7f8c6700 1 -- 172.21.15.192:0/2311356730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b78114260 msgr2=0x7f2b781639a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.076 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.071+0000 7f2b7f8c6700 1 --2- 172.21.15.192:0/2311356730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b78114260 0x7f2b781639a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f2b74007ba0 tx=0x7f2b74007bd0).stop 2020-11-20T11:48:16.077 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.071+0000 7f2b7de63700 1 -- 172.21.15.192:0/2311356730 reap_dead start 2020-11-20T11:48:16.077 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.071+0000 7f2b7f8c6700 1 -- 172.21.15.192:0/2311356730 shutdown_connections 2020-11-20T11:48:16.077 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.071+0000 7f2b7f8c6700 1 -- 172.21.15.192:0/2311356730 >> 172.21.15.192:0/2311356730 conn(0x7f2b780c46a0 msgr2=0x7f2b7814db20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:16.077 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.071+0000 7f2b7f8c6700 1 -- 172.21.15.192:0/2311356730 shutdown_connections 2020-11-20T11:48:16.077 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.071+0000 7f2b7f8c6700 1 -- 172.21.15.192:0/2311356730 wait complete. 2020-11-20T11:48:16.085 INFO:teuthology.orchestra.run.smithi192.stdout:73014444038 2020-11-20T11:48:16.085 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2020-11-20T11:48:16.196 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.193+0000 7f449a249700 1 Processor -- start 2020-11-20T11:48:16.196 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.193+0000 7f449a249700 1 -- start start 2020-11-20T11:48:16.198 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.193+0000 7f449a249700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f44940bf160 0x7f44940bf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:16.199 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.194+0000 7f449a249700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4494152680 con 0x7f44941537d0 2020-11-20T11:48:16.199 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.194+0000 7f449a249700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4494064730 con 0x7f4494151be0 2020-11-20T11:48:16.199 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.194+0000 7f449a249700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44941528b0 con 0x7f44940bf160 2020-11-20T11:48:16.199 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.194+0000 7f4492ffd700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f4494151be0 0x7f4494062740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51824/0 (socket says 172.21.15.192:51824) 2020-11-20T11:48:16.200 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.194+0000 7f4492ffd700 1 -- 172.21.15.192:0/3469695795 learned_addr learned my addr 172.21.15.192:0/3469695795 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:16.200 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.194+0000 7f44937fe700 1 --2- 172.21.15.192:0/3469695795 >> v2:172.21.15.146:3300/0 conn(0x7f44940bf160 0x7f44940bf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:16.200 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.194+0000 7f44927fc700 1 -- 172.21.15.192:0/3469695795 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2834564414 0 0) 0x7f4494064730 con 0x7f4494151be0 2020-11-20T11:48:16.200 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.194+0000 7f44927fc700 1 -- 172.21.15.192:0/3469695795 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4480003280 con 0x7f4494151be0 2020-11-20T11:48:16.200 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.194+0000 7f44927fc700 1 -- 172.21.15.192:0/3469695795 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2906447219 0 0) 0x7f4494152680 con 0x7f44941537d0 2020-11-20T11:48:16.201 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.194+0000 7f44927fc700 1 -- 172.21.15.192:0/3469695795 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4494064730 con 0x7f44941537d0 2020-11-20T11:48:16.201 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.194+0000 7f44937fe700 1 -- 172.21.15.192:0/3469695795 >> v1:172.21.15.192:6789/0 conn(0x7f4494151be0 legacy=0x7f4494062740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.201 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.194+0000 7f44927fc700 1 -- 172.21.15.192:0/3469695795 <== mon.2 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1459517879 0 0) 0x7f4480003280 con 0x7f4494151be0 2020-11-20T11:48:16.202 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.194+0000 7f44937fe700 1 -- 172.21.15.192:0/3469695795 >> v1:172.21.15.87:6789/0 conn(0x7f44941537d0 legacy=0x7f4494153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.202 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.194+0000 7f44937fe700 1 -- 172.21.15.192:0/3469695795 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4494152b50 con 0x7f44940bf160 2020-11-20T11:48:16.202 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.194+0000 7f44937fe700 1 --2- 172.21.15.192:0/3469695795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44940bf160 0x7f44940bf540 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f448800b980 tx=0x7f4488006dd0).ready entity=mon.1 client_cookie=d431592a16e7ae49 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:16.202 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.195+0000 7f44927fc700 1 -- 172.21.15.192:0/3469695795 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4484001520 con 0x7f44940bf160 2020-11-20T11:48:16.202 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.195+0000 7f44927fc700 1 -- 172.21.15.192:0/3469695795 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4488000e90 con 0x7f44940bf160 2020-11-20T11:48:16.203 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.195+0000 7f44927fc700 1 -- 172.21.15.192:0/3469695795 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4488011610 con 0x7f44940bf160 2020-11-20T11:48:16.203 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.195+0000 7f449a249700 1 -- 172.21.15.192:0/3469695795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44940bf160 msgr2=0x7f44940bf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.203 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.195+0000 7f449a249700 1 --2- 172.21.15.192:0/3469695795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44940bf160 0x7f44940bf540 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f448800b980 tx=0x7f4488006dd0).stop 2020-11-20T11:48:16.203 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.195+0000 7f449a249700 1 -- 172.21.15.192:0/3469695795 shutdown_connections 2020-11-20T11:48:16.204 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.195+0000 7f449a249700 1 --2- 172.21.15.192:0/3469695795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44940bf160 0x7f44940bf540 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:16.204 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.195+0000 7f449a249700 1 -- 172.21.15.192:0/3469695795 >> 172.21.15.192:0/3469695795 conn(0x7f44940601b0 msgr2=0x7f44940605c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:16.204 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.195+0000 7f449a249700 1 -- 172.21.15.192:0/3469695795 shutdown_connections 2020-11-20T11:48:16.205 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.195+0000 7f449a249700 1 -- 172.21.15.192:0/3469695795 wait complete. 2020-11-20T11:48:16.208 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.196+0000 7f449a249700 1 Processor -- start 2020-11-20T11:48:16.208 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.196+0000 7f449a249700 1 -- start start 2020-11-20T11:48:16.208 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.197+0000 7f449a249700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44940bf160 0x7f44941645f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:16.208 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.197+0000 7f449a249700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4494151be0 0x7f4494149d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:16.209 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.197+0000 7f449a249700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44941537d0 0x7f4494110190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:16.209 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.197+0000 7f449a249700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4494164ae0 con 0x7f44940bf160 2020-11-20T11:48:16.209 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.197+0000 7f449a249700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4494160640 con 0x7f44941537d0 2020-11-20T11:48:16.209 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.197+0000 7f449a249700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44941608d0 con 0x7f4494151be0 2020-11-20T11:48:16.210 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.197+0000 7f4492ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4494151be0 0x7f4494149d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:16.210 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.197+0000 7f4492ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4494151be0 0x7f4494149d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49162/0 (socket says 172.21.15.192:49162) 2020-11-20T11:48:16.210 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.197+0000 7f4492ffd700 1 -- 172.21.15.192:0/1078746792 learned_addr learned my addr 172.21.15.192:0/1078746792 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:16.210 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.197+0000 7f4492ffd700 1 -- 172.21.15.192:0/1078746792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44941537d0 msgr2=0x7f4494110190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.210 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.197+0000 7f44937fe700 1 --2- 172.21.15.192:0/1078746792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44940bf160 0x7f44941645f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:16.211 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.197+0000 7f4492ffd700 1 --2- 172.21.15.192:0/1078746792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44941537d0 0x7f4494110190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:48:16.211 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.197+0000 7f4492ffd700 1 -- 172.21.15.192:0/1078746792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44940bf160 msgr2=0x7f44941645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.211 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.197+0000 7f4492ffd700 1 --2- 172.21.15.192:0/1078746792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f44940bf160 0x7f44941645f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:16.211 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.197+0000 7f4492ffd700 1 -- 172.21.15.192:0/1078746792 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4494160b70 con 0x7f4494151be0 2020-11-20T11:48:16.212 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.198+0000 7f4492ffd700 1 --2- 172.21.15.192:0/1078746792 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4494151be0 0x7f4494149d50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f44840010e0 tx=0x7f4484001b80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:16.212 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.198+0000 7f44737fe700 1 -- 172.21.15.192:0/1078746792 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4484007170 con 0x7f4494151be0 2020-11-20T11:48:16.212 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.198+0000 7f44737fe700 1 -- 172.21.15.192:0/1078746792 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44840072d0 con 0x7f4494151be0 2020-11-20T11:48:16.213 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.198+0000 7f44737fe700 1 -- 172.21.15.192:0/1078746792 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448400aa80 con 0x7f4494151be0 2020-11-20T11:48:16.213 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.198+0000 7f449a249700 1 -- 172.21.15.192:0/1078746792 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4494160e10 con 0x7f4494151be0 2020-11-20T11:48:16.213 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.198+0000 7f449a249700 1 -- 172.21.15.192:0/1078746792 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4494161350 con 0x7f4494151be0 2020-11-20T11:48:16.213 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.199+0000 7f449a249700 1 -- 172.21.15.192:0/1078746792 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f44940c0940 con 0x7f4494151be0 2020-11-20T11:48:16.214 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.199+0000 7f44737fe700 1 -- 172.21.15.192:0/1078746792 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f4484010070 con 0x7f4494151be0 2020-11-20T11:48:16.214 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.200+0000 7f44737fe700 1 --2- 172.21.15.192:0/1078746792 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f446c0806a0 0x7f446c082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:16.215 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.200+0000 7f44737fe700 1 -- 172.21.15.192:0/1078746792 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f44840a2ef0 con 0x7f4494151be0 2020-11-20T11:48:16.215 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.200+0000 7f44937fe700 1 --2- 172.21.15.192:0/1078746792 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f446c0806a0 0x7f446c082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:16.215 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.200+0000 7f44737fe700 1 --2- 172.21.15.192:0/1078746792 >> [v2:172.21.15.192:6818/23254,v1:172.21.15.192:6819/23254] conn(0x7f446c089350 0x7f446c08b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:16.215 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.200+0000 7f44737fe700 1 -- 172.21.15.192:0/1078746792 --> [v2:172.21.15.192:6818/23254,v1:172.21.15.192:6819/23254] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f446c08bdd0 con 0x7f446c089350 2020-11-20T11:48:16.216 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.200+0000 7f44737fe700 1 -- 172.21.15.192:0/1078746792 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44840a3260 con 0x7f4494151be0 2020-11-20T11:48:16.216 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.200+0000 7f4493fff700 1 --2- 172.21.15.192:0/1078746792 >> [v2:172.21.15.192:6818/23254,v1:172.21.15.192:6819/23254] conn(0x7f446c089350 0x7f446c08b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:16.216 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.200+0000 7f44937fe700 1 --2- 172.21.15.192:0/1078746792 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f446c0806a0 0x7f446c082b60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f448800b980 tx=0x7f4488015000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:16.216 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.201+0000 7f4493fff700 1 --2- 172.21.15.192:0/1078746792 >> [v2:172.21.15.192:6818/23254,v1:172.21.15.192:6819/23254] conn(0x7f446c089350 0x7f446c08b770 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:16.216 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.201+0000 7f44737fe700 1 -- 172.21.15.192:0/1078746792 <== osd.9 v2:172.21.15.192:6818/23254 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f446c08bdd0 con 0x7f446c089350 2020-11-20T11:48:16.218 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.215+0000 7f449a249700 1 -- 172.21.15.192:0/1078746792 --> [v2:172.21.15.192:6818/23254,v1:172.21.15.192:6819/23254] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4494110940 con 0x7f446c089350 2020-11-20T11:48:16.219 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.215+0000 7f44737fe700 1 -- 172.21.15.192:0/1078746792 <== osd.9 v2:172.21.15.192:6818/23254 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4494110940 con 0x7f446c089350 2020-11-20T11:48:16.219 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.215+0000 7f449a249700 1 -- 172.21.15.192:0/1078746792 >> [v2:172.21.15.192:6818/23254,v1:172.21.15.192:6819/23254] conn(0x7f446c089350 msgr2=0x7f446c08b770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.219 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.215+0000 7f449a249700 1 --2- 172.21.15.192:0/1078746792 >> [v2:172.21.15.192:6818/23254,v1:172.21.15.192:6819/23254] conn(0x7f446c089350 0x7f446c08b770 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:16.220 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.215+0000 7f449a249700 1 -- 172.21.15.192:0/1078746792 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f446c0806a0 msgr2=0x7f446c082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.220 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.215+0000 7f449a249700 1 --2- 172.21.15.192:0/1078746792 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f446c0806a0 0x7f446c082b60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f448800b980 tx=0x7f4488015000).stop 2020-11-20T11:48:16.220 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.215+0000 7f449a249700 1 -- 172.21.15.192:0/1078746792 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4494151be0 msgr2=0x7f4494149d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.220 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.215+0000 7f449a249700 1 --2- 172.21.15.192:0/1078746792 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4494151be0 0x7f4494149d50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f44840010e0 tx=0x7f4484001b80).stop 2020-11-20T11:48:16.221 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.215+0000 7f4493fff700 1 -- 172.21.15.192:0/1078746792 reap_dead start 2020-11-20T11:48:16.221 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.215+0000 7f449a249700 1 -- 172.21.15.192:0/1078746792 shutdown_connections 2020-11-20T11:48:16.221 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.215+0000 7f449a249700 1 -- 172.21.15.192:0/1078746792 >> 172.21.15.192:0/1078746792 conn(0x7f44940601b0 msgr2=0x7f449414b080 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:16.221 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.216+0000 7f449a249700 1 -- 172.21.15.192:0/1078746792 shutdown_connections 2020-11-20T11:48:16.221 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.216+0000 7f449a249700 1 -- 172.21.15.192:0/1078746792 wait complete. 2020-11-20T11:48:16.229 INFO:teuthology.orchestra.run.smithi192.stdout:73014444037 2020-11-20T11:48:16.230 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 flush_pg_stats 2020-11-20T11:48:16.339 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.336+0000 7f0ed51e2700 1 Processor -- start 2020-11-20T11:48:16.339 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.336+0000 7f0ed51e2700 1 -- start start 2020-11-20T11:48:16.341 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.337+0000 7f0ed51e2700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0ed0154920 0x7f0ed0060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:16.342 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.337+0000 7f0ed51e2700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed0151e80 con 0x7f0ed0064c40 2020-11-20T11:48:16.342 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.337+0000 7f0ed51e2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed0152120 con 0x7f0ed0060370 2020-11-20T11:48:16.342 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.337+0000 7f0ed51e2700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed0064260 con 0x7f0ed0154920 2020-11-20T11:48:16.342 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.337+0000 7f0ece59c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0ed0154920 0x7f0ed0060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:16.343 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.337+0000 7f0ece59c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0ed0154920 0x7f0ed0060750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49174/0 (socket says 172.21.15.192:49174) 2020-11-20T11:48:16.343 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.337+0000 7f0ece59c700 1 -- 172.21.15.192:0/3521976790 learned_addr learned my addr 172.21.15.192:0/3521976790 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:16.343 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.337+0000 7f0ece59c700 1 -- 172.21.15.192:0/3521976790 >> v1:172.21.15.146:6789/0 conn(0x7f0ed0060370 legacy=0x7f0ed00c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.343 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.337+0000 7f0ece59c700 1 -- 172.21.15.192:0/3521976790 >> v1:172.21.15.87:6789/0 conn(0x7f0ed0064c40 legacy=0x7f0ed0151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.344 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.337+0000 7f0ece59c700 1 -- 172.21.15.192:0/3521976790 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed0064500 con 0x7f0ed0154920 2020-11-20T11:48:16.344 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.337+0000 7f0ece59c700 1 --2- 172.21.15.192:0/3521976790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ed0154920 0x7f0ed0060750 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f0ec0009a10 tx=0x7f0ec0006ef0).ready entity=mon.2 client_cookie=f961a0c58b815b87 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:16.344 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.337+0000 7f0ecdd9b700 1 -- 172.21.15.192:0/3521976790 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec000b8f0 con 0x7f0ed0154920 2020-11-20T11:48:16.344 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.337+0000 7f0ecdd9b700 1 -- 172.21.15.192:0/3521976790 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec0000e90 con 0x7f0ed0154920 2020-11-20T11:48:16.345 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.337+0000 7f0ecdd9b700 1 -- 172.21.15.192:0/3521976790 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec000bc60 con 0x7f0ed0154920 2020-11-20T11:48:16.345 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.338+0000 7f0ed51e2700 1 -- 172.21.15.192:0/3521976790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ed0154920 msgr2=0x7f0ed0060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.345 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.338+0000 7f0ed51e2700 1 --2- 172.21.15.192:0/3521976790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ed0154920 0x7f0ed0060750 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f0ec0009a10 tx=0x7f0ec0006ef0).stop 2020-11-20T11:48:16.345 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.338+0000 7f0ed51e2700 1 -- 172.21.15.192:0/3521976790 shutdown_connections 2020-11-20T11:48:16.345 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.338+0000 7f0ed51e2700 1 --2- 172.21.15.192:0/3521976790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ed0154920 0x7f0ed0060750 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:16.346 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.338+0000 7f0ed51e2700 1 -- 172.21.15.192:0/3521976790 >> 172.21.15.192:0/3521976790 conn(0x7f0ed0062100 msgr2=0x7f0ed00c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:16.346 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.338+0000 7f0ed51e2700 1 -- 172.21.15.192:0/3521976790 shutdown_connections 2020-11-20T11:48:16.346 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.338+0000 7f0ed51e2700 1 -- 172.21.15.192:0/3521976790 wait complete. 2020-11-20T11:48:16.349 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.339+0000 7f0ed51e2700 1 Processor -- start 2020-11-20T11:48:16.350 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.339+0000 7f0ed51e2700 1 -- start start 2020-11-20T11:48:16.350 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.340+0000 7f0ed51e2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ed0060370 0x7f0ed0148ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:16.350 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.340+0000 7f0ed51e2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ed0064c40 0x7f0ed0067c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:16.350 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.340+0000 7f0ed51e2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ed0154920 0x7f0ed00c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:16.351 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.340+0000 7f0ed51e2700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed0164e30 con 0x7f0ed0064c40 2020-11-20T11:48:16.351 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.340+0000 7f0ed51e2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed0164b90 con 0x7f0ed0154920 2020-11-20T11:48:16.351 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.340+0000 7f0ed51e2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed0160af0 con 0x7f0ed0060370 2020-11-20T11:48:16.351 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.340+0000 7f0eced9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ed0060370 0x7f0ed0148ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:16.352 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.340+0000 7f0eced9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ed0060370 0x7f0ed0148ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49178/0 (socket says 172.21.15.192:49178) 2020-11-20T11:48:16.352 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.340+0000 7f0eced9d700 1 -- 172.21.15.192:0/3993719016 learned_addr learned my addr 172.21.15.192:0/3993719016 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:16.352 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.340+0000 7f0ece59c700 1 --2- 172.21.15.192:0/3993719016 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ed0064c40 0x7f0ed0067c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:16.352 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.340+0000 7f0ecf59e700 1 --2- 172.21.15.192:0/3993719016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ed0154920 0x7f0ed00c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:16.353 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.340+0000 7f0eced9d700 1 -- 172.21.15.192:0/3993719016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ed0154920 msgr2=0x7f0ed00c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.353 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.340+0000 7f0eced9d700 1 --2- 172.21.15.192:0/3993719016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ed0154920 0x7f0ed00c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:16.353 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.340+0000 7f0eced9d700 1 -- 172.21.15.192:0/3993719016 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ed0064c40 msgr2=0x7f0ed0067c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.354 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.340+0000 7f0eced9d700 1 --2- 172.21.15.192:0/3993719016 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ed0064c40 0x7f0ed0067c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:16.354 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.340+0000 7f0eced9d700 1 -- 172.21.15.192:0/3993719016 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed0160d90 con 0x7f0ed0060370 2020-11-20T11:48:16.354 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.340+0000 7f0ecf59e700 1 --2- 172.21.15.192:0/3993719016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ed0154920 0x7f0ed00c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:48:16.354 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.340+0000 7f0ece59c700 1 --2- 172.21.15.192:0/3993719016 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0ed0064c40 0x7f0ed0067c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:48:16.355 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.340+0000 7f0eced9d700 1 --2- 172.21.15.192:0/3993719016 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ed0060370 0x7f0ed0148ed0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f0ec400c710 tx=0x7f0ec4007c90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:16.355 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.340+0000 7f0eb6ffd700 1 -- 172.21.15.192:0/3993719016 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4007020 con 0x7f0ed0060370 2020-11-20T11:48:16.355 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.340+0000 7f0eb6ffd700 1 -- 172.21.15.192:0/3993719016 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec4007180 con 0x7f0ed0060370 2020-11-20T11:48:16.355 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.340+0000 7f0ed51e2700 1 -- 172.21.15.192:0/3993719016 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed0161030 con 0x7f0ed0060370 2020-11-20T11:48:16.355 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.340+0000 7f0eb6ffd700 1 -- 172.21.15.192:0/3993719016 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4006530 con 0x7f0ed0060370 2020-11-20T11:48:16.356 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.340+0000 7f0ed51e2700 1 -- 172.21.15.192:0/3993719016 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed0161770 con 0x7f0ed0060370 2020-11-20T11:48:16.356 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.341+0000 7f0ed51e2700 1 -- 172.21.15.192:0/3993719016 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0ed00699a0 con 0x7f0ed0060370 2020-11-20T11:48:16.356 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.342+0000 7f0eb6ffd700 1 -- 172.21.15.192:0/3993719016 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f0ec4018020 con 0x7f0ed0060370 2020-11-20T11:48:16.356 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.342+0000 7f0eb6ffd700 1 --2- 172.21.15.192:0/3993719016 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f0eac0806a0 0x7f0eac082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:16.356 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.342+0000 7f0eb6ffd700 1 -- 172.21.15.192:0/3993719016 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f0ec40a3260 con 0x7f0ed0060370 2020-11-20T11:48:16.357 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.342+0000 7f0ece59c700 1 --2- 172.21.15.192:0/3993719016 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f0eac0806a0 0x7f0eac082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:16.357 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.343+0000 7f0eb6ffd700 1 --2- 172.21.15.192:0/3993719016 >> [v2:172.21.15.146:6817/22859,v1:172.21.15.146:6819/22859] conn(0x7f0eac0893d0 0x7f0eac08b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:16.357 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.343+0000 7f0eb6ffd700 1 -- 172.21.15.192:0/3993719016 --> [v2:172.21.15.146:6817/22859,v1:172.21.15.146:6819/22859] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0eac08be50 con 0x7f0eac0893d0 2020-11-20T11:48:16.357 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.343+0000 7f0eb6ffd700 1 -- 172.21.15.192:0/3993719016 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ec40a3550 con 0x7f0ed0060370 2020-11-20T11:48:16.358 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.343+0000 7f0ece59c700 1 --2- 172.21.15.192:0/3993719016 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f0eac0806a0 0x7f0eac082b60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f0ec0009a10 tx=0x7f0ec0016000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:16.358 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.343+0000 7f0ecf59e700 1 --2- 172.21.15.192:0/3993719016 >> [v2:172.21.15.146:6817/22859,v1:172.21.15.146:6819/22859] conn(0x7f0eac0893d0 0x7f0eac08b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:16.358 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.343+0000 7f0ecf59e700 1 --2- 172.21.15.192:0/3993719016 >> [v2:172.21.15.146:6817/22859,v1:172.21.15.146:6819/22859] conn(0x7f0eac0893d0 0x7f0eac08b7f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:16.358 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.344+0000 7f0eb6ffd700 1 -- 172.21.15.192:0/3993719016 <== osd.10 v2:172.21.15.146:6817/22859 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f0eac08be50 con 0x7f0eac0893d0 2020-11-20T11:48:16.361 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.358+0000 7f0ed51e2700 1 -- 172.21.15.192:0/3993719016 --> [v2:172.21.15.146:6817/22859,v1:172.21.15.146:6819/22859] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0ed005ca80 con 0x7f0eac0893d0 2020-11-20T11:48:16.362 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.359+0000 7f0eb6ffd700 1 -- 172.21.15.192:0/3993719016 <== osd.10 v2:172.21.15.146:6817/22859 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0ed005ca80 con 0x7f0eac0893d0 2020-11-20T11:48:16.363 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.359+0000 7f0ed51e2700 1 -- 172.21.15.192:0/3993719016 >> [v2:172.21.15.146:6817/22859,v1:172.21.15.146:6819/22859] conn(0x7f0eac0893d0 msgr2=0x7f0eac08b7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.363 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.359+0000 7f0ed51e2700 1 --2- 172.21.15.192:0/3993719016 >> [v2:172.21.15.146:6817/22859,v1:172.21.15.146:6819/22859] conn(0x7f0eac0893d0 0x7f0eac08b7f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:16.363 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.359+0000 7f0ed51e2700 1 -- 172.21.15.192:0/3993719016 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f0eac0806a0 msgr2=0x7f0eac082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.363 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.359+0000 7f0ed51e2700 1 --2- 172.21.15.192:0/3993719016 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f0eac0806a0 0x7f0eac082b60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f0ec0009a10 tx=0x7f0ec0016000).stop 2020-11-20T11:48:16.363 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.359+0000 7f0ed51e2700 1 -- 172.21.15.192:0/3993719016 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ed0060370 msgr2=0x7f0ed0148ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.364 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.359+0000 7f0ed51e2700 1 --2- 172.21.15.192:0/3993719016 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ed0060370 0x7f0ed0148ed0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f0ec400c710 tx=0x7f0ec4007c90).stop 2020-11-20T11:48:16.364 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.359+0000 7f0ecf59e700 1 -- 172.21.15.192:0/3993719016 reap_dead start 2020-11-20T11:48:16.364 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.359+0000 7f0ed51e2700 1 -- 172.21.15.192:0/3993719016 shutdown_connections 2020-11-20T11:48:16.364 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.359+0000 7f0ed51e2700 1 -- 172.21.15.192:0/3993719016 >> 172.21.15.192:0/3993719016 conn(0x7f0ed0062100 msgr2=0x7f0ed0153430 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:16.364 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.359+0000 7f0ed51e2700 1 -- 172.21.15.192:0/3993719016 shutdown_connections 2020-11-20T11:48:16.365 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.359+0000 7f0ed51e2700 1 -- 172.21.15.192:0/3993719016 wait complete. 2020-11-20T11:48:16.373 INFO:teuthology.orchestra.run.smithi192.stdout:73014444038 2020-11-20T11:48:16.373 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 flush_pg_stats 2020-11-20T11:48:16.484 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.480+0000 7fb9a171c700 1 Processor -- start 2020-11-20T11:48:16.484 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.481+0000 7fb9a171c700 1 -- start start 2020-11-20T11:48:16.486 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.481+0000 7fb9a171c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb99c154920 0x7fb99c060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:16.486 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.481+0000 7fb9a171c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb99c064c40 0x7fb99c151340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:16.486 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.481+0000 7fb9a171c700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb99c151e80 con 0x7fb99c060370 2020-11-20T11:48:16.487 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.481+0000 7fb9a171c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb99c152120 con 0x7fb99c154920 2020-11-20T11:48:16.487 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.481+0000 7fb9a171c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb99c064260 con 0x7fb99c064c40 2020-11-20T11:48:16.487 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.481+0000 7fb99b7fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb99c064c40 0x7fb99c151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:16.487 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.482+0000 7fb99b7fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb99c064c40 0x7fb99c151340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49190/0 (socket says 172.21.15.192:49190) 2020-11-20T11:48:16.487 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.482+0000 7fb99b7fe700 1 -- 172.21.15.192:0/3505646158 learned_addr learned my addr 172.21.15.192:0/3505646158 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:16.488 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.482+0000 7fb993fff700 1 --2- 172.21.15.192:0/3505646158 >> v2:172.21.15.146:3300/0 conn(0x7fb99c154920 0x7fb99c060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:16.488 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.482+0000 7fb99b7fe700 1 -- 172.21.15.192:0/3505646158 >> v2:172.21.15.146:3300/0 conn(0x7fb99c154920 msgr2=0x7fb99c060750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:16.488 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.482+0000 7fb99b7fe700 1 --2- 172.21.15.192:0/3505646158 >> v2:172.21.15.146:3300/0 conn(0x7fb99c154920 0x7fb99c060750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:16.488 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.482+0000 7fb99b7fe700 1 -- 172.21.15.192:0/3505646158 >> v1:172.21.15.87:6789/0 conn(0x7fb99c060370 legacy=0x7fb99c0c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.489 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.482+0000 7fb99b7fe700 1 -- 172.21.15.192:0/3505646158 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb99c064500 con 0x7fb99c064c40 2020-11-20T11:48:16.489 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.482+0000 7fb99b7fe700 1 --2- 172.21.15.192:0/3505646158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb99c064c40 0x7fb99c151340 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fb99c065700 tx=0x7fb9940092d0).ready entity=mon.2 client_cookie=fc04b6c942e9c764 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:16.489 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.482+0000 7fb99a7fc700 1 -- 172.21.15.192:0/3505646158 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99400bc80 con 0x7fb99c064c40 2020-11-20T11:48:16.489 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.482+0000 7fb99a7fc700 1 -- 172.21.15.192:0/3505646158 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb99400bde0 con 0x7fb99c064c40 2020-11-20T11:48:16.489 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.482+0000 7fb99a7fc700 1 -- 172.21.15.192:0/3505646158 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb994011610 con 0x7fb99c064c40 2020-11-20T11:48:16.490 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.482+0000 7fb9a171c700 1 -- 172.21.15.192:0/3505646158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb99c064c40 msgr2=0x7fb99c151340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.490 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.482+0000 7fb9a171c700 1 --2- 172.21.15.192:0/3505646158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb99c064c40 0x7fb99c151340 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fb99c065700 tx=0x7fb9940092d0).stop 2020-11-20T11:48:16.490 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.483+0000 7fb9a171c700 1 -- 172.21.15.192:0/3505646158 shutdown_connections 2020-11-20T11:48:16.490 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.483+0000 7fb9a171c700 1 --2- 172.21.15.192:0/3505646158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb99c064c40 0x7fb99c151340 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:16.490 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.483+0000 7fb9a171c700 1 --2- 172.21.15.192:0/3505646158 >> v2:172.21.15.146:3300/0 conn(0x7fb99c154920 0x7fb99c060750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:16.491 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.483+0000 7fb9a171c700 1 -- 172.21.15.192:0/3505646158 >> 172.21.15.192:0/3505646158 conn(0x7fb99c062100 msgr2=0x7fb99c0c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:16.491 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.483+0000 7fb9a171c700 1 -- 172.21.15.192:0/3505646158 shutdown_connections 2020-11-20T11:48:16.491 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.483+0000 7fb9a171c700 1 -- 172.21.15.192:0/3505646158 wait complete. 2020-11-20T11:48:16.494 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.484+0000 7fb9a171c700 1 Processor -- start 2020-11-20T11:48:16.494 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.484+0000 7fb9a171c700 1 -- start start 2020-11-20T11:48:16.495 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.484+0000 7fb9a171c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb99c060370 0x7fb99c0c1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:16.495 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.484+0000 7fb9a171c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb99c064c40 0x7fb99c164560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:16.495 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.484+0000 7fb9a171c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb99c154920 0x7fb99c0676a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:16.495 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.484+0000 7fb9a171c700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb99c1588a0 con 0x7fb99c060370 2020-11-20T11:48:16.495 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.484+0000 7fb9a171c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb99c0c1df0 con 0x7fb99c154920 2020-11-20T11:48:16.496 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.484+0000 7fb9a171c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb99c160780 con 0x7fb99c064c40 2020-11-20T11:48:16.496 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.484+0000 7fb993fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb99c064c40 0x7fb99c164560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:16.496 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.485+0000 7fb993fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb99c064c40 0x7fb99c164560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49196/0 (socket says 172.21.15.192:49196) 2020-11-20T11:48:16.496 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.485+0000 7fb993fff700 1 -- 172.21.15.192:0/2604627578 learned_addr learned my addr 172.21.15.192:0/2604627578 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:16.496 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.485+0000 7fb99affd700 1 --2- 172.21.15.192:0/2604627578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb99c060370 0x7fb99c0c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:16.497 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.485+0000 7fb99b7fe700 1 --2- 172.21.15.192:0/2604627578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb99c154920 0x7fb99c0676a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:16.497 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.485+0000 7fb993fff700 1 -- 172.21.15.192:0/2604627578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb99c154920 msgr2=0x7fb99c0676a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.497 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.485+0000 7fb993fff700 1 --2- 172.21.15.192:0/2604627578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb99c154920 0x7fb99c0676a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:16.497 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.485+0000 7fb993fff700 1 -- 172.21.15.192:0/2604627578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb99c060370 msgr2=0x7fb99c0c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.497 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.485+0000 7fb993fff700 1 --2- 172.21.15.192:0/2604627578 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb99c060370 0x7fb99c0c1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:16.498 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.485+0000 7fb993fff700 1 -- 172.21.15.192:0/2604627578 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb99c160a20 con 0x7fb99c064c40 2020-11-20T11:48:16.498 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.485+0000 7fb99b7fe700 1 --2- 172.21.15.192:0/2604627578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb99c154920 0x7fb99c0676a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:48:16.498 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.485+0000 7fb993fff700 1 --2- 172.21.15.192:0/2604627578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb99c064c40 0x7fb99c164560 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fb98400c920 tx=0x7fb984008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:16.498 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.485+0000 7fb992ffd700 1 -- 172.21.15.192:0/2604627578 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb984007620 con 0x7fb99c064c40 2020-11-20T11:48:16.498 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.485+0000 7fb992ffd700 1 -- 172.21.15.192:0/2604627578 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb984007780 con 0x7fb99c064c40 2020-11-20T11:48:16.499 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.485+0000 7fb992ffd700 1 -- 172.21.15.192:0/2604627578 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb984007b00 con 0x7fb99c064c40 2020-11-20T11:48:16.499 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.485+0000 7fb9a171c700 1 -- 172.21.15.192:0/2604627578 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb99c160cc0 con 0x7fb99c064c40 2020-11-20T11:48:16.499 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.485+0000 7fb9a171c700 1 -- 172.21.15.192:0/2604627578 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb99c161200 con 0x7fb99c064c40 2020-11-20T11:48:16.499 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.486+0000 7fb9a171c700 1 -- 172.21.15.192:0/2604627578 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb99c0699a0 con 0x7fb99c064c40 2020-11-20T11:48:16.499 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.487+0000 7fb992ffd700 1 -- 172.21.15.192:0/2604627578 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fb984025430 con 0x7fb99c064c40 2020-11-20T11:48:16.500 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.487+0000 7fb992ffd700 1 --2- 172.21.15.192:0/2604627578 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fb9780806a0 0x7fb978082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:16.500 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.487+0000 7fb992ffd700 1 -- 172.21.15.192:0/2604627578 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fb9840a3520 con 0x7fb99c064c40 2020-11-20T11:48:16.500 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.487+0000 7fb99affd700 1 --2- 172.21.15.192:0/2604627578 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fb9780806a0 0x7fb978082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:16.500 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.487+0000 7fb992ffd700 1 --2- 172.21.15.192:0/2604627578 >> [v2:172.21.15.87:6808/23317,v1:172.21.15.87:6809/23317] conn(0x7fb9780893d0 0x7fb97808b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:16.500 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.487+0000 7fb992ffd700 1 -- 172.21.15.192:0/2604627578 --> [v2:172.21.15.87:6808/23317,v1:172.21.15.87:6809/23317] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb97808be50 con 0x7fb9780893d0 2020-11-20T11:48:16.501 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.487+0000 7fb992ffd700 1 -- 172.21.15.192:0/2604627578 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9840a3890 con 0x7fb99c064c40 2020-11-20T11:48:16.501 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.487+0000 7fb99affd700 1 --2- 172.21.15.192:0/2604627578 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fb9780806a0 0x7fb978082b60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fb98c000c00 tx=0x7fb98c007bb0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:16.501 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.488+0000 7fb99b7fe700 1 --2- 172.21.15.192:0/2604627578 >> [v2:172.21.15.87:6808/23317,v1:172.21.15.87:6809/23317] conn(0x7fb9780893d0 0x7fb97808b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:16.501 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.488+0000 7fb99b7fe700 1 --2- 172.21.15.192:0/2604627578 >> [v2:172.21.15.87:6808/23317,v1:172.21.15.87:6809/23317] conn(0x7fb9780893d0 0x7fb97808b7f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:16.501 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.489+0000 7fb992ffd700 1 -- 172.21.15.192:0/2604627578 <== osd.11 v2:172.21.15.87:6808/23317 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7fb97808be50 con 0x7fb9780893d0 2020-11-20T11:48:16.505 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.503+0000 7fb9a171c700 1 -- 172.21.15.192:0/2604627578 --> [v2:172.21.15.87:6808/23317,v1:172.21.15.87:6809/23317] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb99c0646e0 con 0x7fb9780893d0 2020-11-20T11:48:16.506 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.503+0000 7fb992ffd700 1 -- 172.21.15.192:0/2604627578 <== osd.11 v2:172.21.15.87:6808/23317 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb99c0646e0 con 0x7fb9780893d0 2020-11-20T11:48:16.507 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.504+0000 7fb9a171c700 1 -- 172.21.15.192:0/2604627578 >> [v2:172.21.15.87:6808/23317,v1:172.21.15.87:6809/23317] conn(0x7fb9780893d0 msgr2=0x7fb97808b7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.508 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.504+0000 7fb9a171c700 1 --2- 172.21.15.192:0/2604627578 >> [v2:172.21.15.87:6808/23317,v1:172.21.15.87:6809/23317] conn(0x7fb9780893d0 0x7fb97808b7f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:16.508 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.504+0000 7fb9a171c700 1 -- 172.21.15.192:0/2604627578 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fb9780806a0 msgr2=0x7fb978082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.508 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.504+0000 7fb9a171c700 1 --2- 172.21.15.192:0/2604627578 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fb9780806a0 0x7fb978082b60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fb98c000c00 tx=0x7fb98c007bb0).stop 2020-11-20T11:48:16.508 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.504+0000 7fb9a171c700 1 -- 172.21.15.192:0/2604627578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb99c064c40 msgr2=0x7fb99c164560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.508 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.504+0000 7fb9a171c700 1 --2- 172.21.15.192:0/2604627578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb99c064c40 0x7fb99c164560 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fb98400c920 tx=0x7fb984008040).stop 2020-11-20T11:48:16.509 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.504+0000 7fb99b7fe700 1 -- 172.21.15.192:0/2604627578 reap_dead start 2020-11-20T11:48:16.509 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.504+0000 7fb9a171c700 1 -- 172.21.15.192:0/2604627578 shutdown_connections 2020-11-20T11:48:16.509 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.504+0000 7fb9a171c700 1 -- 172.21.15.192:0/2604627578 >> 172.21.15.192:0/2604627578 conn(0x7fb99c062100 msgr2=0x7fb99c0c2340 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:16.509 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.504+0000 7fb9a171c700 1 -- 172.21.15.192:0/2604627578 shutdown_connections 2020-11-20T11:48:16.509 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.504+0000 7fb9a171c700 1 -- 172.21.15.192:0/2604627578 wait complete. 2020-11-20T11:48:16.518 INFO:teuthology.orchestra.run.smithi192.stdout:73014444037 2020-11-20T11:48:16.518 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2020-11-20T11:48:16.628 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.625+0000 7f3a88b2d700 1 Processor -- start 2020-11-20T11:48:16.628 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.625+0000 7f3a88b2d700 1 -- start start 2020-11-20T11:48:16.632 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.626+0000 7f3a88b2d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3a84060370 0x7f3a84060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:16.632 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.626+0000 7f3a88b2d700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a84151e80 con 0x7f3a84064c40 2020-11-20T11:48:16.632 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.626+0000 7f3a88b2d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a84152120 con 0x7f3a84154920 2020-11-20T11:48:16.633 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.626+0000 7f3a88b2d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a84064260 con 0x7f3a84060370 2020-11-20T11:48:16.633 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.626+0000 7f3a7bfff700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f3a84154920 0x7f3a840c2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51872/0 (socket says 172.21.15.192:51872) 2020-11-20T11:48:16.633 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.626+0000 7f3a7bfff700 1 -- 172.21.15.192:0/422483904 learned_addr learned my addr 172.21.15.192:0/422483904 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:16.633 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.626+0000 7f3a8259c700 1 --2- 172.21.15.192:0/422483904 >> v2:172.21.15.146:3300/0 conn(0x7f3a84060370 0x7f3a84060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:16.634 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.626+0000 7f3a81d9b700 1 -- 172.21.15.192:0/422483904 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3999798274 0 0) 0x7f3a84152120 con 0x7f3a84154920 2020-11-20T11:48:16.634 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.626+0000 7f3a81d9b700 1 -- 172.21.15.192:0/422483904 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a64003280 con 0x7f3a84154920 2020-11-20T11:48:16.634 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.626+0000 7f3a81d9b700 1 -- 172.21.15.192:0/422483904 <== mon.2 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 697329840 0 0) 0x7f3a64003280 con 0x7f3a84154920 2020-11-20T11:48:16.635 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.626+0000 7f3a81d9b700 1 -- 172.21.15.192:0/422483904 >> v2:172.21.15.146:3300/0 conn(0x7f3a84060370 msgr2=0x7f3a84060750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:16.635 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.626+0000 7f3a81d9b700 1 --2- 172.21.15.192:0/422483904 >> v2:172.21.15.146:3300/0 conn(0x7f3a84060370 0x7f3a84060750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:16.635 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.626+0000 7f3a81d9b700 1 -- 172.21.15.192:0/422483904 >> v1:172.21.15.87:6789/0 conn(0x7f3a84064c40 legacy=0x7f3a84151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.635 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.626+0000 7f3a81d9b700 1 -- 172.21.15.192:0/422483904 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a84064500 con 0x7f3a84154920 2020-11-20T11:48:16.635 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.626+0000 7f3a81d9b700 1 -- 172.21.15.192:0/422483904 <== mon.2 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3985397220 0 0) 0x7f3a6c001520 con 0x7f3a84154920 2020-11-20T11:48:16.636 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.626+0000 7f3a8259c700 1 --2- 172.21.15.192:0/422483904 >> v2:172.21.15.146:3300/0 conn(0x7f3a84060370 0x7f3a84060750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:48:16.636 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.627+0000 7f3a81d9b700 1 -- 172.21.15.192:0/422483904 >> v1:172.21.15.192:6789/0 conn(0x7f3a84154920 legacy=0x7f3a840c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.636 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.627+0000 7f3a81d9b700 1 --2- 172.21.15.192:0/422483904 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a640037c0 0x7f3a64003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:16.636 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.627+0000 7f3a81d9b700 1 --2- 172.21.15.192:0/422483904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a64004520 0x7f3a640049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:16.636 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.627+0000 7f3a81d9b700 1 --2- 172.21.15.192:0/422483904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a64004e90 0x7f3a6400b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:16.637 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.627+0000 7f3a81d9b700 1 -- 172.21.15.192:0/422483904 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a84064260 con 0x7f3a64004520 2020-11-20T11:48:16.637 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.627+0000 7f3a81d9b700 1 -- 172.21.15.192:0/422483904 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a64005340 con 0x7f3a640037c0 2020-11-20T11:48:16.637 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.627+0000 7f3a81d9b700 1 -- 172.21.15.192:0/422483904 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6400bc60 con 0x7f3a64004e90 2020-11-20T11:48:16.637 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.627+0000 7f3a82d9d700 1 --2- 172.21.15.192:0/422483904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a64004e90 0x7f3a6400b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:16.637 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.627+0000 7f3a8259c700 1 --2- 172.21.15.192:0/422483904 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a640037c0 0x7f3a64003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:16.638 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.627+0000 7f3a7bfff700 1 --2- 172.21.15.192:0/422483904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a64004520 0x7f3a640049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:16.638 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.627+0000 7f3a82d9d700 1 -- 172.21.15.192:0/422483904 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a640037c0 msgr2=0x7f3a64003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:16.638 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.627+0000 7f3a82d9d700 1 --2- 172.21.15.192:0/422483904 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a640037c0 0x7f3a64003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:16.638 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.627+0000 7f3a82d9d700 1 -- 172.21.15.192:0/422483904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a64004520 msgr2=0x7f3a640049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:16.638 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.627+0000 7f3a82d9d700 1 --2- 172.21.15.192:0/422483904 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a64004520 0x7f3a640049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:16.638 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.627+0000 7f3a82d9d700 1 -- 172.21.15.192:0/422483904 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a64003280 con 0x7f3a64004e90 2020-11-20T11:48:16.639 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.627+0000 7f3a82d9d700 1 -- 172.21.15.192:0/422483904 reap_dead start 2020-11-20T11:48:16.639 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.627+0000 7f3a82d9d700 1 --2- 172.21.15.192:0/422483904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a64004e90 0x7f3a6400b770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f3a7c001ef0 tx=0x7f3a7c007f50).ready entity=mon.2 client_cookie=41323d2e8dd5c46a server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:16.639 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.627+0000 7f3a81d9b700 1 -- 172.21.15.192:0/422483904 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c00c930 con 0x7f3a64004e90 2020-11-20T11:48:16.639 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.627+0000 7f3a81d9b700 1 -- 172.21.15.192:0/422483904 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7c00ca90 con 0x7f3a64004e90 2020-11-20T11:48:16.639 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.627+0000 7f3a81d9b700 1 -- 172.21.15.192:0/422483904 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c00ce50 con 0x7f3a64004e90 2020-11-20T11:48:16.640 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.628+0000 7f3a88b2d700 1 -- 172.21.15.192:0/422483904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a64004e90 msgr2=0x7f3a6400b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.640 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.628+0000 7f3a88b2d700 1 --2- 172.21.15.192:0/422483904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a64004e90 0x7f3a6400b770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f3a7c001ef0 tx=0x7f3a7c007f50).stop 2020-11-20T11:48:16.640 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.628+0000 7f3a88b2d700 1 -- 172.21.15.192:0/422483904 shutdown_connections 2020-11-20T11:48:16.640 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.628+0000 7f3a88b2d700 1 --2- 172.21.15.192:0/422483904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a64004e90 0x7f3a6400b770 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:16.640 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.628+0000 7f3a88b2d700 1 -- 172.21.15.192:0/422483904 >> 172.21.15.192:0/422483904 conn(0x7f3a84062100 msgr2=0x7f3a840c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:16.641 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.628+0000 7f3a88b2d700 1 -- 172.21.15.192:0/422483904 shutdown_connections 2020-11-20T11:48:16.641 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.628+0000 7f3a88b2d700 1 -- 172.21.15.192:0/422483904 wait complete. 2020-11-20T11:48:16.641 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.629+0000 7f3a88b2d700 1 Processor -- start 2020-11-20T11:48:16.641 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.629+0000 7f3a88b2d700 1 -- start start 2020-11-20T11:48:16.644 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.629+0000 7f3a88b2d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a64004e90 0x7f3a84161ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:16.644 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.629+0000 7f3a88b2d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a84160640 0x7f3a840bfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:16.644 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.629+0000 7f3a88b2d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a840c2c40 0x7f3a840b1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:16.645 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.629+0000 7f3a88b2d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a84160ac0 con 0x7f3a84160640 2020-11-20T11:48:16.645 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.629+0000 7f3a88b2d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a840c1dc0 con 0x7f3a840c2c40 2020-11-20T11:48:16.645 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.629+0000 7f3a88b2d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a840bf7b0 con 0x7f3a64004e90 2020-11-20T11:48:16.645 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.630+0000 7f3a8259c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a64004e90 0x7f3a84161ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:16.645 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.630+0000 7f3a8259c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a64004e90 0x7f3a84161ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49216/0 (socket says 172.21.15.192:49216) 2020-11-20T11:48:16.646 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.630+0000 7f3a8259c700 1 -- 172.21.15.192:0/1869392153 learned_addr learned my addr 172.21.15.192:0/1869392153 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:16.646 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.630+0000 7f3a82d9d700 1 --2- 172.21.15.192:0/1869392153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a840c2c40 0x7f3a840b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:16.646 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.630+0000 7f3a7bfff700 1 --2- 172.21.15.192:0/1869392153 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a84160640 0x7f3a840bfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:16.646 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.630+0000 7f3a8259c700 1 -- 172.21.15.192:0/1869392153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a840c2c40 msgr2=0x7f3a840b1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.646 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.630+0000 7f3a8259c700 1 --2- 172.21.15.192:0/1869392153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a840c2c40 0x7f3a840b1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:16.647 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.630+0000 7f3a8259c700 1 -- 172.21.15.192:0/1869392153 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a84160640 msgr2=0x7f3a840bfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.647 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.630+0000 7f3a8259c700 1 --2- 172.21.15.192:0/1869392153 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a84160640 0x7f3a840bfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:16.647 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.630+0000 7f3a8259c700 1 -- 172.21.15.192:0/1869392153 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a84160d00 con 0x7f3a64004e90 2020-11-20T11:48:16.647 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.630+0000 7f3a8259c700 1 --2- 172.21.15.192:0/1869392153 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a64004e90 0x7f3a84161ae0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f3a74011d30 tx=0x7f3a74006e30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:16.647 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.630+0000 7f3a7a7fc700 1 -- 172.21.15.192:0/1869392153 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a74011e90 con 0x7f3a64004e90 2020-11-20T11:48:16.648 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.630+0000 7f3a7a7fc700 1 -- 172.21.15.192:0/1869392153 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7400fd60 con 0x7f3a64004e90 2020-11-20T11:48:16.648 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.630+0000 7f3a88b2d700 1 -- 172.21.15.192:0/1869392153 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a84160fa0 con 0x7f3a64004e90 2020-11-20T11:48:16.648 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.630+0000 7f3a7a7fc700 1 -- 172.21.15.192:0/1869392153 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a74014650 con 0x7f3a64004e90 2020-11-20T11:48:16.648 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.630+0000 7f3a88b2d700 1 -- 172.21.15.192:0/1869392153 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a841614e0 con 0x7f3a64004e90 2020-11-20T11:48:16.648 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.631+0000 7f3a88b2d700 1 -- 172.21.15.192:0/1869392153 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a840699a0 con 0x7f3a64004e90 2020-11-20T11:48:16.649 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.632+0000 7f3a7a7fc700 1 -- 172.21.15.192:0/1869392153 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f3a74014a40 con 0x7f3a64004e90 2020-11-20T11:48:16.649 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.632+0000 7f3a7a7fc700 1 --2- 172.21.15.192:0/1869392153 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3a600806a0 0x7f3a60082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:16.649 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.632+0000 7f3a7bfff700 1 --2- 172.21.15.192:0/1869392153 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3a600806a0 0x7f3a60082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:16.649 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.632+0000 7f3a7a7fc700 1 -- 172.21.15.192:0/1869392153 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f3a740a32e0 con 0x7f3a64004e90 2020-11-20T11:48:16.649 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.632+0000 7f3a7bfff700 1 --2- 172.21.15.192:0/1869392153 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3a600806a0 0x7f3a60082b60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f3a840c8310 tx=0x7f3a6c009040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:16.650 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.635+0000 7f3a7a7fc700 1 -- 172.21.15.192:0/1869392153 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f3a74077cf0 con 0x7f3a64004e90 2020-11-20T11:48:16.777 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.774+0000 7f3a88b2d700 1 -- 172.21.15.192:0/1869392153 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3a840bfbd0 con 0x7f3a64004e90 2020-11-20T11:48:16.778 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.774+0000 7f3a7a7fc700 1 -- 172.21.15.192:0/1869392153 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3a74018030 con 0x7f3a64004e90 2020-11-20T11:48:16.778 INFO:teuthology.orchestra.run.smithi192.stdout:73014444036 2020-11-20T11:48:16.779 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.775+0000 7f3a88b2d700 1 -- 172.21.15.192:0/1869392153 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3a600806a0 msgr2=0x7f3a60082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.779 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.775+0000 7f3a88b2d700 1 --2- 172.21.15.192:0/1869392153 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3a600806a0 0x7f3a60082b60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f3a840c8310 tx=0x7f3a6c009040).stop 2020-11-20T11:48:16.780 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.776+0000 7f3a88b2d700 1 -- 172.21.15.192:0/1869392153 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a64004e90 msgr2=0x7f3a84161ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:16.780 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.776+0000 7f3a88b2d700 1 --2- 172.21.15.192:0/1869392153 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a64004e90 0x7f3a84161ae0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f3a74011d30 tx=0x7f3a74006e30).stop 2020-11-20T11:48:16.780 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.776+0000 7f3a88b2d700 1 -- 172.21.15.192:0/1869392153 shutdown_connections 2020-11-20T11:48:16.781 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.776+0000 7f3a88b2d700 1 --2- 172.21.15.192:0/1869392153 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3a600806a0 0x7f3a60082b60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:16.781 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.776+0000 7f3a88b2d700 1 --2- 172.21.15.192:0/1869392153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3a840c2c40 0x7f3a840b1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:16.781 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.776+0000 7f3a88b2d700 1 --2- 172.21.15.192:0/1869392153 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a64004e90 0x7f3a84161ae0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:16.782 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.776+0000 7f3a88b2d700 1 --2- 172.21.15.192:0/1869392153 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3a84160640 0x7f3a840bfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:16.782 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.776+0000 7f3a88b2d700 1 -- 172.21.15.192:0/1869392153 >> 172.21.15.192:0/1869392153 conn(0x7f3a84062100 msgr2=0x7f3a841534b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:16.782 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.776+0000 7f3a88b2d700 1 -- 172.21.15.192:0/1869392153 shutdown_connections 2020-11-20T11:48:16.782 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:16.776+0000 7f3a88b2d700 1 -- 172.21.15.192:0/1869392153 wait complete. 2020-11-20T11:48:16.790 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444037 got 73014444036 for osd.0 2020-11-20T11:48:17.791 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2020-11-20T11:48:17.905 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.902+0000 7efe3eed4700 1 Processor -- start 2020-11-20T11:48:17.906 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.902+0000 7efe3eed4700 1 -- start start 2020-11-20T11:48:17.911 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.903+0000 7efe3eed4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efe38060750 0x7efe380bdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:17.912 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.903+0000 7efe3eed4700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe380be420 con 0x7efe3814f470 2020-11-20T11:48:17.912 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.903+0000 7efe3eed4700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe381528b0 con 0x7efe38060370 2020-11-20T11:48:17.912 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.903+0000 7efe3eed4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe38152b50 con 0x7efe38060750 2020-11-20T11:48:17.912 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.903+0000 7efe3cc70700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7efe38060370 0x7efe380bf7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51892/0 (socket says 172.21.15.192:51892) 2020-11-20T11:48:17.913 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.903+0000 7efe3cc70700 1 -- 172.21.15.192:0/1417562414 learned_addr learned my addr 172.21.15.192:0/1417562414 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:17.913 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.904+0000 7efe37fff700 1 --2- 172.21.15.192:0/1417562414 >> v2:172.21.15.146:3300/0 conn(0x7efe38060750 0x7efe380bdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:17.913 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.904+0000 7efe377fe700 1 -- 172.21.15.192:0/1417562414 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 560690987 0 0) 0x7efe381528b0 con 0x7efe38060370 2020-11-20T11:48:17.913 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.904+0000 7efe377fe700 1 -- 172.21.15.192:0/1417562414 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe1c003280 con 0x7efe38060370 2020-11-20T11:48:17.914 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.904+0000 7efe377fe700 1 -- 172.21.15.192:0/1417562414 <== mon.2 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2837129015 0 0) 0x7efe1c003280 con 0x7efe38060370 2020-11-20T11:48:17.914 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.904+0000 7efe377fe700 1 -- 172.21.15.192:0/1417562414 >> v2:172.21.15.146:3300/0 conn(0x7efe38060750 msgr2=0x7efe380bdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:17.914 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.904+0000 7efe377fe700 1 --2- 172.21.15.192:0/1417562414 >> v2:172.21.15.146:3300/0 conn(0x7efe38060750 0x7efe380bdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:17.914 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.904+0000 7efe377fe700 1 -- 172.21.15.192:0/1417562414 >> v1:172.21.15.146:6789/0 conn(0x7efe3814f470 legacy=0x7efe3814f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:17.915 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.904+0000 7efe377fe700 1 -- 172.21.15.192:0/1417562414 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe38152df0 con 0x7efe38060370 2020-11-20T11:48:17.915 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.904+0000 7efe377fe700 1 -- 172.21.15.192:0/1417562414 <== mon.2 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3985397220 0 0) 0x7efe2c001520 con 0x7efe38060370 2020-11-20T11:48:17.915 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.904+0000 7efe377fe700 1 -- 172.21.15.192:0/1417562414 >> v1:172.21.15.192:6789/0 conn(0x7efe38060370 legacy=0x7efe380bf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:17.915 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.904+0000 7efe377fe700 1 --2- 172.21.15.192:0/1417562414 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe1c0037c0 0x7efe1c003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:17.916 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.904+0000 7efe377fe700 1 --2- 172.21.15.192:0/1417562414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe1c004520 0x7efe1c0049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:17.916 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.904+0000 7efe377fe700 1 --2- 172.21.15.192:0/1417562414 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe1c004e90 0x7efe1c00b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:17.916 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.904+0000 7efe377fe700 1 -- 172.21.15.192:0/1417562414 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe38152b50 con 0x7efe1c0037c0 2020-11-20T11:48:17.916 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.904+0000 7efe377fe700 1 -- 172.21.15.192:0/1417562414 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1c005340 con 0x7efe1c004520 2020-11-20T11:48:17.917 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.904+0000 7efe377fe700 1 -- 172.21.15.192:0/1417562414 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1c00bc60 con 0x7efe1c004e90 2020-11-20T11:48:17.917 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.904+0000 7efe3d471700 1 --2- 172.21.15.192:0/1417562414 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe1c004e90 0x7efe1c00b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:17.917 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.904+0000 7efe37fff700 1 --2- 172.21.15.192:0/1417562414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe1c004520 0x7efe1c0049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:17.917 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.904+0000 7efe3cc70700 1 --2- 172.21.15.192:0/1417562414 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe1c0037c0 0x7efe1c003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:17.917 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.904+0000 7efe3d471700 1 -- 172.21.15.192:0/1417562414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe1c004520 msgr2=0x7efe1c0049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:17.918 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.904+0000 7efe3d471700 1 --2- 172.21.15.192:0/1417562414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe1c004520 0x7efe1c0049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:17.918 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.904+0000 7efe3d471700 1 -- 172.21.15.192:0/1417562414 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe1c0037c0 msgr2=0x7efe1c003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:17.918 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.904+0000 7efe3d471700 1 --2- 172.21.15.192:0/1417562414 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe1c0037c0 0x7efe1c003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:17.918 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.904+0000 7efe3d471700 1 -- 172.21.15.192:0/1417562414 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe1c003280 con 0x7efe1c004e90 2020-11-20T11:48:17.919 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.904+0000 7efe3d471700 1 -- 172.21.15.192:0/1417562414 reap_dead start 2020-11-20T11:48:17.919 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.904+0000 7efe3d471700 1 --2- 172.21.15.192:0/1417562414 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe1c004e90 0x7efe1c00b770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7efe30001ef0 tx=0x7efe30007f50).ready entity=mon.2 client_cookie=9851453e1def25b4 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:17.919 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.905+0000 7efe377fe700 1 -- 172.21.15.192:0/1417562414 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3000c9e0 con 0x7efe1c004e90 2020-11-20T11:48:17.919 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.905+0000 7efe377fe700 1 -- 172.21.15.192:0/1417562414 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3000cb40 con 0x7efe1c004e90 2020-11-20T11:48:17.919 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.905+0000 7efe377fe700 1 -- 172.21.15.192:0/1417562414 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe300068b0 con 0x7efe1c004e90 2020-11-20T11:48:17.920 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.905+0000 7efe3eed4700 1 -- 172.21.15.192:0/1417562414 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe1c004e90 msgr2=0x7efe1c00b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:17.920 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.905+0000 7efe3eed4700 1 --2- 172.21.15.192:0/1417562414 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe1c004e90 0x7efe1c00b770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7efe30001ef0 tx=0x7efe30007f50).stop 2020-11-20T11:48:17.920 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.905+0000 7efe3eed4700 1 -- 172.21.15.192:0/1417562414 shutdown_connections 2020-11-20T11:48:17.920 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.905+0000 7efe3eed4700 1 --2- 172.21.15.192:0/1417562414 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe1c004e90 0x7efe1c00b770 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:17.921 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.905+0000 7efe3eed4700 1 -- 172.21.15.192:0/1417562414 >> 172.21.15.192:0/1417562414 conn(0x7efe38062100 msgr2=0x7efe380c3590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:17.921 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.905+0000 7efe3eed4700 1 -- 172.21.15.192:0/1417562414 shutdown_connections 2020-11-20T11:48:17.921 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.905+0000 7efe3eed4700 1 -- 172.21.15.192:0/1417562414 wait complete. 2020-11-20T11:48:17.921 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.906+0000 7efe3eed4700 1 Processor -- start 2020-11-20T11:48:17.921 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.906+0000 7efe3eed4700 1 -- start start 2020-11-20T11:48:17.922 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.907+0000 7efe3eed4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe1c004e90 0x7efe380b0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:17.922 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.907+0000 7efe3eed4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe380c13c0 0x7efe381640f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:17.922 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.907+0000 7efe3eed4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe381645e0 0x7efe380bbb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:17.922 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.907+0000 7efe3eed4700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe380c1d30 con 0x7efe381645e0 2020-11-20T11:48:17.922 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.907+0000 7efe3eed4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe380c1fd0 con 0x7efe1c004e90 2020-11-20T11:48:17.923 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.907+0000 7efe3eed4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe380c2270 con 0x7efe380c13c0 2020-11-20T11:48:17.923 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.907+0000 7efe37fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe380c13c0 0x7efe381640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:17.923 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.907+0000 7efe37fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe380c13c0 0x7efe381640f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49236/0 (socket says 172.21.15.192:49236) 2020-11-20T11:48:17.923 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.907+0000 7efe37fff700 1 -- 172.21.15.192:0/2112188840 learned_addr learned my addr 172.21.15.192:0/2112188840 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:17.924 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.907+0000 7efe3d471700 1 --2- 172.21.15.192:0/2112188840 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe381645e0 0x7efe380bbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:17.924 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.907+0000 7efe3cc70700 1 --2- 172.21.15.192:0/2112188840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe1c004e90 0x7efe380b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:17.924 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.907+0000 7efe37fff700 1 -- 172.21.15.192:0/2112188840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe1c004e90 msgr2=0x7efe380b0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:17.924 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.907+0000 7efe37fff700 1 --2- 172.21.15.192:0/2112188840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe1c004e90 0x7efe380b0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:17.925 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.907+0000 7efe37fff700 1 -- 172.21.15.192:0/2112188840 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe381645e0 msgr2=0x7efe380bbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:17.925 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.907+0000 7efe37fff700 1 --2- 172.21.15.192:0/2112188840 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe381645e0 0x7efe380bbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:17.925 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.907+0000 7efe37fff700 1 -- 172.21.15.192:0/2112188840 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe380bb450 con 0x7efe380c13c0 2020-11-20T11:48:17.925 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.907+0000 7efe3d471700 1 --2- 172.21.15.192:0/2112188840 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe381645e0 0x7efe380bbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:48:17.926 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.908+0000 7efe37fff700 1 --2- 172.21.15.192:0/2112188840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe380c13c0 0x7efe381640f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7efe240068a0 tx=0x7efe24006e30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:17.926 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.908+0000 7efe34ff9700 1 -- 172.21.15.192:0/2112188840 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2400fa10 con 0x7efe380c13c0 2020-11-20T11:48:17.926 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.908+0000 7efe34ff9700 1 -- 172.21.15.192:0/2112188840 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2400fb70 con 0x7efe380c13c0 2020-11-20T11:48:17.926 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.908+0000 7efe3eed4700 1 -- 172.21.15.192:0/2112188840 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe380bb6f0 con 0x7efe380c13c0 2020-11-20T11:48:17.926 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.908+0000 7efe34ff9700 1 -- 172.21.15.192:0/2112188840 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe24014440 con 0x7efe380c13c0 2020-11-20T11:48:17.927 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.908+0000 7efe3eed4700 1 -- 172.21.15.192:0/2112188840 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe380b0a60 con 0x7efe380c13c0 2020-11-20T11:48:17.928 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.909+0000 7efe3eed4700 1 -- 172.21.15.192:0/2112188840 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe380c2430 con 0x7efe380c13c0 2020-11-20T11:48:17.928 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.909+0000 7efe34ff9700 1 -- 172.21.15.192:0/2112188840 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7efe24014870 con 0x7efe380c13c0 2020-11-20T11:48:17.928 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.910+0000 7efe34ff9700 1 --2- 172.21.15.192:0/2112188840 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7efe100806a0 0x7efe10082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:17.929 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.910+0000 7efe34ff9700 1 -- 172.21.15.192:0/2112188840 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7efe240a2ff0 con 0x7efe380c13c0 2020-11-20T11:48:17.929 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.910+0000 7efe3cc70700 1 --2- 172.21.15.192:0/2112188840 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7efe100806a0 0x7efe10082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:17.929 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.910+0000 7efe3cc70700 1 --2- 172.21.15.192:0/2112188840 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7efe100806a0 0x7efe10082b60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7efe2c001650 tx=0x7efe2c007040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:17.929 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:17.913+0000 7efe34ff9700 1 -- 172.21.15.192:0/2112188840 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7efe24077a90 con 0x7efe380c13c0 2020-11-20T11:48:18.057 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.054+0000 7efe3eed4700 1 -- 172.21.15.192:0/2112188840 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efe380699a0 con 0x7efe380c13c0 2020-11-20T11:48:18.058 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.055+0000 7efe34ff9700 1 -- 172.21.15.192:0/2112188840 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efe2407b0b0 con 0x7efe380c13c0 2020-11-20T11:48:18.058 INFO:teuthology.orchestra.run.smithi192.stdout:73014444037 2020-11-20T11:48:18.059 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.056+0000 7efe3eed4700 1 -- 172.21.15.192:0/2112188840 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7efe100806a0 msgr2=0x7efe10082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:18.060 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.056+0000 7efe3eed4700 1 --2- 172.21.15.192:0/2112188840 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7efe100806a0 0x7efe10082b60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7efe2c001650 tx=0x7efe2c007040).stop 2020-11-20T11:48:18.060 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.056+0000 7efe3eed4700 1 -- 172.21.15.192:0/2112188840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe380c13c0 msgr2=0x7efe381640f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:18.060 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.056+0000 7efe3eed4700 1 --2- 172.21.15.192:0/2112188840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe380c13c0 0x7efe381640f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7efe240068a0 tx=0x7efe24006e30).stop 2020-11-20T11:48:18.060 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.056+0000 7efe3eed4700 1 -- 172.21.15.192:0/2112188840 shutdown_connections 2020-11-20T11:48:18.060 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.056+0000 7efe3eed4700 1 --2- 172.21.15.192:0/2112188840 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7efe100806a0 0x7efe10082b60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:18.061 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.056+0000 7efe3eed4700 1 --2- 172.21.15.192:0/2112188840 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7efe381645e0 0x7efe380bbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:18.061 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.056+0000 7efe3eed4700 1 --2- 172.21.15.192:0/2112188840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe1c004e90 0x7efe380b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:18.061 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.056+0000 7efe3eed4700 1 --2- 172.21.15.192:0/2112188840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe380c13c0 0x7efe381640f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:18.061 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.056+0000 7efe3eed4700 1 -- 172.21.15.192:0/2112188840 >> 172.21.15.192:0/2112188840 conn(0x7efe38062100 msgr2=0x7efe38152150 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:18.061 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.056+0000 7efe3eed4700 1 -- 172.21.15.192:0/2112188840 shutdown_connections 2020-11-20T11:48:18.062 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.056+0000 7efe3eed4700 1 -- 172.21.15.192:0/2112188840 wait complete. 2020-11-20T11:48:18.070 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444037 got 73014444037 for osd.0 2020-11-20T11:48:18.071 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2020-11-20T11:48:18.180 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.177+0000 7fdcccf2c700 1 Processor -- start 2020-11-20T11:48:18.181 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.177+0000 7fdcccf2c700 1 -- start start 2020-11-20T11:48:18.183 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.178+0000 7fdcccf2c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdcc8154920 0x7fdcc8060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:18.183 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.178+0000 7fdcccf2c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc8151e80 con 0x7fdcc8060370 2020-11-20T11:48:18.183 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.178+0000 7fdcccf2c700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc8152120 con 0x7fdcc8064c40 2020-11-20T11:48:18.183 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.178+0000 7fdcccf2c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcc8064260 con 0x7fdcc8154920 2020-11-20T11:48:18.184 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.178+0000 7fdcc5d9b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdcc8154920 0x7fdcc8060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:18.184 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.178+0000 7fdcc6d9d700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fdcc8064c40 0x7fdcc8151340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51912/0 (socket says 172.21.15.192:51912) 2020-11-20T11:48:18.184 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.178+0000 7fdcc6d9d700 1 -- 172.21.15.192:0/3870820141 learned_addr learned my addr 172.21.15.192:0/3870820141 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:18.184 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.179+0000 7fdcc5d9b700 1 -- 172.21.15.192:0/3870820141 >> v1:172.21.15.192:6789/0 conn(0x7fdcc8064c40 legacy=0x7fdcc8151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:18.184 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.179+0000 7fdcc5d9b700 1 -- 172.21.15.192:0/3870820141 >> v1:172.21.15.146:6789/0 conn(0x7fdcc8060370 legacy=0x7fdcc80c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:18.185 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.179+0000 7fdcc559a700 1 -- 172.21.15.192:0/3870820141 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2390769283 0 0) 0x7fdcc8152120 con 0x7fdcc8064c40 2020-11-20T11:48:18.185 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.179+0000 7fdcc5d9b700 1 -- 172.21.15.192:0/3870820141 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc8064500 con 0x7fdcc8154920 2020-11-20T11:48:18.185 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.179+0000 7fdcc5d9b700 1 --2- 172.21.15.192:0/3870820141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcc8154920 0x7fdcc8060750 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fdcbc006fd0 tx=0x7fdcbc006e30).ready entity=mon.2 client_cookie=2dad70d174de8336 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:18.185 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.179+0000 7fdcc559a700 1 -- 172.21.15.192:0/3870820141 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc009870 con 0x7fdcc8154920 2020-11-20T11:48:18.185 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.179+0000 7fdcc559a700 1 -- 172.21.15.192:0/3870820141 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcbc000e90 con 0x7fdcc8154920 2020-11-20T11:48:18.186 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.179+0000 7fdcc559a700 1 -- 172.21.15.192:0/3870820141 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc009be0 con 0x7fdcc8154920 2020-11-20T11:48:18.186 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.179+0000 7fdcccf2c700 1 -- 172.21.15.192:0/3870820141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcc8154920 msgr2=0x7fdcc8060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:18.186 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.179+0000 7fdcccf2c700 1 --2- 172.21.15.192:0/3870820141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcc8154920 0x7fdcc8060750 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fdcbc006fd0 tx=0x7fdcbc006e30).stop 2020-11-20T11:48:18.186 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.179+0000 7fdcccf2c700 1 -- 172.21.15.192:0/3870820141 shutdown_connections 2020-11-20T11:48:18.186 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.179+0000 7fdcccf2c700 1 --2- 172.21.15.192:0/3870820141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcc8154920 0x7fdcc8060750 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:18.187 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.179+0000 7fdcccf2c700 1 -- 172.21.15.192:0/3870820141 >> 172.21.15.192:0/3870820141 conn(0x7fdcc8062100 msgr2=0x7fdcc80c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:18.187 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.179+0000 7fdcccf2c700 1 -- 172.21.15.192:0/3870820141 shutdown_connections 2020-11-20T11:48:18.187 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.180+0000 7fdcccf2c700 1 -- 172.21.15.192:0/3870820141 wait complete. 2020-11-20T11:48:18.189 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.181+0000 7fdcccf2c700 1 Processor -- start 2020-11-20T11:48:18.190 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.181+0000 7fdcccf2c700 1 -- start start 2020-11-20T11:48:18.190 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.181+0000 7fdcccf2c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcc8060370 0x7fdcc814cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:18.190 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.181+0000 7fdcccf2c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcc8064c40 0x7fdcc8157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:18.190 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.181+0000 7fdcccf2c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcc8154920 0x7fdcc80bf710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:18.191 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.181+0000 7fdcccf2c700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc814d100 con 0x7fdcc8154920 2020-11-20T11:48:18.191 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.181+0000 7fdcccf2c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc8163c40 con 0x7fdcc8060370 2020-11-20T11:48:18.191 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.181+0000 7fdcccf2c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc8163e70 con 0x7fdcc8064c40 2020-11-20T11:48:18.191 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.181+0000 7fdcc5d9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcc8064c40 0x7fdcc8157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:18.191 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.181+0000 7fdcc5d9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcc8064c40 0x7fdcc8157cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49252/0 (socket says 172.21.15.192:49252) 2020-11-20T11:48:18.192 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.181+0000 7fdcc5d9b700 1 -- 172.21.15.192:0/3823529378 learned_addr learned my addr 172.21.15.192:0/3823529378 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:18.192 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.181+0000 7fdcc659c700 1 --2- 172.21.15.192:0/3823529378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcc8060370 0x7fdcc814cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:18.192 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.182+0000 7fdcc5d9b700 1 -- 172.21.15.192:0/3823529378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcc8060370 msgr2=0x7fdcc814cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:18.192 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.182+0000 7fdcc5d9b700 1 --2- 172.21.15.192:0/3823529378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcc8060370 0x7fdcc814cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:18.192 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.182+0000 7fdcc5d9b700 1 -- 172.21.15.192:0/3823529378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcc8154920 msgr2=0x7fdcc80bf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:18.193 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.182+0000 7fdcc5d9b700 1 --2- 172.21.15.192:0/3823529378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcc8154920 0x7fdcc80bf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:48:18.193 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.182+0000 7fdcc5d9b700 1 -- 172.21.15.192:0/3823529378 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc8164110 con 0x7fdcc8064c40 2020-11-20T11:48:18.193 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.182+0000 7fdcc5d9b700 1 --2- 172.21.15.192:0/3823529378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcc8064c40 0x7fdcc8157cb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fdcbc010000 tx=0x7fdcbc015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:18.193 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.182+0000 7fdcb67fc700 1 -- 172.21.15.192:0/3823529378 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc011e40 con 0x7fdcc8064c40 2020-11-20T11:48:18.193 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.182+0000 7fdcb67fc700 1 -- 172.21.15.192:0/3823529378 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcbc01e460 con 0x7fdcc8064c40 2020-11-20T11:48:18.194 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.182+0000 7fdcccf2c700 1 -- 172.21.15.192:0/3823529378 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc81643b0 con 0x7fdcc8064c40 2020-11-20T11:48:18.194 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.182+0000 7fdcb67fc700 1 -- 172.21.15.192:0/3823529378 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc01e7e0 con 0x7fdcc8064c40 2020-11-20T11:48:18.194 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.182+0000 7fdcccf2c700 1 -- 172.21.15.192:0/3823529378 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc81581a0 con 0x7fdcc8064c40 2020-11-20T11:48:18.194 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.183+0000 7fdcccf2c700 1 -- 172.21.15.192:0/3823529378 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc80699a0 con 0x7fdcc8064c40 2020-11-20T11:48:18.194 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.184+0000 7fdcb67fc700 1 -- 172.21.15.192:0/3823529378 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fdcbc025030 con 0x7fdcc8064c40 2020-11-20T11:48:18.195 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.184+0000 7fdcb67fc700 1 --2- 172.21.15.192:0/3823529378 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fdc9c0806a0 0x7fdc9c082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:18.195 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.184+0000 7fdcb67fc700 1 -- 172.21.15.192:0/3823529378 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fdcbc0a4150 con 0x7fdcc8064c40 2020-11-20T11:48:18.195 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.184+0000 7fdcc659c700 1 --2- 172.21.15.192:0/3823529378 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fdc9c0806a0 0x7fdc9c082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:18.195 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.184+0000 7fdcc659c700 1 --2- 172.21.15.192:0/3823529378 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fdc9c0806a0 0x7fdc9c082b60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fdcb8007fd0 tx=0x7fdcb8007bd0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:18.196 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.187+0000 7fdcb67fc700 1 -- 172.21.15.192:0/3823529378 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fdcbc078b60 con 0x7fdcc8064c40 2020-11-20T11:48:18.333 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.330+0000 7fdcccf2c700 1 -- 172.21.15.192:0/3823529378 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdcc8164ab0 con 0x7fdcc8064c40 2020-11-20T11:48:18.334 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.330+0000 7fdcb67fc700 1 -- 172.21.15.192:0/3823529378 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdcbc023020 con 0x7fdcc8064c40 2020-11-20T11:48:18.334 INFO:teuthology.orchestra.run.smithi192.stdout:73014444037 2020-11-20T11:48:18.336 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.332+0000 7fdcccf2c700 1 -- 172.21.15.192:0/3823529378 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fdc9c0806a0 msgr2=0x7fdc9c082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:18.336 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.332+0000 7fdcccf2c700 1 --2- 172.21.15.192:0/3823529378 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fdc9c0806a0 0x7fdc9c082b60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fdcb8007fd0 tx=0x7fdcb8007bd0).stop 2020-11-20T11:48:18.337 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.332+0000 7fdcccf2c700 1 -- 172.21.15.192:0/3823529378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcc8064c40 msgr2=0x7fdcc8157cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:18.337 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.332+0000 7fdcccf2c700 1 --2- 172.21.15.192:0/3823529378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcc8064c40 0x7fdcc8157cb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fdcbc010000 tx=0x7fdcbc015000).stop 2020-11-20T11:48:18.337 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.332+0000 7fdcccf2c700 1 -- 172.21.15.192:0/3823529378 shutdown_connections 2020-11-20T11:48:18.337 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.332+0000 7fdcccf2c700 1 --2- 172.21.15.192:0/3823529378 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fdc9c0806a0 0x7fdc9c082b60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:18.338 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.332+0000 7fdcccf2c700 1 --2- 172.21.15.192:0/3823529378 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdcc8154920 0x7fdcc80bf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:48:18.338 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.332+0000 7fdcccf2c700 1 --2- 172.21.15.192:0/3823529378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcc8060370 0x7fdcc814cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:18.338 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.332+0000 7fdcccf2c700 1 --2- 172.21.15.192:0/3823529378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcc8064c40 0x7fdcc8157cb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:18.338 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.332+0000 7fdcccf2c700 1 -- 172.21.15.192:0/3823529378 >> 172.21.15.192:0/3823529378 conn(0x7fdcc8062100 msgr2=0x7fdcc8154e00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:18.338 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.332+0000 7fdcccf2c700 1 -- 172.21.15.192:0/3823529378 shutdown_connections 2020-11-20T11:48:18.338 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.332+0000 7fdcccf2c700 1 -- 172.21.15.192:0/3823529378 wait complete. 2020-11-20T11:48:18.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444037 got 73014444037 for osd.1 2020-11-20T11:48:18.347 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2020-11-20T11:48:18.458 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.455+0000 7fad4cc1a700 1 Processor -- start 2020-11-20T11:48:18.458 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.455+0000 7fad4cc1a700 1 -- start start 2020-11-20T11:48:18.460 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.456+0000 7fad4cc1a700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fad48151b30 0x7fad481554b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:18.460 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.456+0000 7fad4cc1a700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad481520a0 con 0x7fad48060370 2020-11-20T11:48:18.461 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.456+0000 7fad4cc1a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad48065490 con 0x7fad48060750 2020-11-20T11:48:18.461 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.456+0000 7fad4cc1a700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad480635d0 con 0x7fad48151b30 2020-11-20T11:48:18.462 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.456+0000 7fad45d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fad48060750 0x7fad48150410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.192:32982/0 (socket says 172.21.15.192:32982) 2020-11-20T11:48:18.463 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.456+0000 7fad45d9b700 1 -- 172.21.15.192:0/3218824551 learned_addr learned my addr 172.21.15.192:0/3218824551 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:18.463 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.456+0000 7fad46d9d700 1 --2- 172.21.15.192:0/3218824551 >> v2:172.21.15.87:3300/0 conn(0x7fad48151b30 0x7fad481554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:18.463 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.456+0000 7fad4559a700 1 -- 172.21.15.192:0/3218824551 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 719853191 0 0) 0x7fad48065490 con 0x7fad48060750 2020-11-20T11:48:18.463 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.456+0000 7fad4559a700 1 -- 172.21.15.192:0/3218824551 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad2c003280 con 0x7fad48060750 2020-11-20T11:48:18.463 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.456+0000 7fad46d9d700 1 -- 172.21.15.192:0/3218824551 >> v1:172.21.15.146:6789/0 conn(0x7fad48060750 legacy=0x7fad48150410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:18.464 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.456+0000 7fad46d9d700 1 -- 172.21.15.192:0/3218824551 >> v1:172.21.15.87:6789/0 conn(0x7fad48060370 legacy=0x7fad480bfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:18.464 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.456+0000 7fad46d9d700 1 -- 172.21.15.192:0/3218824551 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad48065730 con 0x7fad48151b30 2020-11-20T11:48:18.464 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.456+0000 7fad46d9d700 1 --2- 172.21.15.192:0/3218824551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad48151b30 0x7fad481554b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fad40009ce0 tx=0x7fad40009220).ready entity=mon.0 client_cookie=7fd28cd130edb46b server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:18.464 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.457+0000 7fad4559a700 1 -- 172.21.15.192:0/3218824551 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4000bad0 con 0x7fad48151b30 2020-11-20T11:48:18.464 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.457+0000 7fad4559a700 1 -- 172.21.15.192:0/3218824551 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4000bc30 con 0x7fad48151b30 2020-11-20T11:48:18.465 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.457+0000 7fad4559a700 1 -- 172.21.15.192:0/3218824551 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad40011400 con 0x7fad48151b30 2020-11-20T11:48:18.465 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.457+0000 7fad4cc1a700 1 -- 172.21.15.192:0/3218824551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad48151b30 msgr2=0x7fad481554b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:18.465 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.457+0000 7fad4cc1a700 1 --2- 172.21.15.192:0/3218824551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad48151b30 0x7fad481554b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fad40009ce0 tx=0x7fad40009220).stop 2020-11-20T11:48:18.465 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.457+0000 7fad4cc1a700 1 -- 172.21.15.192:0/3218824551 shutdown_connections 2020-11-20T11:48:18.465 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.457+0000 7fad4cc1a700 1 --2- 172.21.15.192:0/3218824551 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad48151b30 0x7fad481554b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:18.466 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.457+0000 7fad4cc1a700 1 -- 172.21.15.192:0/3218824551 >> 172.21.15.192:0/3218824551 conn(0x7fad480c46a0 msgr2=0x7fad480c4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:18.466 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.457+0000 7fad4cc1a700 1 -- 172.21.15.192:0/3218824551 shutdown_connections 2020-11-20T11:48:18.466 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.457+0000 7fad4cc1a700 1 -- 172.21.15.192:0/3218824551 wait complete. 2020-11-20T11:48:18.469 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.458+0000 7fad4cc1a700 1 Processor -- start 2020-11-20T11:48:18.469 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.458+0000 7fad4cc1a700 1 -- start start 2020-11-20T11:48:18.469 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.459+0000 7fad4cc1a700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad48060370 0x7fad480be1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:18.469 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.459+0000 7fad4cc1a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad48060750 0x7fad481649f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:18.470 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.459+0000 7fad4cc1a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad48151b30 0x7fad4814b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:18.470 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.459+0000 7fad4cc1a700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad48164ee0 con 0x7fad48060370 2020-11-20T11:48:18.470 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.459+0000 7fad4cc1a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad48146150 con 0x7fad48060750 2020-11-20T11:48:18.470 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.459+0000 7fad4cc1a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad481527b0 con 0x7fad48151b30 2020-11-20T11:48:18.470 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.459+0000 7fad46d9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad48151b30 0x7fad4814b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:18.471 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.459+0000 7fad46d9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad48151b30 0x7fad4814b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49268/0 (socket says 172.21.15.192:49268) 2020-11-20T11:48:18.471 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.459+0000 7fad46d9d700 1 -- 172.21.15.192:0/3513239487 learned_addr learned my addr 172.21.15.192:0/3513239487 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:18.471 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.459+0000 7fad45d9b700 1 --2- 172.21.15.192:0/3513239487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad48060750 0x7fad481649f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:18.471 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.459+0000 7fad4659c700 1 --2- 172.21.15.192:0/3513239487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad48060370 0x7fad480be1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:18.471 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.459+0000 7fad46d9d700 1 -- 172.21.15.192:0/3513239487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad48060750 msgr2=0x7fad481649f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:18.472 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.459+0000 7fad46d9d700 1 --2- 172.21.15.192:0/3513239487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad48060750 0x7fad481649f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:18.472 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.460+0000 7fad46d9d700 1 -- 172.21.15.192:0/3513239487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad48060370 msgr2=0x7fad480be1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:18.472 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.460+0000 7fad46d9d700 1 --2- 172.21.15.192:0/3513239487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad48060370 0x7fad480be1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:18.472 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.460+0000 7fad46d9d700 1 -- 172.21.15.192:0/3513239487 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad48149130 con 0x7fad48151b30 2020-11-20T11:48:18.472 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.460+0000 7fad4659c700 1 --2- 172.21.15.192:0/3513239487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad48060370 0x7fad480be1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:48:18.473 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.460+0000 7fad46d9d700 1 --2- 172.21.15.192:0/3513239487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad48151b30 0x7fad4814b9f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fad400090b0 tx=0x7fad40016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:18.473 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.460+0000 7fad367fc700 1 -- 172.21.15.192:0/3513239487 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad40010ae0 con 0x7fad48151b30 2020-11-20T11:48:18.473 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.460+0000 7fad367fc700 1 -- 172.21.15.192:0/3513239487 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad40010c40 con 0x7fad48151b30 2020-11-20T11:48:18.473 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.460+0000 7fad367fc700 1 -- 172.21.15.192:0/3513239487 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4001d480 con 0x7fad48151b30 2020-11-20T11:48:18.474 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.460+0000 7fad4cc1a700 1 -- 172.21.15.192:0/3513239487 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad48146380 con 0x7fad48151b30 2020-11-20T11:48:18.474 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.460+0000 7fad4cc1a700 1 -- 172.21.15.192:0/3513239487 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad481529e0 con 0x7fad48151b30 2020-11-20T11:48:18.474 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.461+0000 7fad4cc1a700 1 -- 172.21.15.192:0/3513239487 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad48067fc0 con 0x7fad48151b30 2020-11-20T11:48:18.474 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.461+0000 7fad367fc700 1 -- 172.21.15.192:0/3513239487 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fad40017070 con 0x7fad48151b30 2020-11-20T11:48:18.474 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.462+0000 7fad367fc700 1 --2- 172.21.15.192:0/3513239487 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fad1c080670 0x7fad1c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:18.475 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.462+0000 7fad367fc700 1 -- 172.21.15.192:0/3513239487 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fad400a5540 con 0x7fad48151b30 2020-11-20T11:48:18.475 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.462+0000 7fad4659c700 1 --2- 172.21.15.192:0/3513239487 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fad1c080670 0x7fad1c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:18.475 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.462+0000 7fad4659c700 1 --2- 172.21.15.192:0/3513239487 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fad1c080670 0x7fad1c082b30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fad38007fd0 tx=0x7fad38009040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:18.475 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.465+0000 7fad367fc700 1 -- 172.21.15.192:0/3513239487 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fad40079f50 con 0x7fad48151b30 2020-11-20T11:48:18.608 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.604+0000 7fad4cc1a700 1 -- 172.21.15.192:0/3513239487 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fad480699a0 con 0x7fad48151b30 2020-11-20T11:48:18.609 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.605+0000 7fad367fc700 1 -- 172.21.15.192:0/3513239487 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fad4007d570 con 0x7fad48151b30 2020-11-20T11:48:18.609 INFO:teuthology.orchestra.run.smithi192.stdout:73014444037 2020-11-20T11:48:18.612 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.606+0000 7fad4cc1a700 1 -- 172.21.15.192:0/3513239487 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fad1c080670 msgr2=0x7fad1c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:18.612 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.606+0000 7fad4cc1a700 1 --2- 172.21.15.192:0/3513239487 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fad1c080670 0x7fad1c082b30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fad38007fd0 tx=0x7fad38009040).stop 2020-11-20T11:48:18.612 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.606+0000 7fad4cc1a700 1 -- 172.21.15.192:0/3513239487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad48151b30 msgr2=0x7fad4814b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:18.613 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.606+0000 7fad4cc1a700 1 --2- 172.21.15.192:0/3513239487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad48151b30 0x7fad4814b9f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fad400090b0 tx=0x7fad40016000).stop 2020-11-20T11:48:18.613 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.606+0000 7fad4cc1a700 1 -- 172.21.15.192:0/3513239487 shutdown_connections 2020-11-20T11:48:18.614 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.606+0000 7fad4cc1a700 1 --2- 172.21.15.192:0/3513239487 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fad1c080670 0x7fad1c082b30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:18.614 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.606+0000 7fad4cc1a700 1 --2- 172.21.15.192:0/3513239487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad48151b30 0x7fad4814b9f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:18.614 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.606+0000 7fad4cc1a700 1 --2- 172.21.15.192:0/3513239487 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fad48060370 0x7fad480be1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:18.615 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.606+0000 7fad4cc1a700 1 --2- 172.21.15.192:0/3513239487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad48060750 0x7fad481649f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:18.615 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.606+0000 7fad4cc1a700 1 -- 172.21.15.192:0/3513239487 >> 172.21.15.192:0/3513239487 conn(0x7fad480c46a0 msgr2=0x7fad480bf9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:18.616 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.606+0000 7fad4cc1a700 1 -- 172.21.15.192:0/3513239487 shutdown_connections 2020-11-20T11:48:18.616 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.607+0000 7fad4cc1a700 1 -- 172.21.15.192:0/3513239487 wait complete. 2020-11-20T11:48:18.621 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444037 got 73014444037 for osd.2 2020-11-20T11:48:18.622 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2020-11-20T11:48:18.731 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.728+0000 7f27748b2700 1 Processor -- start 2020-11-20T11:48:18.731 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.728+0000 7f27748b2700 1 -- start start 2020-11-20T11:48:18.734 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.728+0000 7f27748b2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2770060370 0x7f2770060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:18.734 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.728+0000 7f27748b2700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f27701547b0 0x7f2770067470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:18.734 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.728+0000 7f27748b2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27700c26a0 con 0x7f27700c32e0 2020-11-20T11:48:18.734 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.728+0000 7f27748b2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2770060ea0 con 0x7f2770060370 2020-11-20T11:48:18.735 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.728+0000 7f27748b2700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2770151e30 con 0x7f27701547b0 2020-11-20T11:48:18.735 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.729+0000 7f276effd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f27701547b0 0x7f2770067470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:18.735 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.729+0000 7f276effd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f27701547b0 0x7f2770067470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49272/0 (socket says 172.21.15.192:49272) 2020-11-20T11:48:18.735 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.729+0000 7f276effd700 1 -- 172.21.15.192:0/3077491905 learned_addr learned my addr 172.21.15.192:0/3077491905 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:18.736 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.729+0000 7f276f7fe700 1 --2- 172.21.15.192:0/3077491905 >> v2:172.21.15.146:3300/0 conn(0x7f2770060370 0x7f2770060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:18.736 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.729+0000 7f276effd700 1 -- 172.21.15.192:0/3077491905 >> v2:172.21.15.146:3300/0 conn(0x7f2770060370 msgr2=0x7f2770060750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:18.736 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.729+0000 7f276effd700 1 --2- 172.21.15.192:0/3077491905 >> v2:172.21.15.146:3300/0 conn(0x7f2770060370 0x7f2770060750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:18.736 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.729+0000 7f276effd700 1 -- 172.21.15.192:0/3077491905 >> v1:172.21.15.146:6789/0 conn(0x7f27700c32e0 legacy=0x7f2770064150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:18.736 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.729+0000 7f276effd700 1 -- 172.21.15.192:0/3077491905 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27700c2900 con 0x7f27701547b0 2020-11-20T11:48:18.737 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.729+0000 7f276f7fe700 1 --2- 172.21.15.192:0/3077491905 >> v2:172.21.15.146:3300/0 conn(0x7f2770060370 0x7f2770060750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:48:18.738 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.729+0000 7f276effd700 1 --2- 172.21.15.192:0/3077491905 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27701547b0 0x7f2770067470 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f2770060c40 tx=0x7f2764006ef0).ready entity=mon.2 client_cookie=f5863931a814aaca server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:18.738 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.729+0000 7f276e7fc700 1 -- 172.21.15.192:0/3077491905 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276400b860 con 0x7f27701547b0 2020-11-20T11:48:18.738 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.729+0000 7f276e7fc700 1 -- 172.21.15.192:0/3077491905 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2764000e90 con 0x7f27701547b0 2020-11-20T11:48:18.738 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.729+0000 7f276e7fc700 1 -- 172.21.15.192:0/3077491905 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276400bbd0 con 0x7f27701547b0 2020-11-20T11:48:18.739 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.730+0000 7f27748b2700 1 -- 172.21.15.192:0/3077491905 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27701547b0 msgr2=0x7f2770067470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:18.739 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.730+0000 7f27748b2700 1 --2- 172.21.15.192:0/3077491905 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27701547b0 0x7f2770067470 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f2770060c40 tx=0x7f2764006ef0).stop 2020-11-20T11:48:18.739 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.730+0000 7f27748b2700 1 -- 172.21.15.192:0/3077491905 shutdown_connections 2020-11-20T11:48:18.739 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.730+0000 7f27748b2700 1 --2- 172.21.15.192:0/3077491905 >> v2:172.21.15.146:3300/0 conn(0x7f2770060370 0x7f2770060750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:18.739 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.730+0000 7f27748b2700 1 --2- 172.21.15.192:0/3077491905 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27701547b0 0x7f2770067470 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:18.740 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.730+0000 7f27748b2700 1 -- 172.21.15.192:0/3077491905 >> 172.21.15.192:0/3077491905 conn(0x7f27700c7820 msgr2=0x7f27700c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:18.740 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.730+0000 7f27748b2700 1 -- 172.21.15.192:0/3077491905 shutdown_connections 2020-11-20T11:48:18.740 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.730+0000 7f27748b2700 1 -- 172.21.15.192:0/3077491905 wait complete. 2020-11-20T11:48:18.740 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.731+0000 7f27748b2700 1 Processor -- start 2020-11-20T11:48:18.740 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.731+0000 7f27748b2700 1 -- start start 2020-11-20T11:48:18.743 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.732+0000 7f27748b2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2770060370 0x7f277014db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:18.743 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.732+0000 7f27748b2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27700c32e0 0x7f27700b3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:18.743 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.732+0000 7f27748b2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27701547b0 0x7f27700b4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:18.744 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.732+0000 7f27748b2700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2770161ba0 con 0x7f27701547b0 2020-11-20T11:48:18.744 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.732+0000 7f27748b2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27700c13d0 con 0x7f27700c32e0 2020-11-20T11:48:18.744 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.732+0000 7f27748b2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27700c1670 con 0x7f2770060370 2020-11-20T11:48:18.744 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.732+0000 7f276f7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2770060370 0x7f277014db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:18.745 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.732+0000 7f276f7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2770060370 0x7f277014db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49278/0 (socket says 172.21.15.192:49278) 2020-11-20T11:48:18.745 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.732+0000 7f276f7fe700 1 -- 172.21.15.192:0/350717629 learned_addr learned my addr 172.21.15.192:0/350717629 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:18.745 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.732+0000 7f276effd700 1 --2- 172.21.15.192:0/350717629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27700c32e0 0x7f27700b3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:18.745 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.732+0000 7f276ffff700 1 --2- 172.21.15.192:0/350717629 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27701547b0 0x7f27700b4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:18.745 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.732+0000 7f276f7fe700 1 -- 172.21.15.192:0/350717629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27700c32e0 msgr2=0x7f27700b3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:18.746 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.732+0000 7f276f7fe700 1 --2- 172.21.15.192:0/350717629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27700c32e0 0x7f27700b3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:18.746 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.732+0000 7f276f7fe700 1 -- 172.21.15.192:0/350717629 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27701547b0 msgr2=0x7f27700b4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:18.746 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.732+0000 7f276f7fe700 1 --2- 172.21.15.192:0/350717629 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27701547b0 0x7f27700b4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:18.746 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.732+0000 7f276f7fe700 1 -- 172.21.15.192:0/350717629 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27700c1910 con 0x7f2770060370 2020-11-20T11:48:18.746 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.732+0000 7f276ffff700 1 --2- 172.21.15.192:0/350717629 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27701547b0 0x7f27700b4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:48:18.747 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.732+0000 7f276effd700 1 --2- 172.21.15.192:0/350717629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27700c32e0 0x7f27700b3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:48:18.747 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.732+0000 7f276f7fe700 1 --2- 172.21.15.192:0/350717629 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2770060370 0x7f277014db10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f276000db30 tx=0x7f2760008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:18.747 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.732+0000 7f274f7fe700 1 -- 172.21.15.192:0/350717629 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2760009760 con 0x7f2770060370 2020-11-20T11:48:18.747 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.732+0000 7f274f7fe700 1 -- 172.21.15.192:0/350717629 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27600098c0 con 0x7f2770060370 2020-11-20T11:48:18.747 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.732+0000 7f27748b2700 1 -- 172.21.15.192:0/350717629 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27700c1bb0 con 0x7f2770060370 2020-11-20T11:48:18.748 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.732+0000 7f274f7fe700 1 -- 172.21.15.192:0/350717629 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2760009c40 con 0x7f2770060370 2020-11-20T11:48:18.748 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.732+0000 7f27748b2700 1 -- 172.21.15.192:0/350717629 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27701607e0 con 0x7f2770060370 2020-11-20T11:48:18.748 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.733+0000 7f27748b2700 1 -- 172.21.15.192:0/350717629 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27701609e0 con 0x7f2770060370 2020-11-20T11:48:18.748 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.734+0000 7f274f7fe700 1 -- 172.21.15.192:0/350717629 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f2760013480 con 0x7f2770060370 2020-11-20T11:48:18.748 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.734+0000 7f274f7fe700 1 --2- 172.21.15.192:0/350717629 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f27480806a0 0x7f2748082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:18.749 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.734+0000 7f274f7fe700 1 -- 172.21.15.192:0/350717629 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f27600a29b0 con 0x7f2770060370 2020-11-20T11:48:18.749 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.734+0000 7f276effd700 1 --2- 172.21.15.192:0/350717629 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f27480806a0 0x7f2748082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:18.749 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.735+0000 7f276effd700 1 --2- 172.21.15.192:0/350717629 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f27480806a0 0x7f2748082b60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f2764006f30 tx=0x7f2764016000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:18.749 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.738+0000 7f274f7fe700 1 -- 172.21.15.192:0/350717629 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f27701609e0 con 0x7f2770060370 2020-11-20T11:48:18.879 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.875+0000 7f27748b2700 1 -- 172.21.15.192:0/350717629 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f27701609e0 con 0x7f2770060370 2020-11-20T11:48:18.880 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.876+0000 7f274f7fe700 1 -- 172.21.15.192:0/350717629 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f27701609e0 con 0x7f2770060370 2020-11-20T11:48:18.880 INFO:teuthology.orchestra.run.smithi192.stdout:73014444038 2020-11-20T11:48:18.882 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.877+0000 7f27748b2700 1 -- 172.21.15.192:0/350717629 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f27480806a0 msgr2=0x7f2748082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:18.882 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.877+0000 7f27748b2700 1 --2- 172.21.15.192:0/350717629 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f27480806a0 0x7f2748082b60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f2764006f30 tx=0x7f2764016000).stop 2020-11-20T11:48:18.883 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.877+0000 7f27748b2700 1 -- 172.21.15.192:0/350717629 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2770060370 msgr2=0x7f277014db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:18.883 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.877+0000 7f27748b2700 1 --2- 172.21.15.192:0/350717629 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2770060370 0x7f277014db10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f276000db30 tx=0x7f2760008040).stop 2020-11-20T11:48:18.883 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.877+0000 7f27748b2700 1 -- 172.21.15.192:0/350717629 shutdown_connections 2020-11-20T11:48:18.883 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.877+0000 7f27748b2700 1 --2- 172.21.15.192:0/350717629 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f27480806a0 0x7f2748082b60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:18.884 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.877+0000 7f27748b2700 1 --2- 172.21.15.192:0/350717629 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f27701547b0 0x7f27700b4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:18.884 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.877+0000 7f27748b2700 1 --2- 172.21.15.192:0/350717629 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2770060370 0x7f277014db10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:18.884 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.877+0000 7f27748b2700 1 --2- 172.21.15.192:0/350717629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27700c32e0 0x7f27700b3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:18.884 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.877+0000 7f27748b2700 1 -- 172.21.15.192:0/350717629 >> 172.21.15.192:0/350717629 conn(0x7f27700c7820 msgr2=0x7f277014d160 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:18.885 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.878+0000 7f27748b2700 1 -- 172.21.15.192:0/350717629 shutdown_connections 2020-11-20T11:48:18.885 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:18.878+0000 7f27748b2700 1 -- 172.21.15.192:0/350717629 wait complete. 2020-11-20T11:48:18.892 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444038 got 73014444038 for osd.3 2020-11-20T11:48:18.893 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2020-11-20T11:48:19.016 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.013+0000 7f82fdddd700 1 Processor -- start 2020-11-20T11:48:19.016 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.013+0000 7f82fdddd700 1 -- start start 2020-11-20T11:48:19.018 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.013+0000 7f82fdddd700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f82f8067c10 0x7f82f80bc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:19.018 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.013+0000 7f82fdddd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f82f80bc800 0x7f82f80640e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:19.019 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.013+0000 7f82fdddd700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82f80baf70 con 0x7f82f8067830 2020-11-20T11:48:19.019 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.013+0000 7f82fdddd700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f80bccb0 con 0x7f82f8067c10 2020-11-20T11:48:19.019 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.013+0000 7f82fdddd700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f814e210 con 0x7f82f80bc800 2020-11-20T11:48:19.019 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.014+0000 7f82f77fe700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f82f8067830 0x7f82f80ba860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51954/0 (socket says 172.21.15.192:51954) 2020-11-20T11:48:19.020 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.014+0000 7f82f7fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f82f80bc800 0x7f82f80640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:19.020 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.014+0000 7f82f77fe700 1 -- 172.21.15.192:0/362694584 learned_addr learned my addr 172.21.15.192:0/362694584 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:19.020 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.014+0000 7f82f6ffd700 1 --2- 172.21.15.192:0/362694584 >> v2:172.21.15.87:3300/0 conn(0x7f82f8067c10 0x7f82f80bc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:19.020 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.014+0000 7f82f7fff700 1 -- 172.21.15.192:0/362694584 >> v2:172.21.15.87:3300/0 conn(0x7f82f8067c10 msgr2=0x7f82f80bc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:19.020 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.014+0000 7f82f7fff700 1 --2- 172.21.15.192:0/362694584 >> v2:172.21.15.87:3300/0 conn(0x7f82f8067c10 0x7f82f80bc310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:19.021 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.014+0000 7f82f7fff700 1 -- 172.21.15.192:0/362694584 >> v1:172.21.15.192:6789/0 conn(0x7f82f8067830 legacy=0x7f82f80ba860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:19.021 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.014+0000 7f82f67fc700 1 -- 172.21.15.192:0/362694584 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 697560777 0 0) 0x7f82e8001110 con 0x7f82f8067830 2020-11-20T11:48:19.021 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.014+0000 7f82f7fff700 1 -- 172.21.15.192:0/362694584 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f814e4b0 con 0x7f82f80bc800 2020-11-20T11:48:19.021 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.014+0000 7f82f7fff700 1 --2- 172.21.15.192:0/362694584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82f80bc800 0x7f82f80640e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f82f80bb460 tx=0x7f82f0009220).ready entity=mon.2 client_cookie=c110cb4366e160f server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:19.021 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.014+0000 7f82f67fc700 1 -- 172.21.15.192:0/362694584 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f000bbf0 con 0x7f82f80bc800 2020-11-20T11:48:19.022 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.014+0000 7f82f67fc700 1 -- 172.21.15.192:0/362694584 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f000bd50 con 0x7f82f80bc800 2020-11-20T11:48:19.022 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.014+0000 7f82f67fc700 1 -- 172.21.15.192:0/362694584 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f0010680 con 0x7f82f80bc800 2020-11-20T11:48:19.022 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.014+0000 7f82fdddd700 1 -- 172.21.15.192:0/362694584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82f80bc800 msgr2=0x7f82f80640e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:19.023 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.014+0000 7f82fdddd700 1 --2- 172.21.15.192:0/362694584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82f80bc800 0x7f82f80640e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f82f80bb460 tx=0x7f82f0009220).stop 2020-11-20T11:48:19.023 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.015+0000 7f82fdddd700 1 -- 172.21.15.192:0/362694584 shutdown_connections 2020-11-20T11:48:19.023 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.015+0000 7f82fdddd700 1 --2- 172.21.15.192:0/362694584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82f80bc800 0x7f82f80640e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:19.023 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.015+0000 7f82fdddd700 1 --2- 172.21.15.192:0/362694584 >> v2:172.21.15.87:3300/0 conn(0x7f82f8067c10 0x7f82f80bc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:19.024 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.015+0000 7f82fdddd700 1 -- 172.21.15.192:0/362694584 >> 172.21.15.192:0/362694584 conn(0x7f82f8062100 msgr2=0x7f82f80c3590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:19.024 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.015+0000 7f82fdddd700 1 -- 172.21.15.192:0/362694584 shutdown_connections 2020-11-20T11:48:19.024 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.015+0000 7f82fdddd700 1 -- 172.21.15.192:0/362694584 wait complete. 2020-11-20T11:48:19.027 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.016+0000 7f82fdddd700 1 Processor -- start 2020-11-20T11:48:19.027 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.016+0000 7f82fdddd700 1 -- start start 2020-11-20T11:48:19.027 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.017+0000 7f82fdddd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82f8067830 0x7f82f814b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:19.027 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.017+0000 7f82fdddd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82f8067c10 0x7f82f80be3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:19.027 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.017+0000 7f82fdddd700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82f80bc800 0x7f82f814d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:19.028 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.017+0000 7f82fdddd700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f814b8f0 con 0x7f82f80bc800 2020-11-20T11:48:19.028 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.017+0000 7f82fdddd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f8142cb0 con 0x7f82f8067830 2020-11-20T11:48:19.028 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.017+0000 7f82fdddd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f8142f50 con 0x7f82f8067c10 2020-11-20T11:48:19.028 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.017+0000 7f82f6ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82f8067c10 0x7f82f80be3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:19.029 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.017+0000 7f82f6ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82f8067c10 0x7f82f80be3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49294/0 (socket says 172.21.15.192:49294) 2020-11-20T11:48:19.029 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.017+0000 7f82f6ffd700 1 -- 172.21.15.192:0/2579698335 learned_addr learned my addr 172.21.15.192:0/2579698335 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:19.029 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.017+0000 7f82f7fff700 1 --2- 172.21.15.192:0/2579698335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82f80bc800 0x7f82f814d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:19.029 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.017+0000 7f82f6ffd700 1 -- 172.21.15.192:0/2579698335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82f8067830 msgr2=0x7f82f814b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:19.029 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.017+0000 7f82f77fe700 1 --2- 172.21.15.192:0/2579698335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82f8067830 0x7f82f814b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:19.030 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.017+0000 7f82f6ffd700 1 --2- 172.21.15.192:0/2579698335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82f8067830 0x7f82f814b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:19.030 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.017+0000 7f82f6ffd700 1 -- 172.21.15.192:0/2579698335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82f80bc800 msgr2=0x7f82f814d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:19.030 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.017+0000 7f82f6ffd700 1 --2- 172.21.15.192:0/2579698335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82f80bc800 0x7f82f814d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:19.030 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.017+0000 7f82f6ffd700 1 -- 172.21.15.192:0/2579698335 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f81431f0 con 0x7f82f8067c10 2020-11-20T11:48:19.031 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.017+0000 7f82f7fff700 1 --2- 172.21.15.192:0/2579698335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82f80bc800 0x7f82f814d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:48:19.031 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.017+0000 7f82f6ffd700 1 --2- 172.21.15.192:0/2579698335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82f8067c10 0x7f82f80be3b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f82ec00cb50 tx=0x7f82ec008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:19.031 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.017+0000 7f82d77fe700 1 -- 172.21.15.192:0/2579698335 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ec0077d0 con 0x7f82f8067c10 2020-11-20T11:48:19.031 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.017+0000 7f82d77fe700 1 -- 172.21.15.192:0/2579698335 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ec007930 con 0x7f82f8067c10 2020-11-20T11:48:19.032 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.017+0000 7f82fdddd700 1 -- 172.21.15.192:0/2579698335 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f8143490 con 0x7f82f8067c10 2020-11-20T11:48:19.032 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.017+0000 7f82d77fe700 1 -- 172.21.15.192:0/2579698335 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ec007cf0 con 0x7f82f8067c10 2020-11-20T11:48:19.032 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.017+0000 7f82fdddd700 1 -- 172.21.15.192:0/2579698335 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f815ce80 con 0x7f82f8067c10 2020-11-20T11:48:19.032 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.018+0000 7f82fdddd700 1 -- 172.21.15.192:0/2579698335 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f80699a0 con 0x7f82f8067c10 2020-11-20T11:48:19.032 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.019+0000 7f82d77fe700 1 -- 172.21.15.192:0/2579698335 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f82ec011620 con 0x7f82f8067c10 2020-11-20T11:48:19.033 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.019+0000 7f82d77fe700 1 --2- 172.21.15.192:0/2579698335 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f82d0080670 0x7f82d0082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:19.033 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.020+0000 7f82d77fe700 1 -- 172.21.15.192:0/2579698335 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f82ec0a2d90 con 0x7f82f8067c10 2020-11-20T11:48:19.033 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.020+0000 7f82f77fe700 1 --2- 172.21.15.192:0/2579698335 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f82d0080670 0x7f82d0082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:19.033 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.020+0000 7f82f77fe700 1 --2- 172.21.15.192:0/2579698335 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f82d0080670 0x7f82d0082b30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f82e8001560 tx=0x7f82e8009040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:19.034 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.023+0000 7f82d77fe700 1 -- 172.21.15.192:0/2579698335 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f82ec0776c0 con 0x7f82f8067c10 2020-11-20T11:48:19.169 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.166+0000 7f82fdddd700 1 -- 172.21.15.192:0/2579698335 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f82f805ca80 con 0x7f82f8067c10 2020-11-20T11:48:19.170 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.166+0000 7f82d77fe700 1 -- 172.21.15.192:0/2579698335 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f82ec07ace0 con 0x7f82f8067c10 2020-11-20T11:48:19.170 INFO:teuthology.orchestra.run.smithi192.stdout:73014444039 2020-11-20T11:48:19.172 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.167+0000 7f82fdddd700 1 -- 172.21.15.192:0/2579698335 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f82d0080670 msgr2=0x7f82d0082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:19.172 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.167+0000 7f82fdddd700 1 --2- 172.21.15.192:0/2579698335 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f82d0080670 0x7f82d0082b30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f82e8001560 tx=0x7f82e8009040).stop 2020-11-20T11:48:19.172 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.167+0000 7f82fdddd700 1 -- 172.21.15.192:0/2579698335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82f8067c10 msgr2=0x7f82f80be3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:19.173 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.167+0000 7f82fdddd700 1 --2- 172.21.15.192:0/2579698335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82f8067c10 0x7f82f80be3b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f82ec00cb50 tx=0x7f82ec008040).stop 2020-11-20T11:48:19.173 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.167+0000 7f82fdddd700 1 -- 172.21.15.192:0/2579698335 shutdown_connections 2020-11-20T11:48:19.173 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.167+0000 7f82fdddd700 1 --2- 172.21.15.192:0/2579698335 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f82d0080670 0x7f82d0082b30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:19.173 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.167+0000 7f82fdddd700 1 --2- 172.21.15.192:0/2579698335 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f82f80bc800 0x7f82f814d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:19.173 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.167+0000 7f82fdddd700 1 --2- 172.21.15.192:0/2579698335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82f8067830 0x7f82f814b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:19.174 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.167+0000 7f82fdddd700 1 --2- 172.21.15.192:0/2579698335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82f8067c10 0x7f82f80be3b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:19.174 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.167+0000 7f82fdddd700 1 -- 172.21.15.192:0/2579698335 >> 172.21.15.192:0/2579698335 conn(0x7f82f8062100 msgr2=0x7f82f80c09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:19.174 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.167+0000 7f82fdddd700 1 -- 172.21.15.192:0/2579698335 shutdown_connections 2020-11-20T11:48:19.174 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.167+0000 7f82fdddd700 1 -- 172.21.15.192:0/2579698335 wait complete. 2020-11-20T11:48:19.182 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444038 got 73014444039 for osd.4 2020-11-20T11:48:19.182 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2020-11-20T11:48:19.295 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.292+0000 7ff17b60d700 1 Processor -- start 2020-11-20T11:48:19.296 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.292+0000 7ff17b60d700 1 -- start start 2020-11-20T11:48:19.298 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.293+0000 7ff17b60d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff174154920 0x7ff174060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:19.298 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.293+0000 7ff17b60d700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff174151e80 con 0x7ff174064c40 2020-11-20T11:48:19.298 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.293+0000 7ff17b60d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff174152120 con 0x7ff174060370 2020-11-20T11:48:19.298 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.293+0000 7ff17b60d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff174064260 con 0x7ff174154920 2020-11-20T11:48:19.298 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.293+0000 7ff178ba8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff174154920 0x7ff174060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:19.299 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.293+0000 7ff178ba8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff174154920 0x7ff174060750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49304/0 (socket says 172.21.15.192:49304) 2020-11-20T11:48:19.299 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.293+0000 7ff178ba8700 1 -- 172.21.15.192:0/1702184493 learned_addr learned my addr 172.21.15.192:0/1702184493 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:19.299 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.294+0000 7ff178ba8700 1 -- 172.21.15.192:0/1702184493 >> v1:172.21.15.146:6789/0 conn(0x7ff174060370 legacy=0x7ff1740c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:19.299 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.294+0000 7ff178ba8700 1 -- 172.21.15.192:0/1702184493 >> v1:172.21.15.87:6789/0 conn(0x7ff174064c40 legacy=0x7ff174151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:19.300 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.294+0000 7ff178ba8700 1 -- 172.21.15.192:0/1702184493 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff174064500 con 0x7ff174154920 2020-11-20T11:48:19.301 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.294+0000 7ff178ba8700 1 --2- 172.21.15.192:0/1702184493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff174154920 0x7ff174060750 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7ff164009a10 tx=0x7ff164006ef0).ready entity=mon.2 client_cookie=7da1c4f99890a761 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:19.301 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.294+0000 7ff163fff700 1 -- 172.21.15.192:0/1702184493 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16400b8b0 con 0x7ff174154920 2020-11-20T11:48:19.301 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.294+0000 7ff163fff700 1 -- 172.21.15.192:0/1702184493 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff164000e90 con 0x7ff174154920 2020-11-20T11:48:19.301 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.294+0000 7ff163fff700 1 -- 172.21.15.192:0/1702184493 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16400bc20 con 0x7ff174154920 2020-11-20T11:48:19.302 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.294+0000 7ff17b60d700 1 -- 172.21.15.192:0/1702184493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff174154920 msgr2=0x7ff174060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:19.302 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.294+0000 7ff17b60d700 1 --2- 172.21.15.192:0/1702184493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff174154920 0x7ff174060750 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7ff164009a10 tx=0x7ff164006ef0).stop 2020-11-20T11:48:19.302 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.294+0000 7ff17b60d700 1 -- 172.21.15.192:0/1702184493 shutdown_connections 2020-11-20T11:48:19.302 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.294+0000 7ff17b60d700 1 --2- 172.21.15.192:0/1702184493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff174154920 0x7ff174060750 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:19.303 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.294+0000 7ff17b60d700 1 -- 172.21.15.192:0/1702184493 >> 172.21.15.192:0/1702184493 conn(0x7ff174062100 msgr2=0x7ff1740c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:19.303 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.294+0000 7ff17b60d700 1 -- 172.21.15.192:0/1702184493 shutdown_connections 2020-11-20T11:48:19.303 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.294+0000 7ff17b60d700 1 -- 172.21.15.192:0/1702184493 wait complete. 2020-11-20T11:48:19.305 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.295+0000 7ff17b60d700 1 Processor -- start 2020-11-20T11:48:19.306 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.296+0000 7ff17b60d700 1 -- start start 2020-11-20T11:48:19.306 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.296+0000 7ff17b60d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff174060370 0x7ff1740c19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:19.306 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.296+0000 7ff17b60d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff174064c40 0x7ff17414a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:19.306 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.296+0000 7ff17b60d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff174154920 0x7ff174164400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:19.307 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.296+0000 7ff17b60d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff174152f10 con 0x7ff174154920 2020-11-20T11:48:19.307 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.296+0000 7ff17b60d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1740c03c0 con 0x7ff174060370 2020-11-20T11:48:19.307 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.296+0000 7ff17b60d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1740c0660 con 0x7ff174064c40 2020-11-20T11:48:19.307 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.297+0000 7ff178ba8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff174064c40 0x7ff17414a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:19.307 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.297+0000 7ff178ba8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff174064c40 0x7ff17414a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49308/0 (socket says 172.21.15.192:49308) 2020-11-20T11:48:19.308 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.297+0000 7ff178ba8700 1 -- 172.21.15.192:0/4202616354 learned_addr learned my addr 172.21.15.192:0/4202616354 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:19.308 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.297+0000 7ff179baa700 1 --2- 172.21.15.192:0/4202616354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff174154920 0x7ff174164400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:19.308 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.297+0000 7ff1793a9700 1 --2- 172.21.15.192:0/4202616354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff174060370 0x7ff1740c19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:19.308 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.297+0000 7ff178ba8700 1 -- 172.21.15.192:0/4202616354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff174060370 msgr2=0x7ff1740c19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:19.308 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.297+0000 7ff178ba8700 1 --2- 172.21.15.192:0/4202616354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff174060370 0x7ff1740c19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:19.309 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.297+0000 7ff178ba8700 1 -- 172.21.15.192:0/4202616354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff174154920 msgr2=0x7ff174164400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:19.309 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.297+0000 7ff178ba8700 1 --2- 172.21.15.192:0/4202616354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff174154920 0x7ff174164400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:19.309 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.297+0000 7ff178ba8700 1 -- 172.21.15.192:0/4202616354 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1740c0900 con 0x7ff174064c40 2020-11-20T11:48:19.309 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.297+0000 7ff178ba8700 1 --2- 172.21.15.192:0/4202616354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff174064c40 0x7ff17414a5c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7ff164011000 tx=0x7ff164016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:19.309 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.297+0000 7ff1617fa700 1 -- 172.21.15.192:0/4202616354 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff164011dc0 con 0x7ff174064c40 2020-11-20T11:48:19.310 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.297+0000 7ff1617fa700 1 -- 172.21.15.192:0/4202616354 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16401d450 con 0x7ff174064c40 2020-11-20T11:48:19.310 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.297+0000 7ff17b60d700 1 -- 172.21.15.192:0/4202616354 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff174163f60 con 0x7ff174064c40 2020-11-20T11:48:19.310 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.297+0000 7ff1617fa700 1 -- 172.21.15.192:0/4202616354 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16401d7f0 con 0x7ff174064c40 2020-11-20T11:48:19.310 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.297+0000 7ff17b60d700 1 -- 172.21.15.192:0/4202616354 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff174152a80 con 0x7ff174064c40 2020-11-20T11:48:19.310 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.298+0000 7ff152ffd700 1 -- 172.21.15.192:0/4202616354 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff144004fd0 con 0x7ff174064c40 2020-11-20T11:48:19.311 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.299+0000 7ff1617fa700 1 -- 172.21.15.192:0/4202616354 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7ff164017040 con 0x7ff174064c40 2020-11-20T11:48:19.311 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.299+0000 7ff1617fa700 1 --2- 172.21.15.192:0/4202616354 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7ff14c0806a0 0x7ff14c082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:19.311 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.299+0000 7ff1617fa700 1 -- 172.21.15.192:0/4202616354 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7ff1640a49d0 con 0x7ff174064c40 2020-11-20T11:48:19.311 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.299+0000 7ff1793a9700 1 --2- 172.21.15.192:0/4202616354 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7ff14c0806a0 0x7ff14c082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:19.311 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.300+0000 7ff1793a9700 1 --2- 172.21.15.192:0/4202616354 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7ff14c0806a0 0x7ff14c082b60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7ff17000b670 tx=0x7ff170008040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:19.312 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.303+0000 7ff1617fa700 1 -- 172.21.15.192:0/4202616354 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7ff1640793e0 con 0x7ff174064c40 2020-11-20T11:48:19.445 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.442+0000 7ff152ffd700 1 -- 172.21.15.192:0/4202616354 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ff144003b30 con 0x7ff174064c40 2020-11-20T11:48:19.446 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.442+0000 7ff1617fa700 1 -- 172.21.15.192:0/4202616354 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff164015030 con 0x7ff174064c40 2020-11-20T11:48:19.446 INFO:teuthology.orchestra.run.smithi192.stdout:73014444039 2020-11-20T11:48:19.447 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.444+0000 7ff152ffd700 1 -- 172.21.15.192:0/4202616354 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7ff14c0806a0 msgr2=0x7ff14c082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:19.447 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.444+0000 7ff152ffd700 1 --2- 172.21.15.192:0/4202616354 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7ff14c0806a0 0x7ff14c082b60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7ff17000b670 tx=0x7ff170008040).stop 2020-11-20T11:48:19.448 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.444+0000 7ff152ffd700 1 -- 172.21.15.192:0/4202616354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff174064c40 msgr2=0x7ff17414a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:19.448 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.444+0000 7ff152ffd700 1 --2- 172.21.15.192:0/4202616354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff174064c40 0x7ff17414a5c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7ff164011000 tx=0x7ff164016000).stop 2020-11-20T11:48:19.448 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.444+0000 7ff152ffd700 1 -- 172.21.15.192:0/4202616354 shutdown_connections 2020-11-20T11:48:19.448 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.444+0000 7ff152ffd700 1 --2- 172.21.15.192:0/4202616354 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7ff14c0806a0 0x7ff14c082b60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:19.449 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.444+0000 7ff152ffd700 1 --2- 172.21.15.192:0/4202616354 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff174154920 0x7ff174164400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:19.449 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.444+0000 7ff152ffd700 1 --2- 172.21.15.192:0/4202616354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff174060370 0x7ff1740c19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:19.449 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.444+0000 7ff152ffd700 1 --2- 172.21.15.192:0/4202616354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff174064c40 0x7ff17414a5c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:19.449 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.444+0000 7ff152ffd700 1 -- 172.21.15.192:0/4202616354 >> 172.21.15.192:0/4202616354 conn(0x7ff174062100 msgr2=0x7ff1740c36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:19.449 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.444+0000 7ff152ffd700 1 -- 172.21.15.192:0/4202616354 shutdown_connections 2020-11-20T11:48:19.450 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.444+0000 7ff152ffd700 1 -- 172.21.15.192:0/4202616354 wait complete. 2020-11-20T11:48:19.459 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444039 got 73014444039 for osd.5 2020-11-20T11:48:19.459 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2020-11-20T11:48:19.576 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.573+0000 7fa307fff700 1 Processor -- start 2020-11-20T11:48:19.577 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.573+0000 7fa307fff700 1 -- start start 2020-11-20T11:48:19.578 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.574+0000 7fa307fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa308060750 0x7fa308067470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:19.579 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.574+0000 7fa307fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3080c26a0 con 0x7fa3081547b0 2020-11-20T11:48:19.579 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.574+0000 7fa307fff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3080c39f0 con 0x7fa308060370 2020-11-20T11:48:19.579 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.574+0000 7fa307fff700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa308060ea0 con 0x7fa308060750 2020-11-20T11:48:19.579 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.574+0000 7fa3077fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa308060750 0x7fa308067470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:19.580 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.574+0000 7fa306ffd700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fa308060370 0x7fa3080c32e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51982/0 (socket says 172.21.15.192:51982) 2020-11-20T11:48:19.580 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.574+0000 7fa306ffd700 1 -- 172.21.15.192:0/1192963465 learned_addr learned my addr 172.21.15.192:0/1192963465 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:19.580 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.574+0000 7fa3077fe700 1 -- 172.21.15.192:0/1192963465 >> v1:172.21.15.192:6789/0 conn(0x7fa308060370 legacy=0x7fa3080c32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:19.580 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.574+0000 7fa3077fe700 1 -- 172.21.15.192:0/1192963465 >> v1:172.21.15.146:6789/0 conn(0x7fa3081547b0 legacy=0x7fa308150690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:19.580 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.574+0000 7fa3067fc700 1 -- 172.21.15.192:0/1192963465 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1620449989 0 0) 0x7fa3080c39f0 con 0x7fa308060370 2020-11-20T11:48:19.581 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.574+0000 7fa3077fe700 1 -- 172.21.15.192:0/1192963465 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa308151e30 con 0x7fa308060750 2020-11-20T11:48:19.581 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.574+0000 7fa3077fe700 1 --2- 172.21.15.192:0/1192963465 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa308060750 0x7fa308067470 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fa300009ce0 tx=0x7fa300009220).ready entity=mon.2 client_cookie=f244e68a49e74e2e server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:19.581 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.575+0000 7fa3067fc700 1 -- 172.21.15.192:0/1192963465 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30000bbb0 con 0x7fa308060750 2020-11-20T11:48:19.581 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.575+0000 7fa3067fc700 1 -- 172.21.15.192:0/1192963465 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30000bd10 con 0x7fa308060750 2020-11-20T11:48:19.581 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.575+0000 7fa3067fc700 1 -- 172.21.15.192:0/1192963465 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa300011610 con 0x7fa308060750 2020-11-20T11:48:19.582 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.575+0000 7fa307fff700 1 -- 172.21.15.192:0/1192963465 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa308060750 msgr2=0x7fa308067470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:19.582 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.575+0000 7fa307fff700 1 --2- 172.21.15.192:0/1192963465 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa308060750 0x7fa308067470 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fa300009ce0 tx=0x7fa300009220).stop 2020-11-20T11:48:19.582 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.575+0000 7fa307fff700 1 -- 172.21.15.192:0/1192963465 shutdown_connections 2020-11-20T11:48:19.582 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.575+0000 7fa307fff700 1 --2- 172.21.15.192:0/1192963465 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa308060750 0x7fa308067470 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:19.582 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.575+0000 7fa307fff700 1 -- 172.21.15.192:0/1192963465 >> 172.21.15.192:0/1192963465 conn(0x7fa3080c7820 msgr2=0x7fa3080c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:19.583 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.575+0000 7fa307fff700 1 -- 172.21.15.192:0/1192963465 shutdown_connections 2020-11-20T11:48:19.583 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.575+0000 7fa307fff700 1 -- 172.21.15.192:0/1192963465 wait complete. 2020-11-20T11:48:19.585 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.576+0000 7fa307fff700 1 Processor -- start 2020-11-20T11:48:19.585 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.576+0000 7fa307fff700 1 -- start start 2020-11-20T11:48:19.586 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.577+0000 7fa307fff700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa308060370 0x7fa308160e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:19.586 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.577+0000 7fa307fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa308060750 0x7fa3080643e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:19.586 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.577+0000 7fa307fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3081547b0 0x7fa3080bfe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:19.586 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.577+0000 7fa307fff700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa308161360 con 0x7fa308060370 2020-11-20T11:48:19.586 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.577+0000 7fa307fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3080c1930 con 0x7fa3081547b0 2020-11-20T11:48:19.587 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.577+0000 7fa307fff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3080c1bd0 con 0x7fa308060750 2020-11-20T11:48:19.587 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.577+0000 7fa2fffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa308060750 0x7fa3080643e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:19.587 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.577+0000 7fa2fffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa308060750 0x7fa3080643e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49322/0 (socket says 172.21.15.192:49322) 2020-11-20T11:48:19.587 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.577+0000 7fa2fffff700 1 -- 172.21.15.192:0/3923490427 learned_addr learned my addr 172.21.15.192:0/3923490427 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:19.587 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.577+0000 7fa2fffff700 1 -- 172.21.15.192:0/3923490427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3081547b0 msgr2=0x7fa3080bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:19.588 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.577+0000 7fa2fffff700 1 --2- 172.21.15.192:0/3923490427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3081547b0 0x7fa3080bfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:48:19.588 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.577+0000 7fa2fffff700 1 -- 172.21.15.192:0/3923490427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa308060370 msgr2=0x7fa308160e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:19.588 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.577+0000 7fa306ffd700 1 --2- 172.21.15.192:0/3923490427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa308060370 0x7fa308160e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:19.588 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.577+0000 7fa2fffff700 1 --2- 172.21.15.192:0/3923490427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa308060370 0x7fa308160e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:19.588 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.577+0000 7fa2fffff700 1 -- 172.21.15.192:0/3923490427 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30814c070 con 0x7fa308060750 2020-11-20T11:48:19.589 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.577+0000 7fa2fffff700 1 --2- 172.21.15.192:0/3923490427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa308060750 0x7fa3080643e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fa2f0009690 tx=0x7fa2f0006db0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:19.589 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.577+0000 7fa2feffd700 1 -- 172.21.15.192:0/3923490427 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f00113f0 con 0x7fa308060750 2020-11-20T11:48:19.589 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.578+0000 7fa2feffd700 1 -- 172.21.15.192:0/3923490427 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f0011570 con 0x7fa308060750 2020-11-20T11:48:19.589 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.578+0000 7fa307fff700 1 -- 172.21.15.192:0/3923490427 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa30814c310 con 0x7fa308060750 2020-11-20T11:48:19.589 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.578+0000 7fa2feffd700 1 -- 172.21.15.192:0/3923490427 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f0011930 con 0x7fa308060750 2020-11-20T11:48:19.590 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.578+0000 7fa307fff700 1 -- 172.21.15.192:0/3923490427 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa308064f40 con 0x7fa308060750 2020-11-20T11:48:19.590 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.578+0000 7fa307fff700 1 -- 172.21.15.192:0/3923490427 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3080699a0 con 0x7fa308060750 2020-11-20T11:48:19.590 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.579+0000 7fa2feffd700 1 -- 172.21.15.192:0/3923490427 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fa2f0011ce0 con 0x7fa308060750 2020-11-20T11:48:19.590 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.579+0000 7fa2feffd700 1 --2- 172.21.15.192:0/3923490427 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fa2e4080670 0x7fa2e4082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:19.590 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.580+0000 7fa2feffd700 1 -- 172.21.15.192:0/3923490427 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fa2f00a1fc0 con 0x7fa308060750 2020-11-20T11:48:19.591 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.580+0000 7fa306ffd700 1 --2- 172.21.15.192:0/3923490427 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fa2e4080670 0x7fa2e4082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:19.591 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.580+0000 7fa306ffd700 1 --2- 172.21.15.192:0/3923490427 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fa2e4080670 0x7fa2e4082b30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fa3080c2830 tx=0x7fa2f8009040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:19.591 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.583+0000 7fa2feffd700 1 -- 172.21.15.192:0/3923490427 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fa2f00769d0 con 0x7fa308060750 2020-11-20T11:48:19.725 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.722+0000 7fa307fff700 1 -- 172.21.15.192:0/3923490427 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fa30805c2e0 con 0x7fa308060750 2020-11-20T11:48:19.725 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.722+0000 7fa2feffd700 1 -- 172.21.15.192:0/3923490427 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa30805c2e0 con 0x7fa308060750 2020-11-20T11:48:19.726 INFO:teuthology.orchestra.run.smithi192.stdout:73014444038 2020-11-20T11:48:19.727 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.723+0000 7fa307fff700 1 -- 172.21.15.192:0/3923490427 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fa2e4080670 msgr2=0x7fa2e4082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:19.728 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.723+0000 7fa307fff700 1 --2- 172.21.15.192:0/3923490427 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fa2e4080670 0x7fa2e4082b30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fa3080c2830 tx=0x7fa2f8009040).stop 2020-11-20T11:48:19.728 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.723+0000 7fa307fff700 1 -- 172.21.15.192:0/3923490427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa308060750 msgr2=0x7fa3080643e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:19.728 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.723+0000 7fa307fff700 1 --2- 172.21.15.192:0/3923490427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa308060750 0x7fa3080643e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fa2f0009690 tx=0x7fa2f0006db0).stop 2020-11-20T11:48:19.728 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.723+0000 7fa307fff700 1 -- 172.21.15.192:0/3923490427 shutdown_connections 2020-11-20T11:48:19.728 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.723+0000 7fa307fff700 1 --2- 172.21.15.192:0/3923490427 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fa2e4080670 0x7fa2e4082b30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:19.729 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.723+0000 7fa307fff700 1 --2- 172.21.15.192:0/3923490427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3081547b0 0x7fa3080bfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:48:19.729 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.723+0000 7fa307fff700 1 --2- 172.21.15.192:0/3923490427 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa308060370 0x7fa308160e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:19.729 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.723+0000 7fa307fff700 1 --2- 172.21.15.192:0/3923490427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa308060750 0x7fa3080643e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:19.729 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.723+0000 7fa307fff700 1 -- 172.21.15.192:0/3923490427 >> 172.21.15.192:0/3923490427 conn(0x7fa3080c7820 msgr2=0x7fa3080c5720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:19.730 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.724+0000 7fa307fff700 1 -- 172.21.15.192:0/3923490427 shutdown_connections 2020-11-20T11:48:19.730 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.724+0000 7fa307fff700 1 -- 172.21.15.192:0/3923490427 wait complete. 2020-11-20T11:48:19.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444038 got 73014444038 for osd.6 2020-11-20T11:48:19.738 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2020-11-20T11:48:19.854 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.851+0000 7f624e283700 1 Processor -- start 2020-11-20T11:48:19.854 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.851+0000 7f624e283700 1 -- start start 2020-11-20T11:48:19.856 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.852+0000 7f624e283700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6248060370 0x7f6248060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:19.857 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.852+0000 7f624e283700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6248067470 0x7f6248150690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:19.857 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.852+0000 7f624e283700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62480c26a0 con 0x7f62481547b0 2020-11-20T11:48:19.857 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.852+0000 7f624e283700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6248060ea0 con 0x7f6248067470 2020-11-20T11:48:19.857 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.852+0000 7f624e283700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62480678c0 con 0x7f6248060370 2020-11-20T11:48:19.858 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.852+0000 7f624d281700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6248060370 0x7f6248060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:19.858 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.852+0000 7f624d281700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6248060370 0x7f6248060750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49328/0 (socket says 172.21.15.192:49328) 2020-11-20T11:48:19.858 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.852+0000 7f624ca80700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f62481547b0 0x7f62480c32e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51996/0 (socket says 172.21.15.192:51996) 2020-11-20T11:48:19.858 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.852+0000 7f624d281700 1 -- 172.21.15.192:0/655756435 learned_addr learned my addr 172.21.15.192:0/655756435 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:19.858 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.852+0000 7f624da82700 1 --2- 172.21.15.192:0/655756435 >> v2:172.21.15.146:3300/0 conn(0x7f6248067470 0x7f6248150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:19.859 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.852+0000 7f624d281700 1 -- 172.21.15.192:0/655756435 >> v2:172.21.15.146:3300/0 conn(0x7f6248067470 msgr2=0x7f6248150690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:19.859 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.852+0000 7f624d281700 1 --2- 172.21.15.192:0/655756435 >> v2:172.21.15.146:3300/0 conn(0x7f6248067470 0x7f6248150690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:19.859 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.852+0000 7f624d281700 1 -- 172.21.15.192:0/655756435 >> v1:172.21.15.192:6789/0 conn(0x7f62481547b0 legacy=0x7f62480c32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:19.859 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.852+0000 7f624d281700 1 -- 172.21.15.192:0/655756435 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62480c39f0 con 0x7f6248060370 2020-11-20T11:48:19.859 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.852+0000 7f6237fff700 1 -- 172.21.15.192:0/655756435 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3221656974 0 0) 0x7f62480c26a0 con 0x7f62481547b0 2020-11-20T11:48:19.860 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.852+0000 7f624d281700 1 --2- 172.21.15.192:0/655756435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6248060370 0x7f6248060750 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f62480c52d0 tx=0x7f6238006ef0).ready entity=mon.2 client_cookie=a78a6598c00120a0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:19.860 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.852+0000 7f6237fff700 1 -- 172.21.15.192:0/655756435 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623800b860 con 0x7f6248060370 2020-11-20T11:48:19.860 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.852+0000 7f6237fff700 1 -- 172.21.15.192:0/655756435 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6238000e90 con 0x7f6248060370 2020-11-20T11:48:19.860 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.852+0000 7f6237fff700 1 -- 172.21.15.192:0/655756435 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623800bbd0 con 0x7f6248060370 2020-11-20T11:48:19.860 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.853+0000 7f624e283700 1 -- 172.21.15.192:0/655756435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6248060370 msgr2=0x7f6248060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:19.861 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.853+0000 7f624e283700 1 --2- 172.21.15.192:0/655756435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6248060370 0x7f6248060750 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f62480c52d0 tx=0x7f6238006ef0).stop 2020-11-20T11:48:19.861 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.853+0000 7f624e283700 1 -- 172.21.15.192:0/655756435 shutdown_connections 2020-11-20T11:48:19.861 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.853+0000 7f624e283700 1 --2- 172.21.15.192:0/655756435 >> v2:172.21.15.146:3300/0 conn(0x7f6248067470 0x7f6248150690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:19.861 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.853+0000 7f624e283700 1 --2- 172.21.15.192:0/655756435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6248060370 0x7f6248060750 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:19.861 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.853+0000 7f624e283700 1 -- 172.21.15.192:0/655756435 >> 172.21.15.192:0/655756435 conn(0x7f62480c7820 msgr2=0x7f62480c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:19.862 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.853+0000 7f624e283700 1 -- 172.21.15.192:0/655756435 shutdown_connections 2020-11-20T11:48:19.862 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.853+0000 7f624e283700 1 -- 172.21.15.192:0/655756435 wait complete. 2020-11-20T11:48:19.864 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.854+0000 7f624e283700 1 Processor -- start 2020-11-20T11:48:19.864 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.854+0000 7f624e283700 1 -- start start 2020-11-20T11:48:19.865 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.855+0000 7f624e283700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6248060370 0x7f6248153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:19.865 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.855+0000 7f624e283700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6248067470 0x7f6248150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:19.865 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.855+0000 7f624e283700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62481547b0 0x7f6248151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:19.865 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.855+0000 7f624e283700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62480b04c0 con 0x7f6248060370 2020-11-20T11:48:19.866 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.855+0000 7f624e283700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62480b0760 con 0x7f62481547b0 2020-11-20T11:48:19.866 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.855+0000 7f624e283700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62480b0a00 con 0x7f6248067470 2020-11-20T11:48:19.866 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.855+0000 7f624ca80700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6248067470 0x7f6248150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:19.866 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.855+0000 7f624ca80700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6248067470 0x7f6248150d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49336/0 (socket says 172.21.15.192:49336) 2020-11-20T11:48:19.866 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.855+0000 7f624ca80700 1 -- 172.21.15.192:0/1704217568 learned_addr learned my addr 172.21.15.192:0/1704217568 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:19.867 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.855+0000 7f624d281700 1 --2- 172.21.15.192:0/1704217568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6248060370 0x7f6248153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:19.867 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.855+0000 7f624ca80700 1 -- 172.21.15.192:0/1704217568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62481547b0 msgr2=0x7f6248151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:19.867 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.855+0000 7f624ca80700 1 --2- 172.21.15.192:0/1704217568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62481547b0 0x7f6248151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:48:19.867 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.855+0000 7f624ca80700 1 -- 172.21.15.192:0/1704217568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6248060370 msgr2=0x7f6248153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:19.867 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.855+0000 7f624ca80700 1 --2- 172.21.15.192:0/1704217568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6248060370 0x7f6248153520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:19.868 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.855+0000 7f624ca80700 1 -- 172.21.15.192:0/1704217568 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62481505e0 con 0x7f6248067470 2020-11-20T11:48:19.868 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.855+0000 7f624ca80700 1 --2- 172.21.15.192:0/1704217568 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6248067470 0x7f6248150d20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f624400c710 tx=0x7f6244007cc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:19.868 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.856+0000 7f62357fa700 1 -- 172.21.15.192:0/1704217568 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6244007320 con 0x7f6248067470 2020-11-20T11:48:19.868 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.856+0000 7f62357fa700 1 -- 172.21.15.192:0/1704217568 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6244005570 con 0x7f6248067470 2020-11-20T11:48:19.868 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.856+0000 7f62357fa700 1 -- 172.21.15.192:0/1704217568 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6244005910 con 0x7f6248067470 2020-11-20T11:48:19.869 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.856+0000 7f624e283700 1 -- 172.21.15.192:0/1704217568 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6248150880 con 0x7f6248067470 2020-11-20T11:48:19.869 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.856+0000 7f624e283700 1 -- 172.21.15.192:0/1704217568 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62480bfbb0 con 0x7f6248067470 2020-11-20T11:48:19.869 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.857+0000 7f624e283700 1 -- 172.21.15.192:0/1704217568 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6248152310 con 0x7f6248067470 2020-11-20T11:48:19.869 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.857+0000 7f62357fa700 1 -- 172.21.15.192:0/1704217568 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f6244010030 con 0x7f6248067470 2020-11-20T11:48:19.869 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.858+0000 7f62357fa700 1 --2- 172.21.15.192:0/1704217568 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f6220080670 0x7f6220082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:19.870 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.858+0000 7f62357fa700 1 -- 172.21.15.192:0/1704217568 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f62440a26f0 con 0x7f6248067470 2020-11-20T11:48:19.870 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.858+0000 7f624d281700 1 --2- 172.21.15.192:0/1704217568 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f6220080670 0x7f6220082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:19.870 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.858+0000 7f624d281700 1 --2- 172.21.15.192:0/1704217568 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f6220080670 0x7f6220082b30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f623800c010 tx=0x7f6238016000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:19.870 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:19.861+0000 7f62357fa700 1 -- 172.21.15.192:0/1704217568 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f6244077100 con 0x7f6248067470 2020-11-20T11:48:20.003 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.000+0000 7f624e283700 1 -- 172.21.15.192:0/1704217568 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f62480699a0 con 0x7f6248067470 2020-11-20T11:48:20.004 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.000+0000 7f62357fa700 1 -- 172.21.15.192:0/1704217568 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f624407a720 con 0x7f6248067470 2020-11-20T11:48:20.005 INFO:teuthology.orchestra.run.smithi192.stdout:73014444038 2020-11-20T11:48:20.007 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.002+0000 7f624e283700 1 -- 172.21.15.192:0/1704217568 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f6220080670 msgr2=0x7f6220082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:20.008 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.002+0000 7f624e283700 1 --2- 172.21.15.192:0/1704217568 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f6220080670 0x7f6220082b30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f623800c010 tx=0x7f6238016000).stop 2020-11-20T11:48:20.008 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.002+0000 7f624e283700 1 -- 172.21.15.192:0/1704217568 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6248067470 msgr2=0x7f6248150d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:20.009 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.002+0000 7f624e283700 1 --2- 172.21.15.192:0/1704217568 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6248067470 0x7f6248150d20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f624400c710 tx=0x7f6244007cc0).stop 2020-11-20T11:48:20.009 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.002+0000 7f624e283700 1 -- 172.21.15.192:0/1704217568 shutdown_connections 2020-11-20T11:48:20.011 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.002+0000 7f624e283700 1 --2- 172.21.15.192:0/1704217568 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f6220080670 0x7f6220082b30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:20.011 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.002+0000 7f624e283700 1 --2- 172.21.15.192:0/1704217568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62481547b0 0x7f6248151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:48:20.012 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.002+0000 7f624e283700 1 --2- 172.21.15.192:0/1704217568 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6248060370 0x7f6248153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:20.012 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.002+0000 7f624e283700 1 --2- 172.21.15.192:0/1704217568 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6248067470 0x7f6248150d20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:20.013 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.002+0000 7f624e283700 1 -- 172.21.15.192:0/1704217568 >> 172.21.15.192:0/1704217568 conn(0x7f62480c7820 msgr2=0x7f624814d960 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:20.013 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.002+0000 7f624e283700 1 -- 172.21.15.192:0/1704217568 shutdown_connections 2020-11-20T11:48:20.013 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.002+0000 7f624e283700 1 -- 172.21.15.192:0/1704217568 wait complete. 2020-11-20T11:48:20.017 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444038 got 73014444038 for osd.7 2020-11-20T11:48:20.018 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2020-11-20T11:48:20.134 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.131+0000 7f323901f700 1 Processor -- start 2020-11-20T11:48:20.136 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.131+0000 7f323901f700 1 -- start start 2020-11-20T11:48:20.139 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.131+0000 7f323901f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3234060370 0x7f3234060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:20.140 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.131+0000 7f323901f700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3234151e80 con 0x7f3234154920 2020-11-20T11:48:20.140 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.131+0000 7f323901f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3234152120 con 0x7f3234064c40 2020-11-20T11:48:20.140 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.131+0000 7f323901f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3234064260 con 0x7f3234060370 2020-11-20T11:48:20.140 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.132+0000 7f3232d9d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3234060370 0x7f3234060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:20.141 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.132+0000 7f323359e700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f3234064c40 0x7f3234151340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52014/0 (socket says 172.21.15.192:52014) 2020-11-20T11:48:20.141 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.132+0000 7f323359e700 1 -- 172.21.15.192:0/1509332503 learned_addr learned my addr 172.21.15.192:0/1509332503 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:20.141 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.132+0000 7f3232d9d700 1 -- 172.21.15.192:0/1509332503 >> v1:172.21.15.192:6789/0 conn(0x7f3234064c40 legacy=0x7f3234151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:20.141 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.132+0000 7f3232d9d700 1 -- 172.21.15.192:0/1509332503 >> v1:172.21.15.87:6789/0 conn(0x7f3234154920 legacy=0x7f32340c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:20.141 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.132+0000 7f323259c700 1 -- 172.21.15.192:0/1509332503 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1131337859 0 0) 0x7f3234152120 con 0x7f3234064c40 2020-11-20T11:48:20.142 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.132+0000 7f3232d9d700 1 -- 172.21.15.192:0/1509332503 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3234064500 con 0x7f3234060370 2020-11-20T11:48:20.142 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.132+0000 7f3232d9d700 1 --2- 172.21.15.192:0/1509332503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3234060370 0x7f3234060750 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f3224006fd0 tx=0x7f3224006e30).ready entity=mon.2 client_cookie=9aef51c040058d9d server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:20.142 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.132+0000 7f323259c700 1 -- 172.21.15.192:0/1509332503 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3224009870 con 0x7f3234060370 2020-11-20T11:48:20.142 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.132+0000 7f323259c700 1 -- 172.21.15.192:0/1509332503 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3224000e90 con 0x7f3234060370 2020-11-20T11:48:20.142 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.132+0000 7f323259c700 1 -- 172.21.15.192:0/1509332503 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3224009be0 con 0x7f3234060370 2020-11-20T11:48:20.143 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.133+0000 7f323901f700 1 -- 172.21.15.192:0/1509332503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3234060370 msgr2=0x7f3234060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:20.143 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.133+0000 7f323901f700 1 --2- 172.21.15.192:0/1509332503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3234060370 0x7f3234060750 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f3224006fd0 tx=0x7f3224006e30).stop 2020-11-20T11:48:20.143 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.133+0000 7f323901f700 1 -- 172.21.15.192:0/1509332503 shutdown_connections 2020-11-20T11:48:20.143 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.133+0000 7f323901f700 1 --2- 172.21.15.192:0/1509332503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3234060370 0x7f3234060750 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:20.143 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.133+0000 7f323901f700 1 -- 172.21.15.192:0/1509332503 >> 172.21.15.192:0/1509332503 conn(0x7f3234062100 msgr2=0x7f32340c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:20.144 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.133+0000 7f323901f700 1 -- 172.21.15.192:0/1509332503 shutdown_connections 2020-11-20T11:48:20.144 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.133+0000 7f323901f700 1 -- 172.21.15.192:0/1509332503 wait complete. 2020-11-20T11:48:20.144 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.134+0000 7f323901f700 1 Processor -- start 2020-11-20T11:48:20.144 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.134+0000 7f323901f700 1 -- start start 2020-11-20T11:48:20.145 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.134+0000 7f323901f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3234060370 0x7f323414cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:20.145 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.134+0000 7f323901f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3234064c40 0x7f32340c2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:20.145 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.134+0000 7f323901f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3234154920 0x7f32340bf920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:20.145 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.134+0000 7f323901f700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323414bcf0 con 0x7f3234154920 2020-11-20T11:48:20.146 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.134+0000 7f323901f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323414cfb0 con 0x7f3234060370 2020-11-20T11:48:20.146 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.134+0000 7f323901f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32340c5fc0 con 0x7f3234064c40 2020-11-20T11:48:20.146 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.135+0000 7f322bfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3234064c40 0x7f32340c2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:20.146 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.135+0000 7f322bfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3234064c40 0x7f32340c2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49350/0 (socket says 172.21.15.192:49350) 2020-11-20T11:48:20.146 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.135+0000 7f322bfff700 1 -- 172.21.15.192:0/3543941685 learned_addr learned my addr 172.21.15.192:0/3543941685 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:20.147 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.135+0000 7f323359e700 1 --2- 172.21.15.192:0/3543941685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3234154920 0x7f32340bf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:20.147 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.135+0000 7f322bfff700 1 -- 172.21.15.192:0/3543941685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3234060370 msgr2=0x7f323414cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:20.147 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.135+0000 7f322bfff700 1 --2- 172.21.15.192:0/3543941685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3234060370 0x7f323414cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:48:20.147 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.135+0000 7f322bfff700 1 -- 172.21.15.192:0/3543941685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3234154920 msgr2=0x7f32340bf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:20.148 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.135+0000 7f322bfff700 1 --2- 172.21.15.192:0/3543941685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3234154920 0x7f32340bf920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:20.148 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.135+0000 7f322bfff700 1 -- 172.21.15.192:0/3543941685 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32340c61b0 con 0x7f3234064c40 2020-11-20T11:48:20.148 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.135+0000 7f322bfff700 1 --2- 172.21.15.192:0/3543941685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3234064c40 0x7f32340c2c40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f321c00c710 tx=0x7f321c007c60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:20.148 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.135+0000 7f322affd700 1 -- 172.21.15.192:0/3543941685 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321c007020 con 0x7f3234064c40 2020-11-20T11:48:20.148 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.135+0000 7f322affd700 1 -- 172.21.15.192:0/3543941685 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f321c001e90 con 0x7f3234064c40 2020-11-20T11:48:20.149 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.135+0000 7f322affd700 1 -- 172.21.15.192:0/3543941685 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321c0073b0 con 0x7f3234064c40 2020-11-20T11:48:20.150 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.135+0000 7f323901f700 1 -- 172.21.15.192:0/3543941685 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32340c6450 con 0x7f3234064c40 2020-11-20T11:48:20.150 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.135+0000 7f323901f700 1 -- 172.21.15.192:0/3543941685 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32340c6c30 con 0x7f3234064c40 2020-11-20T11:48:20.150 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.136+0000 7f323901f700 1 -- 172.21.15.192:0/3543941685 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32340699a0 con 0x7f3234064c40 2020-11-20T11:48:20.151 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.137+0000 7f322affd700 1 -- 172.21.15.192:0/3543941685 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f321c010070 con 0x7f3234064c40 2020-11-20T11:48:20.151 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.137+0000 7f322affd700 1 --2- 172.21.15.192:0/3543941685 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f32100806a0 0x7f3210082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:20.151 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.137+0000 7f322affd700 1 -- 172.21.15.192:0/3543941685 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f321c0a1d00 con 0x7f3234064c40 2020-11-20T11:48:20.151 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.137+0000 7f3232d9d700 1 --2- 172.21.15.192:0/3543941685 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f32100806a0 0x7f3210082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:20.152 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.137+0000 7f3232d9d700 1 --2- 172.21.15.192:0/3543941685 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f32100806a0 0x7f3210082b60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f3224006e70 tx=0x7f3224015000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:20.152 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.140+0000 7f322affd700 1 -- 172.21.15.192:0/3543941685 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f321c076710 con 0x7f3234064c40 2020-11-20T11:48:20.282 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.279+0000 7f323901f700 1 -- 172.21.15.192:0/3543941685 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f32340c6df0 con 0x7f3234064c40 2020-11-20T11:48:20.283 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.279+0000 7f322affd700 1 -- 172.21.15.192:0/3543941685 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f321c079d30 con 0x7f3234064c40 2020-11-20T11:48:20.283 INFO:teuthology.orchestra.run.smithi192.stdout:73014444038 2020-11-20T11:48:20.284 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.281+0000 7f323901f700 1 -- 172.21.15.192:0/3543941685 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f32100806a0 msgr2=0x7f3210082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:20.285 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.281+0000 7f323901f700 1 --2- 172.21.15.192:0/3543941685 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f32100806a0 0x7f3210082b60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f3224006e70 tx=0x7f3224015000).stop 2020-11-20T11:48:20.285 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.281+0000 7f323901f700 1 -- 172.21.15.192:0/3543941685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3234064c40 msgr2=0x7f32340c2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:20.285 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.281+0000 7f323901f700 1 --2- 172.21.15.192:0/3543941685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3234064c40 0x7f32340c2c40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f321c00c710 tx=0x7f321c007c60).stop 2020-11-20T11:48:20.286 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.281+0000 7f323901f700 1 -- 172.21.15.192:0/3543941685 shutdown_connections 2020-11-20T11:48:20.286 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.281+0000 7f323901f700 1 --2- 172.21.15.192:0/3543941685 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f32100806a0 0x7f3210082b60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:20.286 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.281+0000 7f323901f700 1 --2- 172.21.15.192:0/3543941685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3234154920 0x7f32340bf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:20.286 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.281+0000 7f323901f700 1 --2- 172.21.15.192:0/3543941685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3234060370 0x7f323414cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:48:20.286 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.281+0000 7f323901f700 1 --2- 172.21.15.192:0/3543941685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3234064c40 0x7f32340c2c40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:20.287 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.281+0000 7f323901f700 1 -- 172.21.15.192:0/3543941685 >> 172.21.15.192:0/3543941685 conn(0x7f3234062100 msgr2=0x7f3234152d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:20.287 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.281+0000 7f323901f700 1 -- 172.21.15.192:0/3543941685 shutdown_connections 2020-11-20T11:48:20.287 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.281+0000 7f323901f700 1 -- 172.21.15.192:0/3543941685 wait complete. 2020-11-20T11:48:20.295 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444038 got 73014444038 for osd.8 2020-11-20T11:48:20.296 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2020-11-20T11:48:20.407 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.404+0000 7fbf9b305700 1 Processor -- start 2020-11-20T11:48:20.408 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.404+0000 7fbf9b305700 1 -- start start 2020-11-20T11:48:20.414 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.405+0000 7fbf9b305700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbf94060370 0x7fbf94060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:20.414 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.405+0000 7fbf9b305700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fbf94154920 0x7fbf94064c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:20.415 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.405+0000 7fbf9b305700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbf940c2340 0x7fbf94151340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:20.415 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.405+0000 7fbf9b305700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf94065130 con 0x7fbf94154920 2020-11-20T11:48:20.415 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.405+0000 7fbf9b305700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf94151e80 con 0x7fbf940c2340 2020-11-20T11:48:20.416 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.405+0000 7fbf9b305700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf94152120 con 0x7fbf94060370 2020-11-20T11:48:20.416 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.405+0000 7fbf990a1700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbf94060370 0x7fbf94060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:20.416 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.405+0000 7fbf990a1700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbf94060370 0x7fbf94060750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49356/0 (socket says 172.21.15.192:49356) 2020-11-20T11:48:20.417 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.405+0000 7fbf990a1700 1 -- 172.21.15.192:0/2045926627 learned_addr learned my addr 172.21.15.192:0/2045926627 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:20.417 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.405+0000 7fbf988a0700 1 --2- 172.21.15.192:0/2045926627 >> v2:172.21.15.87:3300/0 conn(0x7fbf94154920 0x7fbf94064c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:20.417 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.405+0000 7fbf998a2700 1 --2- 172.21.15.192:0/2045926627 >> v2:172.21.15.146:3300/0 conn(0x7fbf940c2340 0x7fbf94151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:20.418 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.405+0000 7fbf990a1700 1 -- 172.21.15.192:0/2045926627 >> v2:172.21.15.146:3300/0 conn(0x7fbf940c2340 msgr2=0x7fbf94151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:20.418 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.405+0000 7fbf990a1700 1 --2- 172.21.15.192:0/2045926627 >> v2:172.21.15.146:3300/0 conn(0x7fbf940c2340 0x7fbf94151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:20.418 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.405+0000 7fbf990a1700 1 -- 172.21.15.192:0/2045926627 >> v2:172.21.15.87:3300/0 conn(0x7fbf94154920 msgr2=0x7fbf94064c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:20.419 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.405+0000 7fbf990a1700 1 --2- 172.21.15.192:0/2045926627 >> v2:172.21.15.87:3300/0 conn(0x7fbf94154920 0x7fbf94064c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:20.419 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.405+0000 7fbf990a1700 1 -- 172.21.15.192:0/2045926627 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf94064260 con 0x7fbf94060370 2020-11-20T11:48:20.419 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.405+0000 7fbf998a2700 1 --2- 172.21.15.192:0/2045926627 >> v2:172.21.15.146:3300/0 conn(0x7fbf940c2340 0x7fbf94151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:48:20.420 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.405+0000 7fbf990a1700 1 --2- 172.21.15.192:0/2045926627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf94060370 0x7fbf94060750 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fbf94065730 tx=0x7fbf90006ef0).ready entity=mon.2 client_cookie=c00636eaafe9767 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:20.420 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.405+0000 7fbf83fff700 1 -- 172.21.15.192:0/2045926627 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9000b8c0 con 0x7fbf94060370 2020-11-20T11:48:20.420 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.405+0000 7fbf83fff700 1 -- 172.21.15.192:0/2045926627 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf90000e90 con 0x7fbf94060370 2020-11-20T11:48:20.421 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.405+0000 7fbf83fff700 1 -- 172.21.15.192:0/2045926627 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9000bc30 con 0x7fbf94060370 2020-11-20T11:48:20.421 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.406+0000 7fbf9b305700 1 -- 172.21.15.192:0/2045926627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf94060370 msgr2=0x7fbf94060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:20.421 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.406+0000 7fbf9b305700 1 --2- 172.21.15.192:0/2045926627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf94060370 0x7fbf94060750 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fbf94065730 tx=0x7fbf90006ef0).stop 2020-11-20T11:48:20.422 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.406+0000 7fbf9b305700 1 -- 172.21.15.192:0/2045926627 shutdown_connections 2020-11-20T11:48:20.422 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.406+0000 7fbf9b305700 1 --2- 172.21.15.192:0/2045926627 >> v2:172.21.15.146:3300/0 conn(0x7fbf940c2340 0x7fbf94151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:20.422 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.406+0000 7fbf9b305700 1 --2- 172.21.15.192:0/2045926627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf94060370 0x7fbf94060750 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:20.423 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.406+0000 7fbf9b305700 1 --2- 172.21.15.192:0/2045926627 >> v2:172.21.15.87:3300/0 conn(0x7fbf94154920 0x7fbf94064c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:20.423 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.406+0000 7fbf9b305700 1 -- 172.21.15.192:0/2045926627 >> 172.21.15.192:0/2045926627 conn(0x7fbf94062100 msgr2=0x7fbf940c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:20.423 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.406+0000 7fbf9b305700 1 -- 172.21.15.192:0/2045926627 shutdown_connections 2020-11-20T11:48:20.424 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.406+0000 7fbf9b305700 1 -- 172.21.15.192:0/2045926627 wait complete. 2020-11-20T11:48:20.424 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.407+0000 7fbf9b305700 1 Processor -- start 2020-11-20T11:48:20.424 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.407+0000 7fbf9b305700 1 -- start start 2020-11-20T11:48:20.425 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.408+0000 7fbf9b305700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf94060370 0x7fbf94160fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:20.425 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.408+0000 7fbf9b305700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf940c2340 0x7fbf940b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:20.425 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.408+0000 7fbf9b305700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf94154920 0x7fbf9414b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:20.426 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.408+0000 7fbf9b305700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf941614a0 con 0x7fbf940c2340 2020-11-20T11:48:20.426 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.408+0000 7fbf9b305700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf940b0830 con 0x7fbf94060370 2020-11-20T11:48:20.426 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.408+0000 7fbf9b305700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf940c27b0 con 0x7fbf94154920 2020-11-20T11:48:20.427 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.408+0000 7fbf998a2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf94154920 0x7fbf9414b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:20.427 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.408+0000 7fbf998a2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf94154920 0x7fbf9414b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49366/0 (socket says 172.21.15.192:49366) 2020-11-20T11:48:20.427 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.408+0000 7fbf998a2700 1 -- 172.21.15.192:0/1868469741 learned_addr learned my addr 172.21.15.192:0/1868469741 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:20.427 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.408+0000 7fbf988a0700 1 --2- 172.21.15.192:0/1868469741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf940c2340 0x7fbf940b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:20.428 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.408+0000 7fbf990a1700 1 --2- 172.21.15.192:0/1868469741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf94060370 0x7fbf94160fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:20.428 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.408+0000 7fbf998a2700 1 -- 172.21.15.192:0/1868469741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf94060370 msgr2=0x7fbf94160fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:20.428 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.408+0000 7fbf998a2700 1 --2- 172.21.15.192:0/1868469741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf94060370 0x7fbf94160fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:20.429 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.408+0000 7fbf998a2700 1 -- 172.21.15.192:0/1868469741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf940c2340 msgr2=0x7fbf940b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:20.429 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.408+0000 7fbf998a2700 1 --2- 172.21.15.192:0/1868469741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf940c2340 0x7fbf940b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:20.429 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.408+0000 7fbf998a2700 1 -- 172.21.15.192:0/1868469741 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf940c2a50 con 0x7fbf94154920 2020-11-20T11:48:20.430 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.408+0000 7fbf998a2700 1 --2- 172.21.15.192:0/1868469741 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf94154920 0x7fbf9414b820 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fbf8c00ec20 tx=0x7fbf8c008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:20.430 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.409+0000 7fbf817fa700 1 -- 172.21.15.192:0/1868469741 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c00c7f0 con 0x7fbf94154920 2020-11-20T11:48:20.430 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.409+0000 7fbf817fa700 1 -- 172.21.15.192:0/1868469741 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8c00c950 con 0x7fbf94154920 2020-11-20T11:48:20.431 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.409+0000 7fbf817fa700 1 -- 172.21.15.192:0/1868469741 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c00ccd0 con 0x7fbf94154920 2020-11-20T11:48:20.431 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.409+0000 7fbf9b305700 1 -- 172.21.15.192:0/1868469741 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf940c2cf0 con 0x7fbf94154920 2020-11-20T11:48:20.431 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.409+0000 7fbf9b305700 1 -- 172.21.15.192:0/1868469741 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf940c3230 con 0x7fbf94154920 2020-11-20T11:48:20.432 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.409+0000 7fbf9b305700 1 -- 172.21.15.192:0/1868469741 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf940699a0 con 0x7fbf94154920 2020-11-20T11:48:20.432 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.410+0000 7fbf817fa700 1 -- 172.21.15.192:0/1868469741 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fbf8c013640 con 0x7fbf94154920 2020-11-20T11:48:20.432 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.411+0000 7fbf817fa700 1 --2- 172.21.15.192:0/1868469741 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fbf6c080670 0x7fbf6c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:20.433 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.411+0000 7fbf817fa700 1 -- 172.21.15.192:0/1868469741 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fbf8c0a34b0 con 0x7fbf94154920 2020-11-20T11:48:20.433 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.411+0000 7fbf990a1700 1 --2- 172.21.15.192:0/1868469741 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fbf6c080670 0x7fbf6c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:20.433 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.411+0000 7fbf990a1700 1 --2- 172.21.15.192:0/1868469741 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fbf6c080670 0x7fbf6c082b30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fbf90006f30 tx=0x7fbf90016000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:20.434 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.413+0000 7fbf817fa700 1 -- 172.21.15.192:0/1868469741 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fbf8c077ec0 con 0x7fbf94154920 2020-11-20T11:48:20.556 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.553+0000 7fbf9b305700 1 -- 172.21.15.192:0/1868469741 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7fbf9405ca80 con 0x7fbf94154920 2020-11-20T11:48:20.556 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.553+0000 7fbf817fa700 1 -- 172.21.15.192:0/1868469741 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbf8c0094b0 con 0x7fbf94154920 2020-11-20T11:48:20.557 INFO:teuthology.orchestra.run.smithi192.stdout:73014444038 2020-11-20T11:48:20.558 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.554+0000 7fbf9b305700 1 -- 172.21.15.192:0/1868469741 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fbf6c080670 msgr2=0x7fbf6c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:20.558 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.554+0000 7fbf9b305700 1 --2- 172.21.15.192:0/1868469741 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fbf6c080670 0x7fbf6c082b30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fbf90006f30 tx=0x7fbf90016000).stop 2020-11-20T11:48:20.558 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.554+0000 7fbf9b305700 1 -- 172.21.15.192:0/1868469741 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf94154920 msgr2=0x7fbf9414b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:20.559 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.554+0000 7fbf9b305700 1 --2- 172.21.15.192:0/1868469741 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf94154920 0x7fbf9414b820 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fbf8c00ec20 tx=0x7fbf8c008040).stop 2020-11-20T11:48:20.559 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.555+0000 7fbf9b305700 1 -- 172.21.15.192:0/1868469741 shutdown_connections 2020-11-20T11:48:20.559 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.555+0000 7fbf9b305700 1 --2- 172.21.15.192:0/1868469741 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fbf6c080670 0x7fbf6c082b30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:20.559 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.555+0000 7fbf9b305700 1 --2- 172.21.15.192:0/1868469741 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf94154920 0x7fbf9414b820 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:20.560 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.555+0000 7fbf9b305700 1 --2- 172.21.15.192:0/1868469741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf94060370 0x7fbf94160fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:20.560 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.555+0000 7fbf9b305700 1 --2- 172.21.15.192:0/1868469741 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fbf940c2340 0x7fbf940b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:20.560 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.555+0000 7fbf9b305700 1 -- 172.21.15.192:0/1868469741 >> 172.21.15.192:0/1868469741 conn(0x7fbf94062100 msgr2=0x7fbf94152d60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:20.560 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.555+0000 7fbf9b305700 1 -- 172.21.15.192:0/1868469741 shutdown_connections 2020-11-20T11:48:20.561 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.555+0000 7fbf9b305700 1 -- 172.21.15.192:0/1868469741 wait complete. 2020-11-20T11:48:20.569 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444037 got 73014444038 for osd.9 2020-11-20T11:48:20.570 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2020-11-20T11:48:20.683 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.680+0000 7ff2d469c700 1 Processor -- start 2020-11-20T11:48:20.684 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.680+0000 7ff2d469c700 1 -- start start 2020-11-20T11:48:20.686 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.681+0000 7ff2d469c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff2cc060370 0x7ff2cc060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:20.686 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.681+0000 7ff2d469c700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2cc151e80 con 0x7ff2cc154920 2020-11-20T11:48:20.686 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.681+0000 7ff2d469c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2cc152120 con 0x7ff2cc064c40 2020-11-20T11:48:20.687 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.681+0000 7ff2d469c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2cc064260 con 0x7ff2cc060370 2020-11-20T11:48:20.687 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.681+0000 7ff2d2438700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff2cc060370 0x7ff2cc060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:20.687 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.681+0000 7ff2d1c37700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7ff2cc154920 0x7ff2cc0c2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.192:38754/0 (socket says 172.21.15.192:38754) 2020-11-20T11:48:20.687 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.681+0000 7ff2d1c37700 1 -- 172.21.15.192:0/779361129 learned_addr learned my addr 172.21.15.192:0/779361129 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:20.688 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.681+0000 7ff2d2c39700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff2cc064c40 0x7ff2cc151340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.192:33094/0 (socket says 172.21.15.192:33094) 2020-11-20T11:48:20.688 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.682+0000 7ff2d1436700 1 -- 172.21.15.192:0/779361129 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 443342163 0 0) 0x7ff2cc152120 con 0x7ff2cc064c40 2020-11-20T11:48:20.688 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.682+0000 7ff2d1436700 1 -- 172.21.15.192:0/779361129 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2b4003280 con 0x7ff2cc064c40 2020-11-20T11:48:20.688 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.682+0000 7ff2d2438700 1 -- 172.21.15.192:0/779361129 >> v1:172.21.15.146:6789/0 conn(0x7ff2cc064c40 legacy=0x7ff2cc151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:20.689 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.682+0000 7ff2d2438700 1 -- 172.21.15.192:0/779361129 >> v1:172.21.15.87:6789/0 conn(0x7ff2cc154920 legacy=0x7ff2cc0c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:20.689 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.682+0000 7ff2d1436700 1 -- 172.21.15.192:0/779361129 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3169507626 0 0) 0x7ff2cc151e80 con 0x7ff2cc154920 2020-11-20T11:48:20.689 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.682+0000 7ff2d2438700 1 -- 172.21.15.192:0/779361129 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2cc064500 con 0x7ff2cc060370 2020-11-20T11:48:20.689 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.682+0000 7ff2d2438700 1 --2- 172.21.15.192:0/779361129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2cc060370 0x7ff2cc060750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7ff2bc006fd0 tx=0x7ff2bc006e30).ready entity=mon.1 client_cookie=841e26171e371ab6 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:20.689 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.682+0000 7ff2d1436700 1 -- 172.21.15.192:0/779361129 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc00bec0 con 0x7ff2cc060370 2020-11-20T11:48:20.690 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.682+0000 7ff2d1436700 1 -- 172.21.15.192:0/779361129 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2bc000e90 con 0x7ff2cc060370 2020-11-20T11:48:20.690 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.682+0000 7ff2d1436700 1 -- 172.21.15.192:0/779361129 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc009a80 con 0x7ff2cc060370 2020-11-20T11:48:20.690 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.682+0000 7ff2d469c700 1 -- 172.21.15.192:0/779361129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2cc060370 msgr2=0x7ff2cc060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:20.690 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.682+0000 7ff2d469c700 1 --2- 172.21.15.192:0/779361129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2cc060370 0x7ff2cc060750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7ff2bc006fd0 tx=0x7ff2bc006e30).stop 2020-11-20T11:48:20.691 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.682+0000 7ff2d469c700 1 -- 172.21.15.192:0/779361129 shutdown_connections 2020-11-20T11:48:20.691 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.682+0000 7ff2d469c700 1 --2- 172.21.15.192:0/779361129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2cc060370 0x7ff2cc060750 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:20.691 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.682+0000 7ff2d469c700 1 -- 172.21.15.192:0/779361129 >> 172.21.15.192:0/779361129 conn(0x7ff2cc062100 msgr2=0x7ff2cc0c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:20.692 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.682+0000 7ff2d469c700 1 -- 172.21.15.192:0/779361129 shutdown_connections 2020-11-20T11:48:20.692 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.683+0000 7ff2d469c700 1 -- 172.21.15.192:0/779361129 wait complete. 2020-11-20T11:48:20.695 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.684+0000 7ff2d469c700 1 Processor -- start 2020-11-20T11:48:20.695 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.684+0000 7ff2d469c700 1 -- start start 2020-11-20T11:48:20.695 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.684+0000 7ff2d469c700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2cc060370 0x7ff2cc0c0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:20.695 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.684+0000 7ff2d469c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2cc064c40 0x7ff2cc160df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:20.696 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.684+0000 7ff2d469c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2cc154920 0x7ff2cc163970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:20.696 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.684+0000 7ff2d469c700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc14cd20 con 0x7ff2cc060370 2020-11-20T11:48:20.696 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.684+0000 7ff2d469c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc0c0f90 con 0x7ff2cc154920 2020-11-20T11:48:20.696 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.684+0000 7ff2d469c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc164230 con 0x7ff2cc064c40 2020-11-20T11:48:20.697 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.684+0000 7ff2d1c37700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2cc064c40 0x7ff2cc160df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:20.697 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.684+0000 7ff2d1c37700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2cc064c40 0x7ff2cc160df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49378/0 (socket says 172.21.15.192:49378) 2020-11-20T11:48:20.697 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.684+0000 7ff2d1c37700 1 -- 172.21.15.192:0/3163499425 learned_addr learned my addr 172.21.15.192:0/3163499425 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:20.697 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.684+0000 7ff2d2c39700 1 --2- 172.21.15.192:0/3163499425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2cc154920 0x7ff2cc163970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:20.697 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.685+0000 7ff2d2438700 1 --2- 172.21.15.192:0/3163499425 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2cc060370 0x7ff2cc0c0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:20.698 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.685+0000 7ff2d1c37700 1 -- 172.21.15.192:0/3163499425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2cc154920 msgr2=0x7ff2cc163970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:20.698 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.685+0000 7ff2d1c37700 1 --2- 172.21.15.192:0/3163499425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2cc154920 0x7ff2cc163970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:20.698 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.685+0000 7ff2d1c37700 1 -- 172.21.15.192:0/3163499425 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2cc060370 msgr2=0x7ff2cc0c0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:20.699 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.685+0000 7ff2d1c37700 1 --2- 172.21.15.192:0/3163499425 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2cc060370 0x7ff2cc0c0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:20.699 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.685+0000 7ff2d1c37700 1 -- 172.21.15.192:0/3163499425 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2cc1644d0 con 0x7ff2cc064c40 2020-11-20T11:48:20.699 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.685+0000 7ff2d1c37700 1 --2- 172.21.15.192:0/3163499425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2cc064c40 0x7ff2cc160df0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7ff2c800c6e0 tx=0x7ff2c8007a80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:20.699 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.685+0000 7ff2ba7fc700 1 -- 172.21.15.192:0/3163499425 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c80072e0 con 0x7ff2cc064c40 2020-11-20T11:48:20.699 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.685+0000 7ff2ba7fc700 1 -- 172.21.15.192:0/3163499425 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c8007440 con 0x7ff2cc064c40 2020-11-20T11:48:20.700 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.685+0000 7ff2ba7fc700 1 -- 172.21.15.192:0/3163499425 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c8005840 con 0x7ff2cc064c40 2020-11-20T11:48:20.700 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.685+0000 7ff2d469c700 1 -- 172.21.15.192:0/3163499425 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2cc164770 con 0x7ff2cc064c40 2020-11-20T11:48:20.700 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.685+0000 7ff2d469c700 1 -- 172.21.15.192:0/3163499425 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2cc1603e0 con 0x7ff2cc064c40 2020-11-20T11:48:20.700 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.686+0000 7ff2d469c700 1 -- 172.21.15.192:0/3163499425 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2cc0699a0 con 0x7ff2cc064c40 2020-11-20T11:48:20.701 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.687+0000 7ff2ba7fc700 1 -- 172.21.15.192:0/3163499425 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7ff2c8010070 con 0x7ff2cc064c40 2020-11-20T11:48:20.701 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.687+0000 7ff2ba7fc700 1 --2- 172.21.15.192:0/3163499425 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7ff2a4080670 0x7ff2a4082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:20.701 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.687+0000 7ff2ba7fc700 1 -- 172.21.15.192:0/3163499425 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7ff2c80a2020 con 0x7ff2cc064c40 2020-11-20T11:48:20.701 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.687+0000 7ff2d2438700 1 --2- 172.21.15.192:0/3163499425 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7ff2a4080670 0x7ff2a4082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:20.702 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.687+0000 7ff2d2438700 1 --2- 172.21.15.192:0/3163499425 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7ff2a4080670 0x7ff2a4082b30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7ff2bc006ba0 tx=0x7ff2bc015000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:20.702 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.690+0000 7ff2ba7fc700 1 -- 172.21.15.192:0/3163499425 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7ff2c8076ac0 con 0x7ff2cc064c40 2020-11-20T11:48:20.834 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.831+0000 7ff2d469c700 1 -- 172.21.15.192:0/3163499425 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7ff2cc160b10 con 0x7ff2cc064c40 2020-11-20T11:48:20.835 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.831+0000 7ff2ba7fc700 1 -- 172.21.15.192:0/3163499425 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+12 (secure 0 0 0) 0x7ff2c807a0e0 con 0x7ff2cc064c40 2020-11-20T11:48:20.835 INFO:teuthology.orchestra.run.smithi192.stdout:73014444038 2020-11-20T11:48:20.837 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.833+0000 7ff2d469c700 1 -- 172.21.15.192:0/3163499425 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7ff2a4080670 msgr2=0x7ff2a4082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:20.837 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.833+0000 7ff2d469c700 1 --2- 172.21.15.192:0/3163499425 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7ff2a4080670 0x7ff2a4082b30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7ff2bc006ba0 tx=0x7ff2bc015000).stop 2020-11-20T11:48:20.837 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.833+0000 7ff2d469c700 1 -- 172.21.15.192:0/3163499425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2cc064c40 msgr2=0x7ff2cc160df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:20.838 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.833+0000 7ff2d469c700 1 --2- 172.21.15.192:0/3163499425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2cc064c40 0x7ff2cc160df0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7ff2c800c6e0 tx=0x7ff2c8007a80).stop 2020-11-20T11:48:20.838 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.833+0000 7ff2d469c700 1 -- 172.21.15.192:0/3163499425 shutdown_connections 2020-11-20T11:48:20.838 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.833+0000 7ff2d469c700 1 --2- 172.21.15.192:0/3163499425 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7ff2a4080670 0x7ff2a4082b30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:20.838 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.833+0000 7ff2d469c700 1 --2- 172.21.15.192:0/3163499425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2cc154920 0x7ff2cc163970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:20.838 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.833+0000 7ff2d469c700 1 --2- 172.21.15.192:0/3163499425 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ff2cc060370 0x7ff2cc0c0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:20.839 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.833+0000 7ff2d469c700 1 --2- 172.21.15.192:0/3163499425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2cc064c40 0x7ff2cc160df0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:20.839 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.833+0000 7ff2d469c700 1 -- 172.21.15.192:0/3163499425 >> 172.21.15.192:0/3163499425 conn(0x7ff2cc062100 msgr2=0x7ff2cc153c10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:20.839 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.833+0000 7ff2d469c700 1 -- 172.21.15.192:0/3163499425 shutdown_connections 2020-11-20T11:48:20.840 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.833+0000 7ff2d469c700 1 -- 172.21.15.192:0/3163499425 wait complete. 2020-11-20T11:48:20.847 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444038 got 73014444038 for osd.10 2020-11-20T11:48:20.848 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2020-11-20T11:48:20.959 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.956+0000 7fae725ce700 1 Processor -- start 2020-11-20T11:48:20.960 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.956+0000 7fae725ce700 1 -- start start 2020-11-20T11:48:20.962 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.957+0000 7fae725ce700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fae6c0bdad0 0x7fae6c0bdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:20.962 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.957+0000 7fae725ce700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fae6c14fbe0 0x7fae6c066420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:20.962 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.957+0000 7fae725ce700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae6c066e70 con 0x7fae6c1525e0 2020-11-20T11:48:20.963 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.957+0000 7fae725ce700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae6c0becb0 con 0x7fae6c14fbe0 2020-11-20T11:48:20.963 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.957+0000 7fae725ce700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae6c067110 con 0x7fae6c0bdad0 2020-11-20T11:48:20.963 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.957+0000 7fae6bfff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fae6c0bdad0 0x7fae6c0bdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:20.964 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.957+0000 7fae6bfff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fae6c0bdad0 0x7fae6c0bdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49384/0 (socket says 172.21.15.192:49384) 2020-11-20T11:48:20.964 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.957+0000 7fae6bfff700 1 -- 172.21.15.192:0/1309572738 learned_addr learned my addr 172.21.15.192:0/1309572738 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:20.964 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.957+0000 7fae70b6b700 1 --2- 172.21.15.192:0/1309572738 >> v2:172.21.15.146:3300/0 conn(0x7fae6c14fbe0 0x7fae6c066420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:20.964 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.957+0000 7fae6bfff700 1 -- 172.21.15.192:0/1309572738 >> v2:172.21.15.146:3300/0 conn(0x7fae6c14fbe0 msgr2=0x7fae6c066420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:20.964 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.957+0000 7fae6bfff700 1 --2- 172.21.15.192:0/1309572738 >> v2:172.21.15.146:3300/0 conn(0x7fae6c14fbe0 0x7fae6c066420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:20.965 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.957+0000 7fae6bfff700 1 -- 172.21.15.192:0/1309572738 >> v1:172.21.15.146:6789/0 conn(0x7fae6c1525e0 legacy=0x7fae6c0be5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:20.965 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.957+0000 7fae6bfff700 1 -- 172.21.15.192:0/1309572738 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6c14f200 con 0x7fae6c0bdad0 2020-11-20T11:48:20.965 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.957+0000 7fae6bfff700 1 --2- 172.21.15.192:0/1309572738 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae6c0bdad0 0x7fae6c0bdeb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fae6c0c67a0 tx=0x7fae5c006e90).ready entity=mon.2 client_cookie=b7a8285e2346d065 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:20.965 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.958+0000 7fae6affd700 1 -- 172.21.15.192:0/1309572738 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c006030 con 0x7fae6c0bdad0 2020-11-20T11:48:20.966 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.958+0000 7fae6affd700 1 -- 172.21.15.192:0/1309572738 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5c006190 con 0x7fae6c0bdad0 2020-11-20T11:48:20.966 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.958+0000 7fae6affd700 1 -- 172.21.15.192:0/1309572738 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c006510 con 0x7fae6c0bdad0 2020-11-20T11:48:20.966 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.958+0000 7fae725ce700 1 -- 172.21.15.192:0/1309572738 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae6c0bdad0 msgr2=0x7fae6c0bdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:20.966 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.958+0000 7fae725ce700 1 --2- 172.21.15.192:0/1309572738 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae6c0bdad0 0x7fae6c0bdeb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fae6c0c67a0 tx=0x7fae5c006e90).stop 2020-11-20T11:48:20.966 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.958+0000 7fae725ce700 1 -- 172.21.15.192:0/1309572738 shutdown_connections 2020-11-20T11:48:20.967 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.958+0000 7fae725ce700 1 --2- 172.21.15.192:0/1309572738 >> v2:172.21.15.146:3300/0 conn(0x7fae6c14fbe0 0x7fae6c066420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:20.967 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.958+0000 7fae725ce700 1 --2- 172.21.15.192:0/1309572738 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae6c0bdad0 0x7fae6c0bdeb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:20.967 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.958+0000 7fae725ce700 1 -- 172.21.15.192:0/1309572738 >> 172.21.15.192:0/1309572738 conn(0x7fae6c0601b0 msgr2=0x7fae6c0605c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:20.967 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.958+0000 7fae725ce700 1 -- 172.21.15.192:0/1309572738 shutdown_connections 2020-11-20T11:48:20.968 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.958+0000 7fae725ce700 1 -- 172.21.15.192:0/1309572738 wait complete. 2020-11-20T11:48:20.968 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.959+0000 7fae725ce700 1 Processor -- start 2020-11-20T11:48:20.971 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.959+0000 7fae725ce700 1 -- start start 2020-11-20T11:48:20.971 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.960+0000 7fae725ce700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae6c0bdad0 0x7fae6c15efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:20.971 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.960+0000 7fae725ce700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae6c14fbe0 0x7fae6c152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:20.971 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.960+0000 7fae725ce700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae6c1525e0 0x7fae6c1560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:20.972 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.960+0000 7fae725ce700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c15f4a0 con 0x7fae6c1525e0 2020-11-20T11:48:20.972 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.960+0000 7fae725ce700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c153950 con 0x7fae6c0bdad0 2020-11-20T11:48:20.972 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.960+0000 7fae725ce700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c1107f0 con 0x7fae6c14fbe0 2020-11-20T11:48:20.972 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.960+0000 7fae6b7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae6c14fbe0 0x7fae6c152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:20.973 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.960+0000 7fae6b7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae6c14fbe0 0x7fae6c152c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49392/0 (socket says 172.21.15.192:49392) 2020-11-20T11:48:20.973 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.960+0000 7fae6b7fe700 1 -- 172.21.15.192:0/168080569 learned_addr learned my addr 172.21.15.192:0/168080569 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:20.973 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.960+0000 7fae6bfff700 1 --2- 172.21.15.192:0/168080569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae6c0bdad0 0x7fae6c15efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:20.973 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.960+0000 7fae70b6b700 1 --2- 172.21.15.192:0/168080569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae6c1525e0 0x7fae6c1560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:20.974 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.961+0000 7fae6b7fe700 1 -- 172.21.15.192:0/168080569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae6c0bdad0 msgr2=0x7fae6c15efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:20.974 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.961+0000 7fae6b7fe700 1 --2- 172.21.15.192:0/168080569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae6c0bdad0 0x7fae6c15efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:20.974 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.961+0000 7fae6b7fe700 1 -- 172.21.15.192:0/168080569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae6c1525e0 msgr2=0x7fae6c1560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:20.974 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.961+0000 7fae6b7fe700 1 --2- 172.21.15.192:0/168080569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae6c1525e0 0x7fae6c1560b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:20.974 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.961+0000 7fae6b7fe700 1 -- 172.21.15.192:0/168080569 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6c110a50 con 0x7fae6c14fbe0 2020-11-20T11:48:20.975 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.961+0000 7fae70b6b700 1 --2- 172.21.15.192:0/168080569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae6c1525e0 0x7fae6c1560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:48:20.975 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.961+0000 7fae6b7fe700 1 --2- 172.21.15.192:0/168080569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae6c14fbe0 0x7fae6c152c40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fae6000c710 tx=0x7fae60007c40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:20.975 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.961+0000 7fae4bfff700 1 -- 172.21.15.192:0/168080569 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6000e4a0 con 0x7fae6c14fbe0 2020-11-20T11:48:20.975 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.961+0000 7fae4bfff700 1 -- 172.21.15.192:0/168080569 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6000e600 con 0x7fae6c14fbe0 2020-11-20T11:48:20.976 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.961+0000 7fae725ce700 1 -- 172.21.15.192:0/168080569 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae6c110cf0 con 0x7fae6c14fbe0 2020-11-20T11:48:20.976 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.961+0000 7fae4bfff700 1 -- 172.21.15.192:0/168080569 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6000e9a0 con 0x7fae6c14fbe0 2020-11-20T11:48:20.976 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.961+0000 7fae725ce700 1 -- 172.21.15.192:0/168080569 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae6c153b80 con 0x7fae6c14fbe0 2020-11-20T11:48:20.976 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.962+0000 7fae725ce700 1 -- 172.21.15.192:0/168080569 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae6c152420 con 0x7fae6c14fbe0 2020-11-20T11:48:20.977 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.962+0000 7fae4bfff700 1 -- 172.21.15.192:0/168080569 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fae60010030 con 0x7fae6c14fbe0 2020-11-20T11:48:20.977 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.963+0000 7fae4bfff700 1 --2- 172.21.15.192:0/168080569 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fae44080670 0x7fae44082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:20.977 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.963+0000 7fae4bfff700 1 -- 172.21.15.192:0/168080569 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fae600a2750 con 0x7fae6c14fbe0 2020-11-20T11:48:20.977 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.963+0000 7fae6bfff700 1 --2- 172.21.15.192:0/168080569 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fae44080670 0x7fae44082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:20.978 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.963+0000 7fae6bfff700 1 --2- 172.21.15.192:0/168080569 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fae44080670 0x7fae44082b30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fae5c006ed0 tx=0x7fae5c015000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:20.978 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:20.966+0000 7fae4bfff700 1 -- 172.21.15.192:0/168080569 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fae60077160 con 0x7fae6c14fbe0 2020-11-20T11:48:21.109 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.105+0000 7fae725ce700 1 -- 172.21.15.192:0/168080569 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7fae6c05ca80 con 0x7fae6c14fbe0 2020-11-20T11:48:21.109 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.106+0000 7fae4bfff700 1 -- 172.21.15.192:0/168080569 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+12 (secure 0 0 0) 0x7fae6007a780 con 0x7fae6c14fbe0 2020-11-20T11:48:21.110 INFO:teuthology.orchestra.run.smithi192.stdout:73014444038 2020-11-20T11:48:21.111 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.107+0000 7fae725ce700 1 -- 172.21.15.192:0/168080569 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fae44080670 msgr2=0x7fae44082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:21.111 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.107+0000 7fae725ce700 1 --2- 172.21.15.192:0/168080569 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fae44080670 0x7fae44082b30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fae5c006ed0 tx=0x7fae5c015000).stop 2020-11-20T11:48:21.111 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.107+0000 7fae725ce700 1 -- 172.21.15.192:0/168080569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae6c14fbe0 msgr2=0x7fae6c152c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:21.111 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.107+0000 7fae725ce700 1 --2- 172.21.15.192:0/168080569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae6c14fbe0 0x7fae6c152c40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fae6000c710 tx=0x7fae60007c40).stop 2020-11-20T11:48:21.112 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.107+0000 7fae725ce700 1 -- 172.21.15.192:0/168080569 shutdown_connections 2020-11-20T11:48:21.112 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.107+0000 7fae725ce700 1 --2- 172.21.15.192:0/168080569 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fae44080670 0x7fae44082b30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:21.113 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.107+0000 7fae725ce700 1 --2- 172.21.15.192:0/168080569 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fae6c1525e0 0x7fae6c1560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:21.113 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.107+0000 7fae725ce700 1 --2- 172.21.15.192:0/168080569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae6c0bdad0 0x7fae6c15efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:21.113 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.107+0000 7fae725ce700 1 --2- 172.21.15.192:0/168080569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae6c14fbe0 0x7fae6c152c40 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:21.114 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.107+0000 7fae725ce700 1 -- 172.21.15.192:0/168080569 >> 172.21.15.192:0/168080569 conn(0x7fae6c0601b0 msgr2=0x7fae6c0c1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:21.114 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.107+0000 7fae725ce700 1 -- 172.21.15.192:0/168080569 shutdown_connections 2020-11-20T11:48:21.114 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.107+0000 7fae725ce700 1 -- 172.21.15.192:0/168080569 wait complete. 2020-11-20T11:48:21.122 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444037 got 73014444038 for osd.11 2020-11-20T11:48:21.122 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-11-20T11:48:21.123 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-20T11:48:21.231 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.228+0000 7f400d093700 1 Processor -- start 2020-11-20T11:48:21.231 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.228+0000 7f400d093700 1 -- start start 2020-11-20T11:48:21.240 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.229+0000 7f400d093700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4008061bd0 0x7f4008151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:21.240 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.229+0000 7f400d093700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4008154610 con 0x7f4008150c70 2020-11-20T11:48:21.240 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.229+0000 7f400d093700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40081548b0 con 0x7f40080617f0 2020-11-20T11:48:21.240 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.229+0000 7f400d093700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4008154b50 con 0x7f4008061bd0 2020-11-20T11:48:21.240 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.229+0000 7f4007fff700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f40080617f0 0x7f4008150560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52066/0 (socket says 172.21.15.192:52066) 2020-11-20T11:48:21.241 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.229+0000 7f4007fff700 1 -- 172.21.15.192:0/523835926 learned_addr learned my addr 172.21.15.192:0/523835926 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:21.241 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.229+0000 7f4006ffd700 1 -- 172.21.15.192:0/523835926 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1731293453 0 0) 0x7f40081548b0 con 0x7f40080617f0 2020-11-20T11:48:21.241 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.229+0000 7f4006ffd700 1 -- 172.21.15.192:0/523835926 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ff4003280 con 0x7f40080617f0 2020-11-20T11:48:21.241 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.229+0000 7f400c892700 1 --2- 172.21.15.192:0/523835926 >> v2:172.21.15.146:3300/0 conn(0x7f4008061bd0 0x7f4008151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:21.242 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.229+0000 7f4006ffd700 1 -- 172.21.15.192:0/523835926 <== mon.2 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 818374600 0 0) 0x7f3ff4003280 con 0x7f40080617f0 2020-11-20T11:48:21.242 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.229+0000 7f4006ffd700 1 -- 172.21.15.192:0/523835926 >> v2:172.21.15.146:3300/0 conn(0x7f4008061bd0 msgr2=0x7f4008151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:21.242 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.229+0000 7f4006ffd700 1 --2- 172.21.15.192:0/523835926 >> v2:172.21.15.146:3300/0 conn(0x7f4008061bd0 0x7f4008151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:21.242 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.229+0000 7f4006ffd700 1 -- 172.21.15.192:0/523835926 >> v1:172.21.15.146:6789/0 conn(0x7f4008150c70 legacy=0x7f4008151430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:21.242 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.229+0000 7f4006ffd700 1 -- 172.21.15.192:0/523835926 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4008154df0 con 0x7f40080617f0 2020-11-20T11:48:21.243 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.230+0000 7f4006ffd700 1 -- 172.21.15.192:0/523835926 <== mon.2 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3985397220 0 0) 0x7f3ff8001520 con 0x7f40080617f0 2020-11-20T11:48:21.243 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.230+0000 7f4006ffd700 1 -- 172.21.15.192:0/523835926 >> v1:172.21.15.192:6789/0 conn(0x7f40080617f0 legacy=0x7f4008150560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:21.243 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.230+0000 7f4006ffd700 1 --2- 172.21.15.192:0/523835926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ff4003810 0x7f3ff4003c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:21.243 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.230+0000 7f4006ffd700 1 --2- 172.21.15.192:0/523835926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ff4004520 0x7f3ff40049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:21.243 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.230+0000 7f4006ffd700 1 --2- 172.21.15.192:0/523835926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ff4004e90 0x7f3ff400b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:21.244 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.230+0000 7f4006ffd700 1 -- 172.21.15.192:0/523835926 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4008154b50 con 0x7f3ff4004e90 2020-11-20T11:48:21.244 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.230+0000 7f4006ffd700 1 -- 172.21.15.192:0/523835926 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff4005340 con 0x7f3ff4004520 2020-11-20T11:48:21.244 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.230+0000 7f4006ffd700 1 -- 172.21.15.192:0/523835926 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff400bc60 con 0x7f3ff4003810 2020-11-20T11:48:21.244 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.230+0000 7f4007fff700 1 --2- 172.21.15.192:0/523835926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ff4003810 0x7f3ff4003c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:21.244 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.230+0000 7f40077fe700 1 --2- 172.21.15.192:0/523835926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ff4004520 0x7f3ff40049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:21.245 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.230+0000 7f4007fff700 1 -- 172.21.15.192:0/523835926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ff4004520 msgr2=0x7f3ff40049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:21.245 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.230+0000 7f4007fff700 1 --2- 172.21.15.192:0/523835926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ff4004520 0x7f3ff40049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:21.245 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.230+0000 7f4007fff700 1 -- 172.21.15.192:0/523835926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ff4004e90 msgr2=0x7f3ff400b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:21.245 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.230+0000 7f4007fff700 1 --2- 172.21.15.192:0/523835926 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3ff4004e90 0x7f3ff400b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T11:48:21.245 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.230+0000 7f400c892700 1 -- 172.21.15.192:0/523835926 reap_dead start 2020-11-20T11:48:21.246 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.230+0000 7f4007fff700 1 -- 172.21.15.192:0/523835926 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff4003280 con 0x7f3ff4003810 2020-11-20T11:48:21.246 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.230+0000 7f4007fff700 1 --2- 172.21.15.192:0/523835926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ff4003810 0x7f3ff4003c30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f3ff800c210 tx=0x7f4008154a40).ready entity=mon.2 client_cookie=dd6dca7230589038 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:21.246 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.230+0000 7f4006ffd700 1 -- 172.21.15.192:0/523835926 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff800ce80 con 0x7f3ff4003810 2020-11-20T11:48:21.246 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.230+0000 7f4006ffd700 1 -- 172.21.15.192:0/523835926 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff80070d0 con 0x7f3ff4003810 2020-11-20T11:48:21.246 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.230+0000 7f4006ffd700 1 -- 172.21.15.192:0/523835926 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8007450 con 0x7f3ff4003810 2020-11-20T11:48:21.247 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.231+0000 7f400d093700 1 -- 172.21.15.192:0/523835926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ff4003810 msgr2=0x7f3ff4003c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:21.247 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.231+0000 7f400d093700 1 --2- 172.21.15.192:0/523835926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ff4003810 0x7f3ff4003c30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f3ff800c210 tx=0x7f4008154a40).stop 2020-11-20T11:48:21.247 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.231+0000 7f400d093700 1 -- 172.21.15.192:0/523835926 shutdown_connections 2020-11-20T11:48:21.247 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.231+0000 7f400d093700 1 --2- 172.21.15.192:0/523835926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ff4003810 0x7f3ff4003c30 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:21.247 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.231+0000 7f400d093700 1 -- 172.21.15.192:0/523835926 >> 172.21.15.192:0/523835926 conn(0x7f40080c77f0 msgr2=0x7f40080c7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:21.248 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.231+0000 7f400d093700 1 -- 172.21.15.192:0/523835926 shutdown_connections 2020-11-20T11:48:21.248 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.231+0000 7f400d093700 1 -- 172.21.15.192:0/523835926 wait complete. 2020-11-20T11:48:21.248 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.232+0000 7f400d093700 1 Processor -- start 2020-11-20T11:48:21.248 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.232+0000 7f400d093700 1 -- start start 2020-11-20T11:48:21.248 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.233+0000 7f400d093700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ff4003810 0x7f400814c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:21.249 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.233+0000 7f400d093700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4008148620 0x7f4008152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:21.249 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.233+0000 7f400d093700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4008162e90 0x7f4008149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:21.249 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.233+0000 7f400d093700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400814b880 con 0x7f4008162e90 2020-11-20T11:48:21.249 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.233+0000 7f400d093700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40080c7520 con 0x7f4008148620 2020-11-20T11:48:21.249 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.233+0000 7f400d093700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4008148fd0 con 0x7f3ff4003810 2020-11-20T11:48:21.250 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.233+0000 7f4007fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ff4003810 0x7f400814c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:21.250 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.233+0000 7f4007fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ff4003810 0x7f400814c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49410/0 (socket says 172.21.15.192:49410) 2020-11-20T11:48:21.250 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.233+0000 7f4007fff700 1 -- 172.21.15.192:0/2155946289 learned_addr learned my addr 172.21.15.192:0/2155946289 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:21.250 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.233+0000 7f40077fe700 1 --2- 172.21.15.192:0/2155946289 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4008148620 0x7f4008152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:21.250 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.233+0000 7f400c892700 1 --2- 172.21.15.192:0/2155946289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4008162e90 0x7f4008149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:21.251 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.233+0000 7f4007fff700 1 -- 172.21.15.192:0/2155946289 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4008148620 msgr2=0x7f4008152440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:21.251 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.233+0000 7f4007fff700 1 --2- 172.21.15.192:0/2155946289 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4008148620 0x7f4008152440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:21.251 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.233+0000 7f4007fff700 1 -- 172.21.15.192:0/2155946289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4008162e90 msgr2=0x7f4008149cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:21.251 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.233+0000 7f4007fff700 1 --2- 172.21.15.192:0/2155946289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4008162e90 0x7f4008149cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:21.252 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.233+0000 7f4007fff700 1 -- 172.21.15.192:0/2155946289 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4008149270 con 0x7f3ff4003810 2020-11-20T11:48:21.252 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.233+0000 7f400c892700 1 --2- 172.21.15.192:0/2155946289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4008162e90 0x7f4008149cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:48:21.252 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.233+0000 7f4007fff700 1 --2- 172.21.15.192:0/2155946289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ff4003810 0x7f400814c220 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f3ff4005500 tx=0x7f3ff8015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:21.252 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.233+0000 7f3fe7fff700 1 -- 172.21.15.192:0/2155946289 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8007450 con 0x7f3ff4003810 2020-11-20T11:48:21.253 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.233+0000 7f3fe7fff700 1 -- 172.21.15.192:0/2155946289 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff8013450 con 0x7f3ff4003810 2020-11-20T11:48:21.253 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.233+0000 7f400d093700 1 -- 172.21.15.192:0/2155946289 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4008149510 con 0x7f3ff4003810 2020-11-20T11:48:21.253 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.233+0000 7f3fe7fff700 1 -- 172.21.15.192:0/2155946289 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff80137f0 con 0x7f3ff4003810 2020-11-20T11:48:21.253 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.233+0000 7f400d093700 1 -- 172.21.15.192:0/2155946289 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f400814bd80 con 0x7f3ff4003810 2020-11-20T11:48:21.253 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.234+0000 7f400d093700 1 -- 172.21.15.192:0/2155946289 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4008148fd0 con 0x7f3ff4003810 2020-11-20T11:48:21.253 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.235+0000 7f3fe7fff700 1 -- 172.21.15.192:0/2155946289 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f3ff8026020 con 0x7f3ff4003810 2020-11-20T11:48:21.254 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.235+0000 7f3fe7fff700 1 --2- 172.21.15.192:0/2155946289 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3fe0080670 0x7f3fe0082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:21.254 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.236+0000 7f3fe7fff700 1 -- 172.21.15.192:0/2155946289 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f3ff80a3ee0 con 0x7f3ff4003810 2020-11-20T11:48:21.254 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.236+0000 7f40077fe700 1 --2- 172.21.15.192:0/2155946289 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3fe0080670 0x7f3fe0082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:21.254 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.236+0000 7f40077fe700 1 --2- 172.21.15.192:0/2155946289 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3fe0080670 0x7f3fe0082b30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f3ffc000f60 tx=0x7f3ffc009040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:21.255 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.239+0000 7f3fe7fff700 1 -- 172.21.15.192:0/2155946289 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f3ff80788f0 con 0x7f3ff4003810 2020-11-20T11:48:21.378 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.375+0000 7f400d093700 1 -- 172.21.15.192:0/2155946289 --> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f400814b650 con 0x7f3fe0080670 2020-11-20T11:48:21.382 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.379+0000 7f3fe7fff700 1 -- 172.21.15.192:0/2155946289 <== mgr.4106 v2:172.21.15.192:6800/22925 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+100082 (secure 0 0 0) 0x7f400814b650 con 0x7f3fe0080670 2020-11-20T11:48:21.383 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:48:21.385 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.381+0000 7f400d093700 1 -- 172.21.15.192:0/2155946289 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3fe0080670 msgr2=0x7f3fe0082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:21.385 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.381+0000 7f400d093700 1 --2- 172.21.15.192:0/2155946289 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3fe0080670 0x7f3fe0082b30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f3ffc000f60 tx=0x7f3ffc009040).stop 2020-11-20T11:48:21.385 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.381+0000 7f400d093700 1 -- 172.21.15.192:0/2155946289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ff4003810 msgr2=0x7f400814c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:21.385 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.381+0000 7f400d093700 1 --2- 172.21.15.192:0/2155946289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ff4003810 0x7f400814c220 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f3ff4005500 tx=0x7f3ff8015000).stop 2020-11-20T11:48:21.386 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.381+0000 7f400d093700 1 -- 172.21.15.192:0/2155946289 shutdown_connections 2020-11-20T11:48:21.386 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.381+0000 7f400d093700 1 --2- 172.21.15.192:0/2155946289 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3fe0080670 0x7f3fe0082b30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:21.386 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.381+0000 7f400d093700 1 --2- 172.21.15.192:0/2155946289 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4008162e90 0x7f4008149cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:21.386 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.381+0000 7f400d093700 1 --2- 172.21.15.192:0/2155946289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ff4003810 0x7f400814c220 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:21.386 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.381+0000 7f400d093700 1 --2- 172.21.15.192:0/2155946289 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4008148620 0x7f4008152440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:21.387 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.381+0000 7f400d093700 1 -- 172.21.15.192:0/2155946289 >> 172.21.15.192:0/2155946289 conn(0x7f40080c77f0 msgr2=0x7f400814af40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:21.387 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.381+0000 7f400d093700 1 -- 172.21.15.192:0/2155946289 shutdown_connections 2020-11-20T11:48:21.387 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.381+0000 7f400d093700 1 -- 172.21.15.192:0/2155946289 wait complete. 2020-11-20T11:48:21.387 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2020-11-20T11:48:21.395 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2020-11-20T11:48:20.303390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":61744,"kb_used_data":3472,"kb_used_omap":0,"kb_used_meta":58176,"kb_avail":1132400336,"statfs":{"total":1159641169920,"available":1159577944064,"internally_reserved":0,"allocated":3555328,"data_stored":1636164,"data_compressed":33468,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":0,"internal_metadata":59572224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.468801"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.606617+0000","last_change":"2020-11-20T11:48:09.603681+0000","last_active":"2020-11-20T11:48:09.606617+0000","last_peered":"2020-11-20T11:48:09.606617+0000","last_clean":"2020-11-20T11:48:09.606617+0000","last_became_active":"2020-11-20T11:48:09.603149+0000","last_became_peered":"2020-11-20T11:48:09.603149+0000","last_unstale":"2020-11-20T11:48:09.606617+0000","last_undegraded":"2020-11-20T11:48:09.606617+0000","last_fullsized":"2020-11-20T11:48:09.606617+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_clean_scrub_stamp":"2020-11-20T11:48:08.486179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4,7],"acting":[1,8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.493100+0000","last_change":"2020-11-20T11:48:03.440989+0000","last_active":"2020-11-20T11:48:09.493100+0000","last_peered":"2020-11-20T11:48:09.493100+0000","last_clean":"2020-11-20T11:48:09.493100+0000","last_became_active":"2020-11-20T11:48:03.440545+0000","last_became_peered":"2020-11-20T11:48:03.440545+0000","last_unstale":"2020-11-20T11:48:09.493100+0000","last_undegraded":"2020-11-20T11:48:09.493100+0000","last_fullsized":"2020-11-20T11:48:09.493100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_clean_scrub_stamp":"2020-11-20T11:48:02.343998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10],"acting":[9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"28'6","reported_seq":"17","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:48:09.854506+0000","last_change":"2020-11-20T11:48:06.484654+0000","last_active":"2020-11-20T11:48:09.854506+0000","last_peered":"2020-11-20T11:48:09.854506+0000","last_clean":"2020-11-20T11:48:09.854506+0000","last_became_active":"2020-11-20T11:48:06.484261+0000","last_became_peered":"2020-11-20T11:48:06.484261+0000","last_unstale":"2020-11-20T11:48:09.854506+0000","last_undegraded":"2020-11-20T11:48:09.854506+0000","last_fullsized":"2020-11-20T11:48:09.854506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_clean_scrub_stamp":"2020-11-20T11:48:05.473687+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.606264+0000","last_change":"2020-11-20T11:48:09.601081+0000","last_active":"2020-11-20T11:48:09.606264+0000","last_peered":"2020-11-20T11:48:09.606264+0000","last_clean":"2020-11-20T11:48:09.606264+0000","last_became_active":"2020-11-20T11:48:09.600693+0000","last_became_peered":"2020-11-20T11:48:09.600693+0000","last_unstale":"2020-11-20T11:48:09.606264+0000","last_undegraded":"2020-11-20T11:48:09.606264+0000","last_fullsized":"2020-11-20T11:48:09.606264+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_clean_scrub_stamp":"2020-11-20T11:48:08.486179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,8,10],"acting":[6,0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.495347+0000","last_change":"2020-11-20T11:48:03.364301+0000","last_active":"2020-11-20T11:48:09.495347+0000","last_peered":"2020-11-20T11:48:09.495347+0000","last_clean":"2020-11-20T11:48:09.495347+0000","last_became_active":"2020-11-20T11:48:03.364003+0000","last_became_peered":"2020-11-20T11:48:03.364003+0000","last_unstale":"2020-11-20T11:48:09.495347+0000","last_undegraded":"2020-11-20T11:48:09.495347+0000","last_fullsized":"2020-11-20T11:48:09.495347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_clean_scrub_stamp":"2020-11-20T11:48:02.343998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"28'5","reported_seq":"16","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:48:09.854298+0000","last_change":"2020-11-20T11:48:06.628946+0000","last_active":"2020-11-20T11:48:09.854298+0000","last_peered":"2020-11-20T11:48:09.854298+0000","last_clean":"2020-11-20T11:48:09.854298+0000","last_became_active":"2020-11-20T11:48:06.628670+0000","last_became_peered":"2020-11-20T11:48:06.628670+0000","last_unstale":"2020-11-20T11:48:09.854298+0000","last_undegraded":"2020-11-20T11:48:09.854298+0000","last_fullsized":"2020-11-20T11:48:09.854298+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_clean_scrub_stamp":"2020-11-20T11:48:05.473687+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.603374+0000","last_change":"2020-11-20T11:48:09.598612+0000","last_active":"2020-11-20T11:48:09.603374+0000","last_peered":"2020-11-20T11:48:09.603374+0000","last_clean":"2020-11-20T11:48:09.603374+0000","last_became_active":"2020-11-20T11:48:09.598147+0000","last_became_peered":"2020-11-20T11:48:09.598147+0000","last_unstale":"2020-11-20T11:48:09.603374+0000","last_undegraded":"2020-11-20T11:48:09.603374+0000","last_fullsized":"2020-11-20T11:48:09.603374+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_clean_scrub_stamp":"2020-11-20T11:48:08.486179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5,0],"acting":[6,1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.492302+0000","last_change":"2020-11-20T11:48:03.436692+0000","last_active":"2020-11-20T11:48:09.492302+0000","last_peered":"2020-11-20T11:48:09.492302+0000","last_clean":"2020-11-20T11:48:09.492302+0000","last_became_active":"2020-11-20T11:48:03.436251+0000","last_became_peered":"2020-11-20T11:48:03.436251+0000","last_unstale":"2020-11-20T11:48:09.492302+0000","last_undegraded":"2020-11-20T11:48:09.492302+0000","last_fullsized":"2020-11-20T11:48:09.492302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_clean_scrub_stamp":"2020-11-20T11:48:02.343998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"28'8","reported_seq":"20","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:48:09.847822+0000","last_change":"2020-11-20T11:48:06.645759+0000","last_active":"2020-11-20T11:48:09.847822+0000","last_peered":"2020-11-20T11:48:09.847822+0000","last_clean":"2020-11-20T11:48:09.847822+0000","last_became_active":"2020-11-20T11:48:06.645318+0000","last_became_peered":"2020-11-20T11:48:06.645318+0000","last_unstale":"2020-11-20T11:48:09.847822+0000","last_undegraded":"2020-11-20T11:48:09.847822+0000","last_fullsized":"2020-11-20T11:48:09.847822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_clean_scrub_stamp":"2020-11-20T11:48:05.473687+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.601841+0000","last_change":"2020-11-20T11:48:09.600841+0000","last_active":"2020-11-20T11:48:09.601841+0000","last_peered":"2020-11-20T11:48:09.601841+0000","last_clean":"2020-11-20T11:48:09.601841+0000","last_became_active":"2020-11-20T11:48:09.600181+0000","last_became_peered":"2020-11-20T11:48:09.600181+0000","last_unstale":"2020-11-20T11:48:09.601841+0000","last_undegraded":"2020-11-20T11:48:09.601841+0000","last_fullsized":"2020-11-20T11:48:09.601841+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_clean_scrub_stamp":"2020-11-20T11:48:08.486179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,4,11],"acting":[5,10,4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.598292+0000","last_change":"2020-11-20T11:48:03.361972+0000","last_active":"2020-11-20T11:48:09.598292+0000","last_peered":"2020-11-20T11:48:09.598292+0000","last_clean":"2020-11-20T11:48:09.598292+0000","last_became_active":"2020-11-20T11:48:03.361549+0000","last_became_peered":"2020-11-20T11:48:03.361549+0000","last_unstale":"2020-11-20T11:48:09.598292+0000","last_undegraded":"2020-11-20T11:48:09.598292+0000","last_fullsized":"2020-11-20T11:48:09.598292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_clean_scrub_stamp":"2020-11-20T11:48:02.343998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"1.0","version":"18'3","reported_seq":"21","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.597862+0000","last_change":"2020-11-20T11:47:58.639760+0000","last_active":"2020-11-20T11:48:09.597862+0000","last_peered":"2020-11-20T11:48:09.597862+0000","last_clean":"2020-11-20T11:48:09.597862+0000","last_became_active":"2020-11-20T11:47:58.639096+0000","last_became_peered":"2020-11-20T11:47:58.639096+0000","last_unstale":"2020-11-20T11:48:09.597862+0000","last_undegraded":"2020-11-20T11:48:09.597862+0000","last_fullsized":"2020-11-20T11:48:09.597862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:47:52.386743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:47:52.386743+0000","last_clean_scrub_stamp":"2020-11-20T11:47:52.386743+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"28'1","reported_seq":"12","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:48:09.846476+0000","last_change":"2020-11-20T11:48:06.725267+0000","last_active":"2020-11-20T11:48:09.846476+0000","last_peered":"2020-11-20T11:48:09.846476+0000","last_clean":"2020-11-20T11:48:09.846476+0000","last_became_active":"2020-11-20T11:48:06.724982+0000","last_became_peered":"2020-11-20T11:48:06.724982+0000","last_unstale":"2020-11-20T11:48:09.846476+0000","last_undegraded":"2020-11-20T11:48:09.846476+0000","last_fullsized":"2020-11-20T11:48:09.846476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_clean_scrub_stamp":"2020-11-20T11:48:05.473687+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.602037+0000","last_change":"2020-11-20T11:48:09.600385+0000","last_active":"2020-11-20T11:48:09.602037+0000","last_peered":"2020-11-20T11:48:09.602037+0000","last_clean":"2020-11-20T11:48:09.602037+0000","last_became_active":"2020-11-20T11:48:09.599710+0000","last_became_peered":"2020-11-20T11:48:09.599710+0000","last_unstale":"2020-11-20T11:48:09.602037+0000","last_undegraded":"2020-11-20T11:48:09.602037+0000","last_fullsized":"2020-11-20T11:48:09.602037+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_clean_scrub_stamp":"2020-11-20T11:48:08.486179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6,11],"acting":[10,9,6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.597758+0000","last_change":"2020-11-20T11:48:03.438147+0000","last_active":"2020-11-20T11:48:09.597758+0000","last_peered":"2020-11-20T11:48:09.597758+0000","last_clean":"2020-11-20T11:48:09.597758+0000","last_became_active":"2020-11-20T11:48:03.437759+0000","last_became_peered":"2020-11-20T11:48:03.437759+0000","last_unstale":"2020-11-20T11:48:09.597758+0000","last_undegraded":"2020-11-20T11:48:09.597758+0000","last_fullsized":"2020-11-20T11:48:09.597758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_clean_scrub_stamp":"2020-11-20T11:48:02.343998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"12","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.492207+0000","last_change":"2020-11-20T11:48:06.485245+0000","last_active":"2020-11-20T11:48:09.492207+0000","last_peered":"2020-11-20T11:48:09.492207+0000","last_clean":"2020-11-20T11:48:09.492207+0000","last_became_active":"2020-11-20T11:48:06.484857+0000","last_became_peered":"2020-11-20T11:48:06.484857+0000","last_unstale":"2020-11-20T11:48:09.492207+0000","last_undegraded":"2020-11-20T11:48:09.492207+0000","last_fullsized":"2020-11-20T11:48:09.492207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_clean_scrub_stamp":"2020-11-20T11:48:05.473687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.602646+0000","last_change":"2020-11-20T11:48:09.601300+0000","last_active":"2020-11-20T11:48:09.602646+0000","last_peered":"2020-11-20T11:48:09.602646+0000","last_clean":"2020-11-20T11:48:09.602646+0000","last_became_active":"2020-11-20T11:48:09.599735+0000","last_became_peered":"2020-11-20T11:48:09.599735+0000","last_unstale":"2020-11-20T11:48:09.602646+0000","last_undegraded":"2020-11-20T11:48:09.602646+0000","last_fullsized":"2020-11-20T11:48:09.602646+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_clean_scrub_stamp":"2020-11-20T11:48:08.486179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,11,6],"acting":[1,4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.596913+0000","last_change":"2020-11-20T11:48:03.435827+0000","last_active":"2020-11-20T11:48:09.596913+0000","last_peered":"2020-11-20T11:48:09.596913+0000","last_clean":"2020-11-20T11:48:09.596913+0000","last_became_active":"2020-11-20T11:48:03.435438+0000","last_became_peered":"2020-11-20T11:48:03.435438+0000","last_unstale":"2020-11-20T11:48:09.596913+0000","last_undegraded":"2020-11-20T11:48:09.596913+0000","last_fullsized":"2020-11-20T11:48:09.596913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_clean_scrub_stamp":"2020-11-20T11:48:02.343998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"28'8","reported_seq":"20","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:48:09.850421+0000","last_change":"2020-11-20T11:48:06.484739+0000","last_active":"2020-11-20T11:48:09.850421+0000","last_peered":"2020-11-20T11:48:09.850421+0000","last_clean":"2020-11-20T11:48:09.850421+0000","last_became_active":"2020-11-20T11:48:06.484250+0000","last_became_peered":"2020-11-20T11:48:06.484250+0000","last_unstale":"2020-11-20T11:48:09.850421+0000","last_undegraded":"2020-11-20T11:48:09.850421+0000","last_fullsized":"2020-11-20T11:48:09.850421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_clean_scrub_stamp":"2020-11-20T11:48:05.473687+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.600830+0000","last_change":"2020-11-20T11:48:09.599059+0000","last_active":"2020-11-20T11:48:09.600830+0000","last_peered":"2020-11-20T11:48:09.600830+0000","last_clean":"2020-11-20T11:48:09.600830+0000","last_became_active":"2020-11-20T11:48:09.598112+0000","last_became_peered":"2020-11-20T11:48:09.598112+0000","last_unstale":"2020-11-20T11:48:09.600830+0000","last_undegraded":"2020-11-20T11:48:09.600830+0000","last_fullsized":"2020-11-20T11:48:09.600830+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_clean_scrub_stamp":"2020-11-20T11:48:08.486179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"28'6","reported_seq":"17","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:48:09.855332+0000","last_change":"2020-11-20T11:48:06.645335+0000","last_active":"2020-11-20T11:48:09.855332+0000","last_peered":"2020-11-20T11:48:09.855332+0000","last_clean":"2020-11-20T11:48:09.855332+0000","last_became_active":"2020-11-20T11:48:06.644950+0000","last_became_peered":"2020-11-20T11:48:06.644950+0000","last_unstale":"2020-11-20T11:48:09.855332+0000","last_undegraded":"2020-11-20T11:48:09.855332+0000","last_fullsized":"2020-11-20T11:48:09.855332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_clean_scrub_stamp":"2020-11-20T11:48:05.473687+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.493229+0000","last_change":"2020-11-20T11:48:03.441004+0000","last_active":"2020-11-20T11:48:09.493229+0000","last_peered":"2020-11-20T11:48:09.493229+0000","last_clean":"2020-11-20T11:48:09.493229+0000","last_became_active":"2020-11-20T11:48:03.440579+0000","last_became_peered":"2020-11-20T11:48:03.440579+0000","last_unstale":"2020-11-20T11:48:09.493229+0000","last_undegraded":"2020-11-20T11:48:09.493229+0000","last_fullsized":"2020-11-20T11:48:09.493229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_clean_scrub_stamp":"2020-11-20T11:48:02.343998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10],"acting":[9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.625936+0000","last_change":"2020-11-20T11:48:09.625378+0000","last_active":"2020-11-20T11:48:09.625936+0000","last_peered":"2020-11-20T11:48:09.625936+0000","last_clean":"2020-11-20T11:48:09.625936+0000","last_became_active":"2020-11-20T11:48:09.624778+0000","last_became_peered":"2020-11-20T11:48:09.624778+0000","last_unstale":"2020-11-20T11:48:09.625936+0000","last_undegraded":"2020-11-20T11:48:09.625936+0000","last_fullsized":"2020-11-20T11:48:09.625936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_clean_scrub_stamp":"2020-11-20T11:48:08.486179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,11,8],"acting":[4,2,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.597648+0000","last_change":"2020-11-20T11:48:03.359921+0000","last_active":"2020-11-20T11:48:09.597648+0000","last_peered":"2020-11-20T11:48:09.597648+0000","last_clean":"2020-11-20T11:48:09.597648+0000","last_became_active":"2020-11-20T11:48:03.359617+0000","last_became_peered":"2020-11-20T11:48:03.359617+0000","last_unstale":"2020-11-20T11:48:09.597648+0000","last_undegraded":"2020-11-20T11:48:09.597648+0000","last_fullsized":"2020-11-20T11:48:09.597648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_clean_scrub_stamp":"2020-11-20T11:48:02.343998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.6","version":"28'4","reported_seq":"15","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:48:09.850116+0000","last_change":"2020-11-20T11:48:06.484350+0000","last_active":"2020-11-20T11:48:09.850116+0000","last_peered":"2020-11-20T11:48:09.850116+0000","last_clean":"2020-11-20T11:48:09.850116+0000","last_became_active":"2020-11-20T11:48:06.483910+0000","last_became_peered":"2020-11-20T11:48:06.483910+0000","last_unstale":"2020-11-20T11:48:09.850116+0000","last_undegraded":"2020-11-20T11:48:09.850116+0000","last_fullsized":"2020-11-20T11:48:09.850116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_clean_scrub_stamp":"2020-11-20T11:48:05.473687+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":12},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":9},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":10}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444038,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":135997,"data_compressed":2789,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.577}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2889999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.494}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.764}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6579999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.74}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9219999999999999}]}]},{"osd":10,"up_from":17,"seq":73014444039,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5092,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366748,"statfs":{"total":96636764160,"available":96631549952,"internally_reserved":0,"allocated":290816,"data_stored":135963,"data_compressed":2789,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2929999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.49}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.528}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6319999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.706}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.919}]}]},{"osd":9,"up_from":17,"seq":73014444038,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5156,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366684,"statfs":{"total":96636764160,"available":96631484416,"internally_reserved":0,"allocated":290816,"data_stored":135963,"data_compressed":2789,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,6,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5660000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3660000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.732}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4770000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.49}]}]},{"osd":8,"up_from":17,"seq":73014444039,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":135997,"data_compressed":2789,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.488}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6859999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.655}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]}]},{"osd":7,"up_from":17,"seq":73014444039,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5164,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366676,"statfs":{"total":96636764160,"available":96631476224,"internally_reserved":0,"allocated":299008,"data_stored":136538,"data_compressed":2789,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3859999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.667}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6499999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8140000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0470000000000002}]}]},{"osd":6,"up_from":17,"seq":73014444039,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5168,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366672,"statfs":{"total":96636764160,"available":96631472128,"internally_reserved":0,"allocated":303104,"data_stored":137498,"data_compressed":2789,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3480000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.377}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]}]},{"osd":1,"up_from":17,"seq":73014444038,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5168,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366672,"statfs":{"total":96636764160,"available":96631472128,"internally_reserved":0,"allocated":303104,"data_stored":137498,"data_compressed":2789,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5069999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6419999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.617}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.748}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.871}]}]},{"osd":0,"up_from":17,"seq":73014444038,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5156,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366684,"statfs":{"total":96636764160,"available":96631484416,"internally_reserved":0,"allocated":290816,"data_stored":135963,"data_compressed":2789,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3560000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.214}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4490000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7210000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.411}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.482}]}]},{"osd":2,"up_from":17,"seq":73014444038,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5092,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366748,"statfs":{"total":96636764160,"available":96631549952,"internally_reserved":0,"allocated":290816,"data_stored":135963,"data_compressed":2789,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5720000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0389999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7230000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5029999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.611}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.016}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.635}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9099999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7709999999999999}]}]},{"osd":3,"up_from":17,"seq":73014444039,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5172,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366668,"statfs":{"total":96636764160,"available":96631468032,"internally_reserved":0,"allocated":307200,"data_stored":136698,"data_compressed":2789,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3380000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3560000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.73}]}]},{"osd":4,"up_from":17,"seq":73014444039,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5092,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366748,"statfs":{"total":96636764160,"available":96631549952,"internally_reserved":0,"allocated":290816,"data_stored":135963,"data_compressed":2789,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3740000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7110000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.78}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.573}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6200000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9099999999999999}]}]},{"osd":5,"up_from":17,"seq":73014444040,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5164,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366676,"statfs":{"total":96636764160,"available":96631476224,"internally_reserved":0,"allocated":299008,"data_stored":136123,"data_compressed":2789,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3680000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6379999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.415}]}]}]}} 2020-11-20T11:48:21.400 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-20T11:48:21.508 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.505+0000 7f073ee51700 1 Processor -- start 2020-11-20T11:48:21.509 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.505+0000 7f073ee51700 1 -- start start 2020-11-20T11:48:21.512 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.506+0000 7f073ee51700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0738060750 0x7f0738064c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:21.512 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.506+0000 7f073ee51700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0738065130 con 0x7f0738154920 2020-11-20T11:48:21.512 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.506+0000 7f073ee51700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0738151e80 con 0x7f0738060370 2020-11-20T11:48:21.513 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.506+0000 7f073ee51700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0738152120 con 0x7f0738060750 2020-11-20T11:48:21.513 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.506+0000 7f073cbed700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f0738060370 0x7f07380c2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52086/0 (socket says 172.21.15.192:52086) 2020-11-20T11:48:21.513 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.506+0000 7f073cbed700 1 -- 172.21.15.192:0/148194533 learned_addr learned my addr 172.21.15.192:0/148194533 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:21.513 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.506+0000 7f073d3ee700 1 --2- 172.21.15.192:0/148194533 >> v2:172.21.15.87:3300/0 conn(0x7f0738060750 0x7f0738064c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:21.514 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.506+0000 7f07377fe700 1 -- 172.21.15.192:0/148194533 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1089427766 0 0) 0x7f0738151e80 con 0x7f0738060370 2020-11-20T11:48:21.514 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.506+0000 7f07377fe700 1 -- 172.21.15.192:0/148194533 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f071c003280 con 0x7f0738060370 2020-11-20T11:48:21.514 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.507+0000 7f07377fe700 1 -- 172.21.15.192:0/148194533 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 101887904 0 0) 0x7f0738065130 con 0x7f0738154920 2020-11-20T11:48:21.514 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.507+0000 7f07377fe700 1 -- 172.21.15.192:0/148194533 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0738151e80 con 0x7f0738154920 2020-11-20T11:48:21.514 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.507+0000 7f07377fe700 1 -- 172.21.15.192:0/148194533 <== mon.2 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1104667292 0 0) 0x7f071c003280 con 0x7f0738060370 2020-11-20T11:48:21.515 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.507+0000 7f07377fe700 1 -- 172.21.15.192:0/148194533 >> v2:172.21.15.87:3300/0 conn(0x7f0738060750 msgr2=0x7f0738064c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:21.515 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.507+0000 7f07377fe700 1 --2- 172.21.15.192:0/148194533 >> v2:172.21.15.87:3300/0 conn(0x7f0738060750 0x7f0738064c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:21.515 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.507+0000 7f07377fe700 1 -- 172.21.15.192:0/148194533 >> v1:172.21.15.146:6789/0 conn(0x7f0738154920 legacy=0x7f0738151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:21.515 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.507+0000 7f07377fe700 1 -- 172.21.15.192:0/148194533 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0738064260 con 0x7f0738060370 2020-11-20T11:48:21.515 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.507+0000 7f07377fe700 1 -- 172.21.15.192:0/148194533 <== mon.2 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3985397220 0 0) 0x7f072c001520 con 0x7f0738060370 2020-11-20T11:48:21.516 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.507+0000 7f07377fe700 1 -- 172.21.15.192:0/148194533 >> v1:172.21.15.192:6789/0 conn(0x7f0738060370 legacy=0x7f07380c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:21.516 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.507+0000 7f07377fe700 1 --2- 172.21.15.192:0/148194533 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f071c003950 0x7f071c003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:21.516 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.507+0000 7f07377fe700 1 --2- 172.21.15.192:0/148194533 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f071c004520 0x7f071c0049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:21.516 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.507+0000 7f07377fe700 1 --2- 172.21.15.192:0/148194533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f071c004e90 0x7f071c00b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:21.517 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.507+0000 7f07377fe700 1 -- 172.21.15.192:0/148194533 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0738152120 con 0x7f071c004520 2020-11-20T11:48:21.517 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.507+0000 7f07377fe700 1 -- 172.21.15.192:0/148194533 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071c00bc60 con 0x7f071c004e90 2020-11-20T11:48:21.518 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.507+0000 7f07377fe700 1 -- 172.21.15.192:0/148194533 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071c00bda0 con 0x7f071c003950 2020-11-20T11:48:21.518 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.507+0000 7f073cbed700 1 --2- 172.21.15.192:0/148194533 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f071c003950 0x7f071c003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:21.518 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.507+0000 7f0737fff700 1 --2- 172.21.15.192:0/148194533 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f071c004520 0x7f071c0049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:21.518 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.507+0000 7f073d3ee700 1 --2- 172.21.15.192:0/148194533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f071c004e90 0x7f071c00b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:21.518 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.507+0000 7f073cbed700 1 -- 172.21.15.192:0/148194533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f071c004e90 msgr2=0x7f071c00b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:21.519 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.507+0000 7f073cbed700 1 --2- 172.21.15.192:0/148194533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f071c004e90 0x7f071c00b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:21.519 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.507+0000 7f073cbed700 1 -- 172.21.15.192:0/148194533 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f071c004520 msgr2=0x7f071c0049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:21.519 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.507+0000 7f073cbed700 1 --2- 172.21.15.192:0/148194533 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f071c004520 0x7f071c0049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:21.519 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.507+0000 7f073cbed700 1 -- 172.21.15.192:0/148194533 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071c003280 con 0x7f071c003950 2020-11-20T11:48:21.520 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.507+0000 7f073d3ee700 1 -- 172.21.15.192:0/148194533 reap_dead start 2020-11-20T11:48:21.520 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.507+0000 7f073cbed700 1 --2- 172.21.15.192:0/148194533 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f071c003950 0x7f071c003d50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f072c00c420 tx=0x7f0738152010).ready entity=mon.2 client_cookie=c087586be961e78c server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:21.520 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.507+0000 7f07377fe700 1 -- 172.21.15.192:0/148194533 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072c0070d0 con 0x7f071c003950 2020-11-20T11:48:21.520 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.507+0000 7f07377fe700 1 -- 172.21.15.192:0/148194533 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072c007230 con 0x7f071c003950 2020-11-20T11:48:21.520 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.507+0000 7f07377fe700 1 -- 172.21.15.192:0/148194533 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072c005630 con 0x7f071c003950 2020-11-20T11:48:21.521 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.508+0000 7f073ee51700 1 -- 172.21.15.192:0/148194533 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f071c003950 msgr2=0x7f071c003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:21.521 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.508+0000 7f073ee51700 1 --2- 172.21.15.192:0/148194533 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f071c003950 0x7f071c003d50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f072c00c420 tx=0x7f0738152010).stop 2020-11-20T11:48:21.521 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.508+0000 7f073ee51700 1 -- 172.21.15.192:0/148194533 shutdown_connections 2020-11-20T11:48:21.521 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.508+0000 7f073ee51700 1 --2- 172.21.15.192:0/148194533 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f071c003950 0x7f071c003d50 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:21.521 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.508+0000 7f073ee51700 1 -- 172.21.15.192:0/148194533 >> 172.21.15.192:0/148194533 conn(0x7f0738062100 msgr2=0x7f07380c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:21.522 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.508+0000 7f073ee51700 1 -- 172.21.15.192:0/148194533 shutdown_connections 2020-11-20T11:48:21.522 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.508+0000 7f073ee51700 1 -- 172.21.15.192:0/148194533 wait complete. 2020-11-20T11:48:21.522 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.509+0000 7f073ee51700 1 Processor -- start 2020-11-20T11:48:21.522 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.509+0000 7f073ee51700 1 -- start start 2020-11-20T11:48:21.525 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.510+0000 7f073ee51700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f071c003950 0x7f07380c0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:21.525 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.510+0000 7f073ee51700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07381612f0 0x7f0738161b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:21.526 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.510+0000 7f073ee51700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07380c16a0 0x7f07380b1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:21.526 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.510+0000 7f073ee51700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07380bfab0 con 0x7f07381612f0 2020-11-20T11:48:21.526 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.510+0000 7f073ee51700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07380bfd50 con 0x7f071c003950 2020-11-20T11:48:21.527 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.510+0000 7f073ee51700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07380bfff0 con 0x7f07380c16a0 2020-11-20T11:48:21.527 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.510+0000 7f073d3ee700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07380c16a0 0x7f07380b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:21.528 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.510+0000 7f073d3ee700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07380c16a0 0x7f07380b1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49434/0 (socket says 172.21.15.192:49434) 2020-11-20T11:48:21.528 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.510+0000 7f073d3ee700 1 -- 172.21.15.192:0/1609309481 learned_addr learned my addr 172.21.15.192:0/1609309481 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:21.528 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.510+0000 7f073cbed700 1 --2- 172.21.15.192:0/1609309481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f071c003950 0x7f07380c0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:21.529 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.510+0000 7f0737fff700 1 --2- 172.21.15.192:0/1609309481 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07381612f0 0x7f0738161b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:21.529 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.510+0000 7f073d3ee700 1 -- 172.21.15.192:0/1609309481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f071c003950 msgr2=0x7f07380c0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:21.529 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.510+0000 7f073d3ee700 1 --2- 172.21.15.192:0/1609309481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f071c003950 0x7f07380c0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:21.529 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.510+0000 7f073d3ee700 1 -- 172.21.15.192:0/1609309481 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07381612f0 msgr2=0x7f0738161b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:21.529 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.510+0000 7f073d3ee700 1 --2- 172.21.15.192:0/1609309481 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07381612f0 0x7f0738161b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:21.530 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.510+0000 7f073d3ee700 1 -- 172.21.15.192:0/1609309481 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07380c0290 con 0x7f07380c16a0 2020-11-20T11:48:21.530 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.510+0000 7f073cbed700 1 --2- 172.21.15.192:0/1609309481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f071c003950 0x7f07380c0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:48:21.530 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.510+0000 7f0737fff700 1 --2- 172.21.15.192:0/1609309481 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07381612f0 0x7f0738161b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:48:21.530 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.510+0000 7f073d3ee700 1 --2- 172.21.15.192:0/1609309481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07380c16a0 0x7f07380b1110 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f0730009160 tx=0x7f0730009220).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:21.530 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.511+0000 7f0734ff9700 1 -- 172.21.15.192:0/1609309481 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073000faf0 con 0x7f07380c16a0 2020-11-20T11:48:21.531 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.511+0000 7f0734ff9700 1 -- 172.21.15.192:0/1609309481 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073000fc50 con 0x7f07380c16a0 2020-11-20T11:48:21.531 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.511+0000 7f0734ff9700 1 -- 172.21.15.192:0/1609309481 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0730014440 con 0x7f07380c16a0 2020-11-20T11:48:21.531 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.511+0000 7f073ee51700 1 -- 172.21.15.192:0/1609309481 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07380c0530 con 0x7f07380c16a0 2020-11-20T11:48:21.531 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.511+0000 7f073ee51700 1 -- 172.21.15.192:0/1609309481 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07380bf700 con 0x7f07380c16a0 2020-11-20T11:48:21.531 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.511+0000 7f073ee51700 1 -- 172.21.15.192:0/1609309481 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07380699a0 con 0x7f07380c16a0 2020-11-20T11:48:21.532 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.512+0000 7f0734ff9700 1 -- 172.21.15.192:0/1609309481 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f0730014830 con 0x7f07380c16a0 2020-11-20T11:48:21.532 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.512+0000 7f0734ff9700 1 --2- 172.21.15.192:0/1609309481 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f0710080670 0x7f0710082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:21.532 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.513+0000 7f0734ff9700 1 -- 172.21.15.192:0/1609309481 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f07300a36d0 con 0x7f07380c16a0 2020-11-20T11:48:21.532 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.513+0000 7f073cbed700 1 --2- 172.21.15.192:0/1609309481 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f0710080670 0x7f0710082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:21.532 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.513+0000 7f073cbed700 1 --2- 172.21.15.192:0/1609309481 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f0710080670 0x7f0710082b30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f072c007900 tx=0x7f072c013000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:21.533 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.516+0000 7f0734ff9700 1 -- 172.21.15.192:0/1609309481 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f07300780e0 con 0x7f07380c16a0 2020-11-20T11:48:21.654 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.650+0000 7f073ee51700 1 -- 172.21.15.192:0/1609309481 --> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0738064440 con 0x7f0710080670 2020-11-20T11:48:21.658 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.654+0000 7f0734ff9700 1 -- 172.21.15.192:0/1609309481 <== mgr.4106 v2:172.21.15.192:6800/22925 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+100082 (secure 0 0 0) 0x7f0738064440 con 0x7f0710080670 2020-11-20T11:48:21.659 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:48:21.660 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.656+0000 7f073ee51700 1 -- 172.21.15.192:0/1609309481 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f0710080670 msgr2=0x7f0710082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:21.660 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.656+0000 7f073ee51700 1 --2- 172.21.15.192:0/1609309481 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f0710080670 0x7f0710082b30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f072c007900 tx=0x7f072c013000).stop 2020-11-20T11:48:21.661 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.656+0000 7f073ee51700 1 -- 172.21.15.192:0/1609309481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07380c16a0 msgr2=0x7f07380b1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:21.661 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.656+0000 7f073ee51700 1 --2- 172.21.15.192:0/1609309481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07380c16a0 0x7f07380b1110 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f0730009160 tx=0x7f0730009220).stop 2020-11-20T11:48:21.661 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.656+0000 7f073ee51700 1 -- 172.21.15.192:0/1609309481 shutdown_connections 2020-11-20T11:48:21.661 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.656+0000 7f073ee51700 1 --2- 172.21.15.192:0/1609309481 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f0710080670 0x7f0710082b30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:21.661 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.656+0000 7f073ee51700 1 --2- 172.21.15.192:0/1609309481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07380c16a0 0x7f07380b1110 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:21.662 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.656+0000 7f073ee51700 1 --2- 172.21.15.192:0/1609309481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f071c003950 0x7f07380c0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:21.662 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.656+0000 7f073ee51700 1 --2- 172.21.15.192:0/1609309481 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f07381612f0 0x7f0738161b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:21.662 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.656+0000 7f073ee51700 1 -- 172.21.15.192:0/1609309481 >> 172.21.15.192:0/1609309481 conn(0x7f0738062100 msgr2=0x7f073814dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:21.662 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.656+0000 7f073ee51700 1 -- 172.21.15.192:0/1609309481 shutdown_connections 2020-11-20T11:48:21.663 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.656+0000 7f073ee51700 1 -- 172.21.15.192:0/1609309481 wait complete. 2020-11-20T11:48:21.663 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2020-11-20T11:48:21.670 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2020-11-20T11:48:20.303390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":61744,"kb_used_data":3472,"kb_used_omap":0,"kb_used_meta":58176,"kb_avail":1132400336,"statfs":{"total":1159641169920,"available":1159577944064,"internally_reserved":0,"allocated":3555328,"data_stored":1636164,"data_compressed":33468,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":0,"internal_metadata":59572224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.468801"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.606617+0000","last_change":"2020-11-20T11:48:09.603681+0000","last_active":"2020-11-20T11:48:09.606617+0000","last_peered":"2020-11-20T11:48:09.606617+0000","last_clean":"2020-11-20T11:48:09.606617+0000","last_became_active":"2020-11-20T11:48:09.603149+0000","last_became_peered":"2020-11-20T11:48:09.603149+0000","last_unstale":"2020-11-20T11:48:09.606617+0000","last_undegraded":"2020-11-20T11:48:09.606617+0000","last_fullsized":"2020-11-20T11:48:09.606617+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_clean_scrub_stamp":"2020-11-20T11:48:08.486179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4,7],"acting":[1,8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.493100+0000","last_change":"2020-11-20T11:48:03.440989+0000","last_active":"2020-11-20T11:48:09.493100+0000","last_peered":"2020-11-20T11:48:09.493100+0000","last_clean":"2020-11-20T11:48:09.493100+0000","last_became_active":"2020-11-20T11:48:03.440545+0000","last_became_peered":"2020-11-20T11:48:03.440545+0000","last_unstale":"2020-11-20T11:48:09.493100+0000","last_undegraded":"2020-11-20T11:48:09.493100+0000","last_fullsized":"2020-11-20T11:48:09.493100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_clean_scrub_stamp":"2020-11-20T11:48:02.343998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10],"acting":[9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"28'6","reported_seq":"17","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:48:09.854506+0000","last_change":"2020-11-20T11:48:06.484654+0000","last_active":"2020-11-20T11:48:09.854506+0000","last_peered":"2020-11-20T11:48:09.854506+0000","last_clean":"2020-11-20T11:48:09.854506+0000","last_became_active":"2020-11-20T11:48:06.484261+0000","last_became_peered":"2020-11-20T11:48:06.484261+0000","last_unstale":"2020-11-20T11:48:09.854506+0000","last_undegraded":"2020-11-20T11:48:09.854506+0000","last_fullsized":"2020-11-20T11:48:09.854506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_clean_scrub_stamp":"2020-11-20T11:48:05.473687+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.606264+0000","last_change":"2020-11-20T11:48:09.601081+0000","last_active":"2020-11-20T11:48:09.606264+0000","last_peered":"2020-11-20T11:48:09.606264+0000","last_clean":"2020-11-20T11:48:09.606264+0000","last_became_active":"2020-11-20T11:48:09.600693+0000","last_became_peered":"2020-11-20T11:48:09.600693+0000","last_unstale":"2020-11-20T11:48:09.606264+0000","last_undegraded":"2020-11-20T11:48:09.606264+0000","last_fullsized":"2020-11-20T11:48:09.606264+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_clean_scrub_stamp":"2020-11-20T11:48:08.486179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,8,10],"acting":[6,0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.495347+0000","last_change":"2020-11-20T11:48:03.364301+0000","last_active":"2020-11-20T11:48:09.495347+0000","last_peered":"2020-11-20T11:48:09.495347+0000","last_clean":"2020-11-20T11:48:09.495347+0000","last_became_active":"2020-11-20T11:48:03.364003+0000","last_became_peered":"2020-11-20T11:48:03.364003+0000","last_unstale":"2020-11-20T11:48:09.495347+0000","last_undegraded":"2020-11-20T11:48:09.495347+0000","last_fullsized":"2020-11-20T11:48:09.495347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_clean_scrub_stamp":"2020-11-20T11:48:02.343998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"28'5","reported_seq":"16","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:48:09.854298+0000","last_change":"2020-11-20T11:48:06.628946+0000","last_active":"2020-11-20T11:48:09.854298+0000","last_peered":"2020-11-20T11:48:09.854298+0000","last_clean":"2020-11-20T11:48:09.854298+0000","last_became_active":"2020-11-20T11:48:06.628670+0000","last_became_peered":"2020-11-20T11:48:06.628670+0000","last_unstale":"2020-11-20T11:48:09.854298+0000","last_undegraded":"2020-11-20T11:48:09.854298+0000","last_fullsized":"2020-11-20T11:48:09.854298+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_clean_scrub_stamp":"2020-11-20T11:48:05.473687+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.603374+0000","last_change":"2020-11-20T11:48:09.598612+0000","last_active":"2020-11-20T11:48:09.603374+0000","last_peered":"2020-11-20T11:48:09.603374+0000","last_clean":"2020-11-20T11:48:09.603374+0000","last_became_active":"2020-11-20T11:48:09.598147+0000","last_became_peered":"2020-11-20T11:48:09.598147+0000","last_unstale":"2020-11-20T11:48:09.603374+0000","last_undegraded":"2020-11-20T11:48:09.603374+0000","last_fullsized":"2020-11-20T11:48:09.603374+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_clean_scrub_stamp":"2020-11-20T11:48:08.486179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5,0],"acting":[6,1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.492302+0000","last_change":"2020-11-20T11:48:03.436692+0000","last_active":"2020-11-20T11:48:09.492302+0000","last_peered":"2020-11-20T11:48:09.492302+0000","last_clean":"2020-11-20T11:48:09.492302+0000","last_became_active":"2020-11-20T11:48:03.436251+0000","last_became_peered":"2020-11-20T11:48:03.436251+0000","last_unstale":"2020-11-20T11:48:09.492302+0000","last_undegraded":"2020-11-20T11:48:09.492302+0000","last_fullsized":"2020-11-20T11:48:09.492302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_clean_scrub_stamp":"2020-11-20T11:48:02.343998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"28'8","reported_seq":"20","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:48:09.847822+0000","last_change":"2020-11-20T11:48:06.645759+0000","last_active":"2020-11-20T11:48:09.847822+0000","last_peered":"2020-11-20T11:48:09.847822+0000","last_clean":"2020-11-20T11:48:09.847822+0000","last_became_active":"2020-11-20T11:48:06.645318+0000","last_became_peered":"2020-11-20T11:48:06.645318+0000","last_unstale":"2020-11-20T11:48:09.847822+0000","last_undegraded":"2020-11-20T11:48:09.847822+0000","last_fullsized":"2020-11-20T11:48:09.847822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_clean_scrub_stamp":"2020-11-20T11:48:05.473687+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.601841+0000","last_change":"2020-11-20T11:48:09.600841+0000","last_active":"2020-11-20T11:48:09.601841+0000","last_peered":"2020-11-20T11:48:09.601841+0000","last_clean":"2020-11-20T11:48:09.601841+0000","last_became_active":"2020-11-20T11:48:09.600181+0000","last_became_peered":"2020-11-20T11:48:09.600181+0000","last_unstale":"2020-11-20T11:48:09.601841+0000","last_undegraded":"2020-11-20T11:48:09.601841+0000","last_fullsized":"2020-11-20T11:48:09.601841+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_clean_scrub_stamp":"2020-11-20T11:48:08.486179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,4,11],"acting":[5,10,4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.598292+0000","last_change":"2020-11-20T11:48:03.361972+0000","last_active":"2020-11-20T11:48:09.598292+0000","last_peered":"2020-11-20T11:48:09.598292+0000","last_clean":"2020-11-20T11:48:09.598292+0000","last_became_active":"2020-11-20T11:48:03.361549+0000","last_became_peered":"2020-11-20T11:48:03.361549+0000","last_unstale":"2020-11-20T11:48:09.598292+0000","last_undegraded":"2020-11-20T11:48:09.598292+0000","last_fullsized":"2020-11-20T11:48:09.598292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_clean_scrub_stamp":"2020-11-20T11:48:02.343998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"1.0","version":"18'3","reported_seq":"21","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.597862+0000","last_change":"2020-11-20T11:47:58.639760+0000","last_active":"2020-11-20T11:48:09.597862+0000","last_peered":"2020-11-20T11:48:09.597862+0000","last_clean":"2020-11-20T11:48:09.597862+0000","last_became_active":"2020-11-20T11:47:58.639096+0000","last_became_peered":"2020-11-20T11:47:58.639096+0000","last_unstale":"2020-11-20T11:48:09.597862+0000","last_undegraded":"2020-11-20T11:48:09.597862+0000","last_fullsized":"2020-11-20T11:48:09.597862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:47:52.386743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:47:52.386743+0000","last_clean_scrub_stamp":"2020-11-20T11:47:52.386743+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"28'1","reported_seq":"12","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:48:09.846476+0000","last_change":"2020-11-20T11:48:06.725267+0000","last_active":"2020-11-20T11:48:09.846476+0000","last_peered":"2020-11-20T11:48:09.846476+0000","last_clean":"2020-11-20T11:48:09.846476+0000","last_became_active":"2020-11-20T11:48:06.724982+0000","last_became_peered":"2020-11-20T11:48:06.724982+0000","last_unstale":"2020-11-20T11:48:09.846476+0000","last_undegraded":"2020-11-20T11:48:09.846476+0000","last_fullsized":"2020-11-20T11:48:09.846476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_clean_scrub_stamp":"2020-11-20T11:48:05.473687+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.602037+0000","last_change":"2020-11-20T11:48:09.600385+0000","last_active":"2020-11-20T11:48:09.602037+0000","last_peered":"2020-11-20T11:48:09.602037+0000","last_clean":"2020-11-20T11:48:09.602037+0000","last_became_active":"2020-11-20T11:48:09.599710+0000","last_became_peered":"2020-11-20T11:48:09.599710+0000","last_unstale":"2020-11-20T11:48:09.602037+0000","last_undegraded":"2020-11-20T11:48:09.602037+0000","last_fullsized":"2020-11-20T11:48:09.602037+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_clean_scrub_stamp":"2020-11-20T11:48:08.486179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6,11],"acting":[10,9,6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.597758+0000","last_change":"2020-11-20T11:48:03.438147+0000","last_active":"2020-11-20T11:48:09.597758+0000","last_peered":"2020-11-20T11:48:09.597758+0000","last_clean":"2020-11-20T11:48:09.597758+0000","last_became_active":"2020-11-20T11:48:03.437759+0000","last_became_peered":"2020-11-20T11:48:03.437759+0000","last_unstale":"2020-11-20T11:48:09.597758+0000","last_undegraded":"2020-11-20T11:48:09.597758+0000","last_fullsized":"2020-11-20T11:48:09.597758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_clean_scrub_stamp":"2020-11-20T11:48:02.343998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"12","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.492207+0000","last_change":"2020-11-20T11:48:06.485245+0000","last_active":"2020-11-20T11:48:09.492207+0000","last_peered":"2020-11-20T11:48:09.492207+0000","last_clean":"2020-11-20T11:48:09.492207+0000","last_became_active":"2020-11-20T11:48:06.484857+0000","last_became_peered":"2020-11-20T11:48:06.484857+0000","last_unstale":"2020-11-20T11:48:09.492207+0000","last_undegraded":"2020-11-20T11:48:09.492207+0000","last_fullsized":"2020-11-20T11:48:09.492207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_clean_scrub_stamp":"2020-11-20T11:48:05.473687+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.602646+0000","last_change":"2020-11-20T11:48:09.601300+0000","last_active":"2020-11-20T11:48:09.602646+0000","last_peered":"2020-11-20T11:48:09.602646+0000","last_clean":"2020-11-20T11:48:09.602646+0000","last_became_active":"2020-11-20T11:48:09.599735+0000","last_became_peered":"2020-11-20T11:48:09.599735+0000","last_unstale":"2020-11-20T11:48:09.602646+0000","last_undegraded":"2020-11-20T11:48:09.602646+0000","last_fullsized":"2020-11-20T11:48:09.602646+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_clean_scrub_stamp":"2020-11-20T11:48:08.486179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,11,6],"acting":[1,4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.596913+0000","last_change":"2020-11-20T11:48:03.435827+0000","last_active":"2020-11-20T11:48:09.596913+0000","last_peered":"2020-11-20T11:48:09.596913+0000","last_clean":"2020-11-20T11:48:09.596913+0000","last_became_active":"2020-11-20T11:48:03.435438+0000","last_became_peered":"2020-11-20T11:48:03.435438+0000","last_unstale":"2020-11-20T11:48:09.596913+0000","last_undegraded":"2020-11-20T11:48:09.596913+0000","last_fullsized":"2020-11-20T11:48:09.596913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_clean_scrub_stamp":"2020-11-20T11:48:02.343998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"28'8","reported_seq":"20","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:48:09.850421+0000","last_change":"2020-11-20T11:48:06.484739+0000","last_active":"2020-11-20T11:48:09.850421+0000","last_peered":"2020-11-20T11:48:09.850421+0000","last_clean":"2020-11-20T11:48:09.850421+0000","last_became_active":"2020-11-20T11:48:06.484250+0000","last_became_peered":"2020-11-20T11:48:06.484250+0000","last_unstale":"2020-11-20T11:48:09.850421+0000","last_undegraded":"2020-11-20T11:48:09.850421+0000","last_fullsized":"2020-11-20T11:48:09.850421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_clean_scrub_stamp":"2020-11-20T11:48:05.473687+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.600830+0000","last_change":"2020-11-20T11:48:09.599059+0000","last_active":"2020-11-20T11:48:09.600830+0000","last_peered":"2020-11-20T11:48:09.600830+0000","last_clean":"2020-11-20T11:48:09.600830+0000","last_became_active":"2020-11-20T11:48:09.598112+0000","last_became_peered":"2020-11-20T11:48:09.598112+0000","last_unstale":"2020-11-20T11:48:09.600830+0000","last_undegraded":"2020-11-20T11:48:09.600830+0000","last_fullsized":"2020-11-20T11:48:09.600830+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_clean_scrub_stamp":"2020-11-20T11:48:08.486179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"28'6","reported_seq":"17","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:48:09.855332+0000","last_change":"2020-11-20T11:48:06.645335+0000","last_active":"2020-11-20T11:48:09.855332+0000","last_peered":"2020-11-20T11:48:09.855332+0000","last_clean":"2020-11-20T11:48:09.855332+0000","last_became_active":"2020-11-20T11:48:06.644950+0000","last_became_peered":"2020-11-20T11:48:06.644950+0000","last_unstale":"2020-11-20T11:48:09.855332+0000","last_undegraded":"2020-11-20T11:48:09.855332+0000","last_fullsized":"2020-11-20T11:48:09.855332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_clean_scrub_stamp":"2020-11-20T11:48:05.473687+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.493229+0000","last_change":"2020-11-20T11:48:03.441004+0000","last_active":"2020-11-20T11:48:09.493229+0000","last_peered":"2020-11-20T11:48:09.493229+0000","last_clean":"2020-11-20T11:48:09.493229+0000","last_became_active":"2020-11-20T11:48:03.440579+0000","last_became_peered":"2020-11-20T11:48:03.440579+0000","last_unstale":"2020-11-20T11:48:09.493229+0000","last_undegraded":"2020-11-20T11:48:09.493229+0000","last_fullsized":"2020-11-20T11:48:09.493229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_clean_scrub_stamp":"2020-11-20T11:48:02.343998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10],"acting":[9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.625936+0000","last_change":"2020-11-20T11:48:09.625378+0000","last_active":"2020-11-20T11:48:09.625936+0000","last_peered":"2020-11-20T11:48:09.625936+0000","last_clean":"2020-11-20T11:48:09.625936+0000","last_became_active":"2020-11-20T11:48:09.624778+0000","last_became_peered":"2020-11-20T11:48:09.624778+0000","last_unstale":"2020-11-20T11:48:09.625936+0000","last_undegraded":"2020-11-20T11:48:09.625936+0000","last_fullsized":"2020-11-20T11:48:09.625936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_clean_scrub_stamp":"2020-11-20T11:48:08.486179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,11,8],"acting":[4,2,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.597648+0000","last_change":"2020-11-20T11:48:03.359921+0000","last_active":"2020-11-20T11:48:09.597648+0000","last_peered":"2020-11-20T11:48:09.597648+0000","last_clean":"2020-11-20T11:48:09.597648+0000","last_became_active":"2020-11-20T11:48:03.359617+0000","last_became_peered":"2020-11-20T11:48:03.359617+0000","last_unstale":"2020-11-20T11:48:09.597648+0000","last_undegraded":"2020-11-20T11:48:09.597648+0000","last_fullsized":"2020-11-20T11:48:09.597648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_clean_scrub_stamp":"2020-11-20T11:48:02.343998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.6","version":"28'4","reported_seq":"15","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T11:48:09.850116+0000","last_change":"2020-11-20T11:48:06.484350+0000","last_active":"2020-11-20T11:48:09.850116+0000","last_peered":"2020-11-20T11:48:09.850116+0000","last_clean":"2020-11-20T11:48:09.850116+0000","last_became_active":"2020-11-20T11:48:06.483910+0000","last_became_peered":"2020-11-20T11:48:06.483910+0000","last_unstale":"2020-11-20T11:48:09.850116+0000","last_undegraded":"2020-11-20T11:48:09.850116+0000","last_fullsized":"2020-11-20T11:48:09.850116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_clean_scrub_stamp":"2020-11-20T11:48:05.473687+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":12},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":9},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":10}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444038,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":135997,"data_compressed":2789,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.577}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2889999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.494}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.764}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6579999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.74}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9219999999999999}]}]},{"osd":10,"up_from":17,"seq":73014444039,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5092,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366748,"statfs":{"total":96636764160,"available":96631549952,"internally_reserved":0,"allocated":290816,"data_stored":135963,"data_compressed":2789,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2929999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.49}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.528}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6319999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.706}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.919}]}]},{"osd":9,"up_from":17,"seq":73014444038,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5156,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366684,"statfs":{"total":96636764160,"available":96631484416,"internally_reserved":0,"allocated":290816,"data_stored":135963,"data_compressed":2789,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,6,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5660000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3660000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.732}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4770000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.49}]}]},{"osd":8,"up_from":17,"seq":73014444039,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":135997,"data_compressed":2789,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.488}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6859999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.655}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]}]},{"osd":7,"up_from":17,"seq":73014444039,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5164,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366676,"statfs":{"total":96636764160,"available":96631476224,"internally_reserved":0,"allocated":299008,"data_stored":136538,"data_compressed":2789,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3859999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.667}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6499999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8140000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0470000000000002}]}]},{"osd":6,"up_from":17,"seq":73014444039,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5168,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366672,"statfs":{"total":96636764160,"available":96631472128,"internally_reserved":0,"allocated":303104,"data_stored":137498,"data_compressed":2789,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3480000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.377}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]}]},{"osd":1,"up_from":17,"seq":73014444038,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5168,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366672,"statfs":{"total":96636764160,"available":96631472128,"internally_reserved":0,"allocated":303104,"data_stored":137498,"data_compressed":2789,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5069999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6419999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.617}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.748}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.871}]}]},{"osd":0,"up_from":17,"seq":73014444038,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5156,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366684,"statfs":{"total":96636764160,"available":96631484416,"internally_reserved":0,"allocated":290816,"data_stored":135963,"data_compressed":2789,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3560000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.214}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4490000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7210000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.411}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.482}]}]},{"osd":2,"up_from":17,"seq":73014444038,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5092,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366748,"statfs":{"total":96636764160,"available":96631549952,"internally_reserved":0,"allocated":290816,"data_stored":135963,"data_compressed":2789,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5720000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0389999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7230000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5029999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.611}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.016}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.635}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9099999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7709999999999999}]}]},{"osd":3,"up_from":17,"seq":73014444039,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5172,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366668,"statfs":{"total":96636764160,"available":96631468032,"internally_reserved":0,"allocated":307200,"data_stored":136698,"data_compressed":2789,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3380000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3560000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.73}]}]},{"osd":4,"up_from":17,"seq":73014444039,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5092,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366748,"statfs":{"total":96636764160,"available":96631549952,"internally_reserved":0,"allocated":290816,"data_stored":135963,"data_compressed":2789,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3740000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7110000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.78}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.573}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6200000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9099999999999999}]}]},{"osd":5,"up_from":17,"seq":73014444040,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5164,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366676,"statfs":{"total":96636764160,"available":96631476224,"internally_reserved":0,"allocated":299008,"data_stored":136123,"data_compressed":2789,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3680000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6379999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.415}]}]}]}} 2020-11-20T11:48:21.708 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-11-20T11:48:21.709 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-11-20T11:48:21.709 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-11-20T11:48:21.709 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-11-20T11:48:21.817 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.814+0000 7fc8dba8d700 1 Processor -- start 2020-11-20T11:48:21.818 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.814+0000 7fc8dba8d700 1 -- start start 2020-11-20T11:48:21.820 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.815+0000 7fc8dba8d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc8d4151b30 0x7fc8d41554b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:21.820 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.815+0000 7fc8dba8d700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d41520a0 con 0x7fc8d4060750 2020-11-20T11:48:21.820 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.815+0000 7fc8dba8d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d4065490 con 0x7fc8d4060370 2020-11-20T11:48:21.820 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.815+0000 7fc8dba8d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8d40635d0 con 0x7fc8d4151b30 2020-11-20T11:48:21.821 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.815+0000 7fc8da02a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc8d4151b30 0x7fc8d41554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:21.821 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.816+0000 7fc8da02a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc8d4151b30 0x7fc8d41554b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49442/0 (socket says 172.21.15.192:49442) 2020-11-20T11:48:21.821 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.816+0000 7fc8da02a700 1 -- 172.21.15.192:0/4145977578 learned_addr learned my addr 172.21.15.192:0/4145977578 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:21.821 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.816+0000 7fc8da02a700 1 -- 172.21.15.192:0/4145977578 >> v1:172.21.15.146:6789/0 conn(0x7fc8d4060370 legacy=0x7fc8d40bfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:21.822 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.816+0000 7fc8da02a700 1 -- 172.21.15.192:0/4145977578 >> v1:172.21.15.87:6789/0 conn(0x7fc8d4060750 legacy=0x7fc8d4150410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:21.822 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.816+0000 7fc8da02a700 1 -- 172.21.15.192:0/4145977578 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d4065730 con 0x7fc8d4151b30 2020-11-20T11:48:21.822 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.816+0000 7fc8da02a700 1 --2- 172.21.15.192:0/4145977578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8d4151b30 0x7fc8d41554b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fc8cc009d90 tx=0x7fc8cc0092d0).ready entity=mon.2 client_cookie=91c48ad1b5dd401 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:21.822 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.816+0000 7fc8d8827700 1 -- 172.21.15.192:0/4145977578 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc00bc40 con 0x7fc8d4151b30 2020-11-20T11:48:21.822 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.816+0000 7fc8d8827700 1 -- 172.21.15.192:0/4145977578 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8cc00bda0 con 0x7fc8d4151b30 2020-11-20T11:48:21.823 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.816+0000 7fc8d8827700 1 -- 172.21.15.192:0/4145977578 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc011610 con 0x7fc8d4151b30 2020-11-20T11:48:21.823 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.816+0000 7fc8dba8d700 1 -- 172.21.15.192:0/4145977578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8d4151b30 msgr2=0x7fc8d41554b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:21.823 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.816+0000 7fc8dba8d700 1 --2- 172.21.15.192:0/4145977578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8d4151b30 0x7fc8d41554b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fc8cc009d90 tx=0x7fc8cc0092d0).stop 2020-11-20T11:48:21.823 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.816+0000 7fc8dba8d700 1 -- 172.21.15.192:0/4145977578 shutdown_connections 2020-11-20T11:48:21.823 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.816+0000 7fc8dba8d700 1 --2- 172.21.15.192:0/4145977578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8d4151b30 0x7fc8d41554b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:21.824 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.816+0000 7fc8dba8d700 1 -- 172.21.15.192:0/4145977578 >> 172.21.15.192:0/4145977578 conn(0x7fc8d40c46a0 msgr2=0x7fc8d40c4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:21.824 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.817+0000 7fc8dba8d700 1 -- 172.21.15.192:0/4145977578 shutdown_connections 2020-11-20T11:48:21.824 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.817+0000 7fc8dba8d700 1 -- 172.21.15.192:0/4145977578 wait complete. 2020-11-20T11:48:21.827 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.818+0000 7fc8dba8d700 1 Processor -- start 2020-11-20T11:48:21.827 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.818+0000 7fc8dba8d700 1 -- start start 2020-11-20T11:48:21.827 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.818+0000 7fc8dba8d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8d4060370 0x7fc8d4154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:21.827 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.818+0000 7fc8dba8d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8d4060750 0x7fc8d41648f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:21.827 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.818+0000 7fc8dba8d700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8d4151b30 0x7fc8d40c0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:21.828 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.818+0000 7fc8dba8d700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d4113230 con 0x7fc8d4151b30 2020-11-20T11:48:21.828 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.818+0000 7fc8dba8d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d4164de0 con 0x7fc8d4060750 2020-11-20T11:48:21.828 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.818+0000 7fc8dba8d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d4113460 con 0x7fc8d4060370 2020-11-20T11:48:21.828 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.818+0000 7fc8d9829700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8d4060370 0x7fc8d4154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:21.829 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.818+0000 7fc8d9829700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8d4060370 0x7fc8d4154980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49446/0 (socket says 172.21.15.192:49446) 2020-11-20T11:48:21.829 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.818+0000 7fc8d9829700 1 -- 172.21.15.192:0/2944753149 learned_addr learned my addr 172.21.15.192:0/2944753149 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:21.829 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.819+0000 7fc8da02a700 1 --2- 172.21.15.192:0/2944753149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8d4151b30 0x7fc8d40c0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:21.829 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.819+0000 7fc8d9028700 1 --2- 172.21.15.192:0/2944753149 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8d4060750 0x7fc8d41648f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:21.829 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.819+0000 7fc8d9829700 1 -- 172.21.15.192:0/2944753149 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8d4060750 msgr2=0x7fc8d41648f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:21.830 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.819+0000 7fc8d9829700 1 --2- 172.21.15.192:0/2944753149 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8d4060750 0x7fc8d41648f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:21.830 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.819+0000 7fc8d9829700 1 -- 172.21.15.192:0/2944753149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8d4151b30 msgr2=0x7fc8d40c0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:21.830 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.819+0000 7fc8d9829700 1 --2- 172.21.15.192:0/2944753149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8d4151b30 0x7fc8d40c0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:21.830 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.819+0000 7fc8d9829700 1 -- 172.21.15.192:0/2944753149 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d4113700 con 0x7fc8d4060370 2020-11-20T11:48:21.830 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.819+0000 7fc8da02a700 1 --2- 172.21.15.192:0/2944753149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8d4151b30 0x7fc8d40c0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:48:21.831 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.819+0000 7fc8d9829700 1 --2- 172.21.15.192:0/2944753149 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8d4060370 0x7fc8d4154980 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fc8d000c760 tx=0x7fc8d0007c70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:21.831 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.819+0000 7fc8c1ffb700 1 -- 172.21.15.192:0/2944753149 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d0010510 con 0x7fc8d4060370 2020-11-20T11:48:21.831 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.819+0000 7fc8c1ffb700 1 -- 172.21.15.192:0/2944753149 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d0010690 con 0x7fc8d4060370 2020-11-20T11:48:21.831 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.819+0000 7fc8dba8d700 1 -- 172.21.15.192:0/2944753149 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8d4160c60 con 0x7fc8d4060370 2020-11-20T11:48:21.832 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.819+0000 7fc8c1ffb700 1 -- 172.21.15.192:0/2944753149 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d0010a50 con 0x7fc8d4060370 2020-11-20T11:48:21.832 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.819+0000 7fc8dba8d700 1 -- 172.21.15.192:0/2944753149 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8d41611a0 con 0x7fc8d4060370 2020-11-20T11:48:21.832 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.820+0000 7fc8dba8d700 1 -- 172.21.15.192:0/2944753149 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8d40699a0 con 0x7fc8d4060370 2020-11-20T11:48:21.832 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.820+0000 7fc8c1ffb700 1 -- 172.21.15.192:0/2944753149 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fc8d0010070 con 0x7fc8d4060370 2020-11-20T11:48:21.832 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.821+0000 7fc8c1ffb700 1 --2- 172.21.15.192:0/2944753149 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fc8ac0806a0 0x7fc8ac082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:21.832 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.821+0000 7fc8c1ffb700 1 -- 172.21.15.192:0/2944753149 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fc8d00a25d0 con 0x7fc8d4060370 2020-11-20T11:48:21.833 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.821+0000 7fc8d9028700 1 --2- 172.21.15.192:0/2944753149 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fc8ac0806a0 0x7fc8ac082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:21.833 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.821+0000 7fc8d9028700 1 --2- 172.21.15.192:0/2944753149 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fc8ac0806a0 0x7fc8ac082b60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fc8d4154f20 tx=0x7fc8c4009040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:21.834 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:21.825+0000 7fc8c1ffb700 1 -- 172.21.15.192:0/2944753149 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fc8d0074fd0 con 0x7fc8d4060370 2020-11-20T11:48:22.021 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.018+0000 7fc8dba8d700 1 -- 172.21.15.192:0/2944753149 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc8d4161330 con 0x7fc8d4060370 2020-11-20T11:48:22.021 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.018+0000 7fc8c1ffb700 1 -- 172.21.15.192:0/2944753149 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7fc8d007aa10 con 0x7fc8d4060370 2020-11-20T11:48:22.022 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:48:22.023 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.019+0000 7fc8dba8d700 1 -- 172.21.15.192:0/2944753149 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fc8ac0806a0 msgr2=0x7fc8ac082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:22.023 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.019+0000 7fc8dba8d700 1 --2- 172.21.15.192:0/2944753149 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fc8ac0806a0 0x7fc8ac082b60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fc8d4154f20 tx=0x7fc8c4009040).stop 2020-11-20T11:48:22.023 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.019+0000 7fc8dba8d700 1 -- 172.21.15.192:0/2944753149 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8d4060370 msgr2=0x7fc8d4154980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:22.024 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.019+0000 7fc8dba8d700 1 --2- 172.21.15.192:0/2944753149 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8d4060370 0x7fc8d4154980 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fc8d000c760 tx=0x7fc8d0007c70).stop 2020-11-20T11:48:22.024 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.019+0000 7fc8dba8d700 1 -- 172.21.15.192:0/2944753149 shutdown_connections 2020-11-20T11:48:22.024 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.019+0000 7fc8dba8d700 1 --2- 172.21.15.192:0/2944753149 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fc8ac0806a0 0x7fc8ac082b60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:22.024 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.019+0000 7fc8dba8d700 1 --2- 172.21.15.192:0/2944753149 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8d4151b30 0x7fc8d40c0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:22.024 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.019+0000 7fc8dba8d700 1 --2- 172.21.15.192:0/2944753149 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8d4060370 0x7fc8d4154980 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:22.025 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.019+0000 7fc8dba8d700 1 --2- 172.21.15.192:0/2944753149 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8d4060750 0x7fc8d41648f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:22.025 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.019+0000 7fc8dba8d700 1 -- 172.21.15.192:0/2944753149 >> 172.21.15.192:0/2944753149 conn(0x7fc8d40c46a0 msgr2=0x7fc8d40c3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:22.025 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.019+0000 7fc8dba8d700 1 -- 172.21.15.192:0/2944753149 shutdown_connections 2020-11-20T11:48:22.025 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.020+0000 7fc8dba8d700 1 -- 172.21.15.192:0/2944753149 wait complete. 2020-11-20T11:48:22.034 INFO:teuthology.orchestra.run.smithi192.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-11-20T11:48:22.034 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2020-11-20T11:48:22.035 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:48:22.144 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.140+0000 7f6d8c8fe700 1 Processor -- start 2020-11-20T11:48:22.144 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.141+0000 7f6d8c8fe700 1 -- start start 2020-11-20T11:48:22.150 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.141+0000 7f6d8c8fe700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d8814dc50 con 0x7f6d88060750 2020-11-20T11:48:22.150 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.141+0000 7f6d8c8fe700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d8814def0 con 0x7f6d88060370 2020-11-20T11:48:22.150 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.141+0000 7f6d8c8fe700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d8814e190 con 0x7f6d881519d0 2020-11-20T11:48:22.150 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.141+0000 7f6d7ffff700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f6d881519d0 0x7f6d880bce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52120/0 (socket says 172.21.15.192:52120) 2020-11-20T11:48:22.151 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.141+0000 7f6d7ffff700 1 -- 172.21.15.192:0/4235381729 learned_addr learned my addr 172.21.15.192:0/4235381729 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:22.151 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.142+0000 7f6d85d9b700 1 -- 172.21.15.192:0/4235381729 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 24404733 0 0) 0x7f6d8814e190 con 0x7f6d881519d0 2020-11-20T11:48:22.151 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.142+0000 7f6d85d9b700 1 -- 172.21.15.192:0/4235381729 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d68003280 con 0x7f6d881519d0 2020-11-20T11:48:22.151 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.142+0000 7f6d85d9b700 1 -- 172.21.15.192:0/4235381729 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2781166347 0 0) 0x7f6d8814dc50 con 0x7f6d88060750 2020-11-20T11:48:22.151 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.142+0000 7f6d85d9b700 1 -- 172.21.15.192:0/4235381729 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d8814e190 con 0x7f6d88060750 2020-11-20T11:48:22.152 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.142+0000 7f6d85d9b700 1 -- 172.21.15.192:0/4235381729 <== mon.2 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2821216180 0 0) 0x7f6d68003280 con 0x7f6d881519d0 2020-11-20T11:48:22.152 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.142+0000 7f6d85d9b700 1 -- 172.21.15.192:0/4235381729 >> v1:172.21.15.146:6789/0 conn(0x7f6d88060370 legacy=0x7f6d880bbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:22.152 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.142+0000 7f6d85d9b700 1 -- 172.21.15.192:0/4235381729 >> v1:172.21.15.87:6789/0 conn(0x7f6d88060750 legacy=0x7f6d8814ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:22.152 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.142+0000 7f6d85d9b700 1 -- 172.21.15.192:0/4235381729 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8814e430 con 0x7f6d881519d0 2020-11-20T11:48:22.152 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.142+0000 7f6d85d9b700 1 -- 172.21.15.192:0/4235381729 <== mon.2 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3985397220 0 0) 0x7f6d70001520 con 0x7f6d881519d0 2020-11-20T11:48:22.153 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.142+0000 7f6d85d9b700 1 -- 172.21.15.192:0/4235381729 >> v1:172.21.15.192:6789/0 conn(0x7f6d881519d0 legacy=0x7f6d880bce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:22.153 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.142+0000 7f6d85d9b700 1 --2- 172.21.15.192:0/4235381729 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d68003950 0x7f6d68003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:22.153 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.142+0000 7f6d85d9b700 1 --2- 172.21.15.192:0/4235381729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d68004520 0x7f6d680049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:22.153 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.142+0000 7f6d85d9b700 1 --2- 172.21.15.192:0/4235381729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d68004e90 0x7f6d6800b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:22.153 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.142+0000 7f6d85d9b700 1 -- 172.21.15.192:0/4235381729 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6800bc60 con 0x7f6d68004520 2020-11-20T11:48:22.154 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.142+0000 7f6d85d9b700 1 -- 172.21.15.192:0/4235381729 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6800bda0 con 0x7f6d68004e90 2020-11-20T11:48:22.154 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.142+0000 7f6d85d9b700 1 -- 172.21.15.192:0/4235381729 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6800bee0 con 0x7f6d68003950 2020-11-20T11:48:22.154 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.142+0000 7f6d8659c700 1 --2- 172.21.15.192:0/4235381729 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d68003950 0x7f6d68003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:22.154 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.142+0000 7f6d7ffff700 1 --2- 172.21.15.192:0/4235381729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d68004520 0x7f6d680049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:22.154 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.142+0000 7f6d86d9d700 1 --2- 172.21.15.192:0/4235381729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d68004e90 0x7f6d6800b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:22.155 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.142+0000 7f6d8659c700 1 -- 172.21.15.192:0/4235381729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d68004e90 msgr2=0x7f6d6800b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:22.155 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.142+0000 7f6d8659c700 1 --2- 172.21.15.192:0/4235381729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d68004e90 0x7f6d6800b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:22.155 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.142+0000 7f6d8659c700 1 -- 172.21.15.192:0/4235381729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d68004520 msgr2=0x7f6d680049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:22.155 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.142+0000 7f6d8659c700 1 --2- 172.21.15.192:0/4235381729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d68004520 0x7f6d680049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:22.155 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.142+0000 7f6d86d9d700 1 -- 172.21.15.192:0/4235381729 reap_dead start 2020-11-20T11:48:22.156 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.142+0000 7f6d8659c700 1 -- 172.21.15.192:0/4235381729 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d68003280 con 0x7f6d68003950 2020-11-20T11:48:22.156 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.142+0000 7f6d7ffff700 1 --2- 172.21.15.192:0/4235381729 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d68004520 0x7f6d680049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:48:22.156 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.143+0000 7f6d8659c700 1 --2- 172.21.15.192:0/4235381729 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d68003950 0x7f6d68003d30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f6d78001a70 tx=0x7f6d78007bd0).ready entity=mon.2 client_cookie=3124fd402249aa35 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:22.156 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.143+0000 7f6d85d9b700 1 -- 172.21.15.192:0/4235381729 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d78007020 con 0x7f6d68003950 2020-11-20T11:48:22.156 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.143+0000 7f6d85d9b700 1 -- 172.21.15.192:0/4235381729 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d78001e90 con 0x7f6d68003950 2020-11-20T11:48:22.157 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.143+0000 7f6d85d9b700 1 -- 172.21.15.192:0/4235381729 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d780073d0 con 0x7f6d68003950 2020-11-20T11:48:22.157 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.143+0000 7f6d8c8fe700 1 -- 172.21.15.192:0/4235381729 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d68003950 msgr2=0x7f6d68003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:22.157 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.143+0000 7f6d8c8fe700 1 --2- 172.21.15.192:0/4235381729 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d68003950 0x7f6d68003d30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f6d78001a70 tx=0x7f6d78007bd0).stop 2020-11-20T11:48:22.158 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.143+0000 7f6d8c8fe700 1 -- 172.21.15.192:0/4235381729 shutdown_connections 2020-11-20T11:48:22.158 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.143+0000 7f6d8c8fe700 1 --2- 172.21.15.192:0/4235381729 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d68003950 0x7f6d68003d30 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:22.158 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.143+0000 7f6d8c8fe700 1 -- 172.21.15.192:0/4235381729 >> 172.21.15.192:0/4235381729 conn(0x7f6d88062100 msgr2=0x7f6d880c3590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:22.159 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.143+0000 7f6d8c8fe700 1 -- 172.21.15.192:0/4235381729 shutdown_connections 2020-11-20T11:48:22.159 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.143+0000 7f6d8c8fe700 1 -- 172.21.15.192:0/4235381729 wait complete. 2020-11-20T11:48:22.159 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.144+0000 7f6d8c8fe700 1 Processor -- start 2020-11-20T11:48:22.159 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.144+0000 7f6d8c8fe700 1 -- start start 2020-11-20T11:48:22.159 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.145+0000 7f6d8c8fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d68003950 0x7f6d8815e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:22.160 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.145+0000 7f6d8c8fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d880bcd20 0x7f6d8813a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:22.160 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.145+0000 7f6d8c8fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d880bd1a0 0x7f6d8813a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:22.160 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.145+0000 7f6d8c8fe700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8815ea00 con 0x7f6d880bd1a0 2020-11-20T11:48:22.160 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.145+0000 7f6d8c8fe700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8815eca0 con 0x7f6d880bcd20 2020-11-20T11:48:22.161 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.145+0000 7f6d8c8fe700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8815ef40 con 0x7f6d68003950 2020-11-20T11:48:22.161 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.145+0000 7f6d8659c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d68003950 0x7f6d8815e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:22.161 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.145+0000 7f6d8659c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d68003950 0x7f6d8815e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49462/0 (socket says 172.21.15.192:49462) 2020-11-20T11:48:22.161 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.145+0000 7f6d8659c700 1 -- 172.21.15.192:0/3636089129 learned_addr learned my addr 172.21.15.192:0/3636089129 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:22.161 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.145+0000 7f6d7ffff700 1 --2- 172.21.15.192:0/3636089129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d880bcd20 0x7f6d8813a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:22.162 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.145+0000 7f6d8659c700 1 -- 172.21.15.192:0/3636089129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d880bcd20 msgr2=0x7f6d8813a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:22.162 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.145+0000 7f6d8659c700 1 --2- 172.21.15.192:0/3636089129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d880bcd20 0x7f6d8813a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:22.162 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.145+0000 7f6d8659c700 1 -- 172.21.15.192:0/3636089129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d880bd1a0 msgr2=0x7f6d8813a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:22.162 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.145+0000 7f6d8659c700 1 --2- 172.21.15.192:0/3636089129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d880bd1a0 0x7f6d8813a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:48:22.162 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.145+0000 7f6d8659c700 1 -- 172.21.15.192:0/3636089129 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8815f1e0 con 0x7f6d68003950 2020-11-20T11:48:22.163 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.145+0000 7f6d8659c700 1 --2- 172.21.15.192:0/3636089129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d68003950 0x7f6d8815e470 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f6d78001a10 tx=0x7f6d78015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:22.163 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.146+0000 7f6d7e7fc700 1 -- 172.21.15.192:0/3636089129 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d78013940 con 0x7f6d68003950 2020-11-20T11:48:22.163 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.146+0000 7f6d7e7fc700 1 -- 172.21.15.192:0/3636089129 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d78013aa0 con 0x7f6d68003950 2020-11-20T11:48:22.163 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.146+0000 7f6d8c8fe700 1 -- 172.21.15.192:0/3636089129 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d88135ca0 con 0x7f6d68003950 2020-11-20T11:48:22.163 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.146+0000 7f6d7e7fc700 1 -- 172.21.15.192:0/3636089129 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d78013e20 con 0x7f6d68003950 2020-11-20T11:48:22.163 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.146+0000 7f6d8c8fe700 1 -- 172.21.15.192:0/3636089129 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d88150e40 con 0x7f6d68003950 2020-11-20T11:48:22.164 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.147+0000 7f6d8c8fe700 1 -- 172.21.15.192:0/3636089129 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d880699a0 con 0x7f6d68003950 2020-11-20T11:48:22.165 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.147+0000 7f6d7e7fc700 1 -- 172.21.15.192:0/3636089129 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f6d78027070 con 0x7f6d68003950 2020-11-20T11:48:22.165 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.147+0000 7f6d7e7fc700 1 --2- 172.21.15.192:0/3636089129 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f6d640806a0 0x7f6d64082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:22.165 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.148+0000 7f6d7e7fc700 1 -- 172.21.15.192:0/3636089129 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f6d780a37c0 con 0x7f6d68003950 2020-11-20T11:48:22.165 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.148+0000 7f6d7ffff700 1 --2- 172.21.15.192:0/3636089129 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f6d640806a0 0x7f6d64082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:22.166 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.148+0000 7f6d7ffff700 1 --2- 172.21.15.192:0/3636089129 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f6d640806a0 0x7f6d64082b60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f6d88062660 tx=0x7f6d8814dde0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:22.166 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.151+0000 7f6d7e7fc700 1 -- 172.21.15.192:0/3636089129 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f6d780781d0 con 0x7f6d68003950 2020-11-20T11:48:22.294 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.291+0000 7f6d8c8fe700 1 -- 172.21.15.192:0/3636089129 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d8815f370 con 0x7f6d68003950 2020-11-20T11:48:22.295 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.292+0000 7f6d7e7fc700 1 -- 172.21.15.192:0/3636089129 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21795 (secure 0 0 0) 0x7f6d7807b7f0 con 0x7f6d68003950 2020-11-20T11:48:22.296 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:48:22.296 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":28,"fsid":"4871390d-d110-4379-8302-5810d7b54f34","created":"2020-11-20T11:47:49.059675+0000","modified":"2020-11-20T11:48:09.832333+0000","last_up_change":"2020-11-20T11:47:57.317253+0000","last_in_change":"2020-11-20T11:47:57.317253+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:47:52.327778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:48:01.912951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:48:04.793810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:48:07.506705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77a5e1d9-0fb0-450c-872e-4aee77dede49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":23242},{"type":"v1","addr":"172.21.15.192:6827","nonce":23242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":23242},{"type":"v1","addr":"172.21.15.192:6829","nonce":23242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":23242},{"type":"v1","addr":"172.21.15.192:6833","nonce":23242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":23242},{"type":"v1","addr":"172.21.15.192:6831","nonce":23242}]},"public_addr":"172.21.15.192:6827/23242","cluster_addr":"172.21.15.192:6829/23242","heartbeat_back_addr":"172.21.15.192:6833/23242","heartbeat_front_addr":"172.21.15.192:6831/23242","state":["exists","up"]},{"osd":1,"uuid":"564330c6-5c45-4ef6-8718-bbfa97848e6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":22856},{"type":"v1","addr":"172.21.15.146:6801","nonce":22856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":22856},{"type":"v1","addr":"172.21.15.146:6803","nonce":22856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":22856},{"type":"v1","addr":"172.21.15.146:6807","nonce":22856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":22856},{"type":"v1","addr":"172.21.15.146:6805","nonce":22856}]},"public_addr":"172.21.15.146:6801/22856","cluster_addr":"172.21.15.146:6803/22856","heartbeat_back_addr":"172.21.15.146:6807/22856","heartbeat_front_addr":"172.21.15.146:6805/22856","state":["exists","up"]},{"osd":2,"uuid":"128ddb77-579b-4fa3-a0cb-7465ad959f3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6815","nonce":23326},{"type":"v1","addr":"172.21.15.87:6817","nonce":23326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":23326},{"type":"v1","addr":"172.21.15.87:6819","nonce":23326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":23326},{"type":"v1","addr":"172.21.15.87:6823","nonce":23326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":23326},{"type":"v1","addr":"172.21.15.87:6821","nonce":23326}]},"public_addr":"172.21.15.87:6817/23326","cluster_addr":"172.21.15.87:6819/23326","heartbeat_back_addr":"172.21.15.87:6823/23326","heartbeat_front_addr":"172.21.15.87:6821/23326","state":["exists","up"]},{"osd":3,"uuid":"4668cfdf-d172-4f30-95b8-ac842108a520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":23243},{"type":"v1","addr":"172.21.15.192:6803","nonce":23243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":23243},{"type":"v1","addr":"172.21.15.192:6805","nonce":23243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":23243},{"type":"v1","addr":"172.21.15.192:6809","nonce":23243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":23243},{"type":"v1","addr":"172.21.15.192:6807","nonce":23243}]},"public_addr":"172.21.15.192:6803/23243","cluster_addr":"172.21.15.192:6805/23243","heartbeat_back_addr":"172.21.15.192:6809/23243","heartbeat_front_addr":"172.21.15.192:6807/23243","state":["exists","up"]},{"osd":4,"uuid":"c4bc8ba5-0d22-49f5-97a6-2ca71e3a8c62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":22857},{"type":"v1","addr":"172.21.15.146:6809","nonce":22857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":22857},{"type":"v1","addr":"172.21.15.146:6811","nonce":22857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":22857},{"type":"v1","addr":"172.21.15.146:6815","nonce":22857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":22857},{"type":"v1","addr":"172.21.15.146:6813","nonce":22857}]},"public_addr":"172.21.15.146:6809/22857","cluster_addr":"172.21.15.146:6811/22857","heartbeat_back_addr":"172.21.15.146:6815/22857","heartbeat_front_addr":"172.21.15.146:6813/22857","state":["exists","up"]},{"osd":5,"uuid":"2d15f1db-e580-4715-9728-8fe5dd7e34d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":23316},{"type":"v1","addr":"172.21.15.87:6801","nonce":23316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":23316},{"type":"v1","addr":"172.21.15.87:6803","nonce":23316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":23316},{"type":"v1","addr":"172.21.15.87:6807","nonce":23316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":23316},{"type":"v1","addr":"172.21.15.87:6805","nonce":23316}]},"public_addr":"172.21.15.87:6801/23316","cluster_addr":"172.21.15.87:6803/23316","heartbeat_back_addr":"172.21.15.87:6807/23316","heartbeat_front_addr":"172.21.15.87:6805/23316","state":["exists","up"]},{"osd":6,"uuid":"a659da2b-bdce-42ac-8b30-b8c69b4c7041","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":23246},{"type":"v1","addr":"172.21.15.192:6811","nonce":23246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":23246},{"type":"v1","addr":"172.21.15.192:6813","nonce":23246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":23246},{"type":"v1","addr":"172.21.15.192:6817","nonce":23246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":23246},{"type":"v1","addr":"172.21.15.192:6815","nonce":23246}]},"public_addr":"172.21.15.192:6811/23246","cluster_addr":"172.21.15.192:6813/23246","heartbeat_back_addr":"172.21.15.192:6817/23246","heartbeat_front_addr":"172.21.15.192:6815/23246","state":["exists","up"]},{"osd":7,"uuid":"d6e41ac5-bab7-49e2-a17a-ef794bcc4a09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":22858},{"type":"v1","addr":"172.21.15.146:6818","nonce":22858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":22858},{"type":"v1","addr":"172.21.15.146:6822","nonce":22858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":22858},{"type":"v1","addr":"172.21.15.146:6830","nonce":22858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":22858},{"type":"v1","addr":"172.21.15.146:6826","nonce":22858}]},"public_addr":"172.21.15.146:6818/22858","cluster_addr":"172.21.15.146:6822/22858","heartbeat_back_addr":"172.21.15.146:6830/22858","heartbeat_front_addr":"172.21.15.146:6826/22858","state":["exists","up"]},{"osd":8,"uuid":"c4907993-7513-4162-974f-07dcb0a260a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":23333},{"type":"v1","addr":"172.21.15.87:6825","nonce":23333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":23333},{"type":"v1","addr":"172.21.15.87:6827","nonce":23333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":23333},{"type":"v1","addr":"172.21.15.87:6831","nonce":23333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":23333},{"type":"v1","addr":"172.21.15.87:6829","nonce":23333}]},"public_addr":"172.21.15.87:6825/23333","cluster_addr":"172.21.15.87:6827/23333","heartbeat_back_addr":"172.21.15.87:6831/23333","heartbeat_front_addr":"172.21.15.87:6829/23333","state":["exists","up"]},{"osd":9,"uuid":"3523676f-c9b8-47ae-86c0-4930dca17831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":23254},{"type":"v1","addr":"172.21.15.192:6819","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":23254},{"type":"v1","addr":"172.21.15.192:6821","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":23254},{"type":"v1","addr":"172.21.15.192:6825","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":23254},{"type":"v1","addr":"172.21.15.192:6823","nonce":23254}]},"public_addr":"172.21.15.192:6819/23254","cluster_addr":"172.21.15.192:6821/23254","heartbeat_back_addr":"172.21.15.192:6825/23254","heartbeat_front_addr":"172.21.15.192:6823/23254","state":["exists","up"]},{"osd":10,"uuid":"88d5c251-0bb1-4624-8fa2-7f3b74bd1bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":22859},{"type":"v1","addr":"172.21.15.146:6819","nonce":22859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6821","nonce":22859},{"type":"v1","addr":"172.21.15.146:6823","nonce":22859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":22859},{"type":"v1","addr":"172.21.15.146:6831","nonce":22859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6825","nonce":22859},{"type":"v1","addr":"172.21.15.146:6827","nonce":22859}]},"public_addr":"172.21.15.146:6819/22859","cluster_addr":"172.21.15.146:6823/22859","heartbeat_back_addr":"172.21.15.146:6831/22859","heartbeat_front_addr":"172.21.15.146:6827/22859","state":["exists","up"]},{"osd":11,"uuid":"31f650d6-ba1e-4f29-92ff-6abee04c0f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":23317},{"type":"v1","addr":"172.21.15.87:6809","nonce":23317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":23317},{"type":"v1","addr":"172.21.15.87:6811","nonce":23317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":23317},{"type":"v1","addr":"172.21.15.87:6816","nonce":23317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":23317},{"type":"v1","addr":"172.21.15.87:6813","nonce":23317}]},"public_addr":"172.21.15.87:6809/23317","cluster_addr":"172.21.15.87:6811/23317","heartbeat_back_addr":"172.21.15.87:6816/23317","heartbeat_front_addr":"172.21.15.87:6813/23317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.538863+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.552293+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.585265+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.505194+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.550032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.558089+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.565622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.587102+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.654330+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.599072+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.645833+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.596236+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:48:22.297 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.294+0000 7f6d8c8fe700 1 -- 172.21.15.192:0/3636089129 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f6d640806a0 msgr2=0x7f6d64082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:22.297 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.294+0000 7f6d8c8fe700 1 --2- 172.21.15.192:0/3636089129 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f6d640806a0 0x7f6d64082b60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f6d88062660 tx=0x7f6d8814dde0).stop 2020-11-20T11:48:22.298 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.294+0000 7f6d8c8fe700 1 -- 172.21.15.192:0/3636089129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d68003950 msgr2=0x7f6d8815e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:22.298 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.294+0000 7f6d8c8fe700 1 --2- 172.21.15.192:0/3636089129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d68003950 0x7f6d8815e470 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f6d78001a10 tx=0x7f6d78015000).stop 2020-11-20T11:48:22.298 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.294+0000 7f6d8c8fe700 1 -- 172.21.15.192:0/3636089129 shutdown_connections 2020-11-20T11:48:22.298 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.294+0000 7f6d8c8fe700 1 --2- 172.21.15.192:0/3636089129 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f6d640806a0 0x7f6d64082b60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:22.299 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.294+0000 7f6d8c8fe700 1 --2- 172.21.15.192:0/3636089129 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6d880bd1a0 0x7f6d8813a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:48:22.299 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.294+0000 7f6d8c8fe700 1 --2- 172.21.15.192:0/3636089129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d68003950 0x7f6d8815e470 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:22.299 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.294+0000 7f6d8c8fe700 1 --2- 172.21.15.192:0/3636089129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d880bcd20 0x7f6d8813a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:22.299 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.294+0000 7f6d8c8fe700 1 -- 172.21.15.192:0/3636089129 >> 172.21.15.192:0/3636089129 conn(0x7f6d88062100 msgr2=0x7f6d880bef20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:22.300 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.294+0000 7f6d8c8fe700 1 -- 172.21.15.192:0/3636089129 shutdown_connections 2020-11-20T11:48:22.300 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.294+0000 7f6d8c8fe700 1 -- 172.21.15.192:0/3636089129 wait complete. 2020-11-20T11:48:22.309 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-20T11:47:52.327778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-20T11:48:01.912951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-11-20T11:48:04.793810+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-11-20T11:48:07.506705+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-11-20T11:48:22.310 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2020-11-20T11:48:22.422 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.419+0000 7f4a8f66b700 1 Processor -- start 2020-11-20T11:48:22.422 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.419+0000 7f4a8f66b700 1 -- start start 2020-11-20T11:48:22.426 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.420+0000 7f4a8f66b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4a88060370 0x7f4a88060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:22.426 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.420+0000 7f4a8f66b700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a88151e80 con 0x7f4a88064c40 2020-11-20T11:48:22.426 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.420+0000 7f4a8f66b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a88152120 con 0x7f4a88154920 2020-11-20T11:48:22.427 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.420+0000 7f4a8f66b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a88064260 con 0x7f4a88060370 2020-11-20T11:48:22.427 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.420+0000 7f4a8cc06700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f4a88154920 0x7f4a880c2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52138/0 (socket says 172.21.15.192:52138) 2020-11-20T11:48:22.427 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.420+0000 7f4a8cc06700 1 -- 172.21.15.192:0/2268661897 learned_addr learned my addr 172.21.15.192:0/2268661897 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:22.427 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.420+0000 7f4a77fff700 1 -- 172.21.15.192:0/2268661897 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 473842528 0 0) 0x7f4a88152120 con 0x7f4a88154920 2020-11-20T11:48:22.427 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.420+0000 7f4a8d407700 1 --2- 172.21.15.192:0/2268661897 >> v2:172.21.15.146:3300/0 conn(0x7f4a88060370 0x7f4a88060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:22.428 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.420+0000 7f4a77fff700 1 -- 172.21.15.192:0/2268661897 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a70003280 con 0x7f4a88154920 2020-11-20T11:48:22.428 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.420+0000 7f4a77fff700 1 -- 172.21.15.192:0/2268661897 <== mon.2 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2661246260 0 0) 0x7f4a70003280 con 0x7f4a88154920 2020-11-20T11:48:22.428 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.420+0000 7f4a77fff700 1 -- 172.21.15.192:0/2268661897 >> v2:172.21.15.146:3300/0 conn(0x7f4a88060370 msgr2=0x7f4a88060750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:22.428 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.420+0000 7f4a77fff700 1 --2- 172.21.15.192:0/2268661897 >> v2:172.21.15.146:3300/0 conn(0x7f4a88060370 0x7f4a88060750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:22.429 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.420+0000 7f4a77fff700 1 -- 172.21.15.192:0/2268661897 >> v1:172.21.15.87:6789/0 conn(0x7f4a88064c40 legacy=0x7f4a88151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:22.429 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.420+0000 7f4a77fff700 1 -- 172.21.15.192:0/2268661897 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a88064500 con 0x7f4a88154920 2020-11-20T11:48:22.429 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.420+0000 7f4a77fff700 1 -- 172.21.15.192:0/2268661897 <== mon.2 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3985397220 0 0) 0x7f4a78001520 con 0x7f4a88154920 2020-11-20T11:48:22.429 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.420+0000 7f4a77fff700 1 -- 172.21.15.192:0/2268661897 >> v1:172.21.15.192:6789/0 conn(0x7f4a88154920 legacy=0x7f4a880c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:22.430 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.420+0000 7f4a77fff700 1 --2- 172.21.15.192:0/2268661897 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a70003770 0x7f4a70003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:22.430 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.420+0000 7f4a77fff700 1 --2- 172.21.15.192:0/2268661897 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a70004520 0x7f4a700049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:22.430 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.420+0000 7f4a77fff700 1 --2- 172.21.15.192:0/2268661897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a70004e90 0x7f4a7000b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:22.430 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.420+0000 7f4a77fff700 1 -- 172.21.15.192:0/2268661897 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a88064260 con 0x7f4a70003770 2020-11-20T11:48:22.430 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.420+0000 7f4a77fff700 1 -- 172.21.15.192:0/2268661897 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a70004260 con 0x7f4a70004e90 2020-11-20T11:48:22.431 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.420+0000 7f4a77fff700 1 -- 172.21.15.192:0/2268661897 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7000bc60 con 0x7f4a70004520 2020-11-20T11:48:22.431 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.420+0000 7f4a8cc06700 1 --2- 172.21.15.192:0/2268661897 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a70004520 0x7f4a700049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:22.431 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.421+0000 7f4a8d407700 1 --2- 172.21.15.192:0/2268661897 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a70003770 0x7f4a70003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:22.431 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.421+0000 7f4a8dc08700 1 --2- 172.21.15.192:0/2268661897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a70004e90 0x7f4a7000b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:22.432 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.421+0000 7f4a8cc06700 1 -- 172.21.15.192:0/2268661897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a70004e90 msgr2=0x7f4a7000b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:22.432 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.421+0000 7f4a8cc06700 1 --2- 172.21.15.192:0/2268661897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a70004e90 0x7f4a7000b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:22.432 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.421+0000 7f4a8cc06700 1 -- 172.21.15.192:0/2268661897 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a70003770 msgr2=0x7f4a70003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:22.432 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.421+0000 7f4a8cc06700 1 --2- 172.21.15.192:0/2268661897 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a70003770 0x7f4a70003b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:22.432 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.421+0000 7f4a8cc06700 1 -- 172.21.15.192:0/2268661897 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a70003280 con 0x7f4a70004520 2020-11-20T11:48:22.433 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.421+0000 7f4a8dc08700 1 -- 172.21.15.192:0/2268661897 reap_dead start 2020-11-20T11:48:22.433 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.421+0000 7f4a8cc06700 1 --2- 172.21.15.192:0/2268661897 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a70004520 0x7f4a700049a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f4a7800c410 tx=0x7f4a881522b0).ready entity=mon.2 client_cookie=b38d3b8d2c4e9fe server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:22.433 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.421+0000 7f4a77fff700 1 -- 172.21.15.192:0/2268661897 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a780070d0 con 0x7f4a70004520 2020-11-20T11:48:22.433 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.421+0000 7f4a77fff700 1 -- 172.21.15.192:0/2268661897 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a78007230 con 0x7f4a70004520 2020-11-20T11:48:22.434 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.421+0000 7f4a77fff700 1 -- 172.21.15.192:0/2268661897 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a78005630 con 0x7f4a70004520 2020-11-20T11:48:22.434 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.421+0000 7f4a8f66b700 1 -- 172.21.15.192:0/2268661897 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a70004520 msgr2=0x7f4a700049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:22.434 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.421+0000 7f4a8f66b700 1 --2- 172.21.15.192:0/2268661897 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a70004520 0x7f4a700049a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f4a7800c410 tx=0x7f4a881522b0).stop 2020-11-20T11:48:22.434 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.421+0000 7f4a8f66b700 1 -- 172.21.15.192:0/2268661897 shutdown_connections 2020-11-20T11:48:22.434 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.421+0000 7f4a8f66b700 1 --2- 172.21.15.192:0/2268661897 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a70004520 0x7f4a700049a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:22.435 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.421+0000 7f4a8f66b700 1 -- 172.21.15.192:0/2268661897 >> 172.21.15.192:0/2268661897 conn(0x7f4a88062100 msgr2=0x7f4a880c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:22.435 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.421+0000 7f4a8f66b700 1 -- 172.21.15.192:0/2268661897 shutdown_connections 2020-11-20T11:48:22.435 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.421+0000 7f4a8f66b700 1 -- 172.21.15.192:0/2268661897 wait complete. 2020-11-20T11:48:22.435 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.422+0000 7f4a8f66b700 1 Processor -- start 2020-11-20T11:48:22.435 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.423+0000 7f4a8f66b700 1 -- start start 2020-11-20T11:48:22.438 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.423+0000 7f4a8f66b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a70004520 0x7f4a880c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:22.438 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.423+0000 7f4a8f66b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a880c8010 0x7f4a880c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:22.438 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.423+0000 7f4a8f66b700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a880c7230 0x7f4a8814c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:22.439 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.423+0000 7f4a8f66b700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a880b1410 con 0x7f4a880c7230 2020-11-20T11:48:22.439 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.423+0000 7f4a8f66b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a880b16b0 con 0x7f4a70004520 2020-11-20T11:48:22.439 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.423+0000 7f4a8f66b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a880c6360 con 0x7f4a880c8010 2020-11-20T11:48:22.439 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.423+0000 7f4a8cc06700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a880c8010 0x7f4a880c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:22.439 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.423+0000 7f4a8cc06700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a880c8010 0x7f4a880c6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49484/0 (socket says 172.21.15.192:49484) 2020-11-20T11:48:22.440 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.423+0000 7f4a8cc06700 1 -- 172.21.15.192:0/342027201 learned_addr learned my addr 172.21.15.192:0/342027201 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:22.440 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.424+0000 7f4a8dc08700 1 --2- 172.21.15.192:0/342027201 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a880c7230 0x7f4a8814c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:22.440 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.424+0000 7f4a8d407700 1 --2- 172.21.15.192:0/342027201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a70004520 0x7f4a880c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:22.440 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.424+0000 7f4a8cc06700 1 -- 172.21.15.192:0/342027201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a70004520 msgr2=0x7f4a880c7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:22.440 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.424+0000 7f4a8cc06700 1 --2- 172.21.15.192:0/342027201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a70004520 0x7f4a880c7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:22.441 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.424+0000 7f4a8cc06700 1 -- 172.21.15.192:0/342027201 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a880c7230 msgr2=0x7f4a8814c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:22.441 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.424+0000 7f4a8cc06700 1 --2- 172.21.15.192:0/342027201 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a880c7230 0x7f4a8814c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:22.441 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.424+0000 7f4a8cc06700 1 -- 172.21.15.192:0/342027201 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a880c6600 con 0x7f4a880c8010 2020-11-20T11:48:22.441 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.424+0000 7f4a8d407700 1 --2- 172.21.15.192:0/342027201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a70004520 0x7f4a880c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:48:22.441 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.424+0000 7f4a8cc06700 1 --2- 172.21.15.192:0/342027201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a880c8010 0x7f4a880c6d40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f4a700054e0 tx=0x7f4a78013000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:22.442 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.424+0000 7f4a757fa700 1 -- 172.21.15.192:0/342027201 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7801a070 con 0x7f4a880c8010 2020-11-20T11:48:22.442 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.424+0000 7f4a757fa700 1 -- 172.21.15.192:0/342027201 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a78005e00 con 0x7f4a880c8010 2020-11-20T11:48:22.442 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.424+0000 7f4a8f66b700 1 -- 172.21.15.192:0/342027201 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a880c68a0 con 0x7f4a880c8010 2020-11-20T11:48:22.442 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.424+0000 7f4a757fa700 1 -- 172.21.15.192:0/342027201 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a78005030 con 0x7f4a880c8010 2020-11-20T11:48:22.443 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.425+0000 7f4a8f66b700 1 -- 172.21.15.192:0/342027201 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a880b0ff0 con 0x7f4a880c8010 2020-11-20T11:48:22.443 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.426+0000 7f4a8f66b700 1 -- 172.21.15.192:0/342027201 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a880c61b0 con 0x7f4a880c8010 2020-11-20T11:48:22.443 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.426+0000 7f4a757fa700 1 -- 172.21.15.192:0/342027201 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f4a78010070 con 0x7f4a880c8010 2020-11-20T11:48:22.443 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.426+0000 7f4a757fa700 1 --2- 172.21.15.192:0/342027201 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f4a600806a0 0x7f4a60082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:22.443 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.427+0000 7f4a8d407700 1 --2- 172.21.15.192:0/342027201 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f4a600806a0 0x7f4a60082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:22.444 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.427+0000 7f4a757fa700 1 -- 172.21.15.192:0/342027201 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f4a780a2de0 con 0x7f4a880c8010 2020-11-20T11:48:22.444 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.427+0000 7f4a8d407700 1 --2- 172.21.15.192:0/342027201 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f4a600806a0 0x7f4a60082b60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f4a84006fd0 tx=0x7f4a84008040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:22.444 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.430+0000 7f4a757fa700 1 -- 172.21.15.192:0/342027201 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f4a780777f0 con 0x7f4a880c8010 2020-11-20T11:48:22.573 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.570+0000 7f4a8f66b700 1 -- 172.21.15.192:0/342027201 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4a880699a0 con 0x7f4a880c8010 2020-11-20T11:48:22.574 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.570+0000 7f4a757fa700 1 -- 172.21.15.192:0/342027201 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v28) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4a7807ae10 con 0x7f4a880c8010 2020-11-20T11:48:22.574 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2020-11-20T11:48:22.575 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.572+0000 7f4a8f66b700 1 -- 172.21.15.192:0/342027201 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f4a600806a0 msgr2=0x7f4a60082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:22.576 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.572+0000 7f4a8f66b700 1 --2- 172.21.15.192:0/342027201 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f4a600806a0 0x7f4a60082b60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f4a84006fd0 tx=0x7f4a84008040).stop 2020-11-20T11:48:22.576 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.572+0000 7f4a8f66b700 1 -- 172.21.15.192:0/342027201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a880c8010 msgr2=0x7f4a880c6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:22.576 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.572+0000 7f4a8f66b700 1 --2- 172.21.15.192:0/342027201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a880c8010 0x7f4a880c6d40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f4a700054e0 tx=0x7f4a78013000).stop 2020-11-20T11:48:22.576 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.572+0000 7f4a8f66b700 1 -- 172.21.15.192:0/342027201 shutdown_connections 2020-11-20T11:48:22.577 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.572+0000 7f4a8f66b700 1 --2- 172.21.15.192:0/342027201 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f4a600806a0 0x7f4a60082b60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:22.577 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.572+0000 7f4a8f66b700 1 --2- 172.21.15.192:0/342027201 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f4a880c7230 0x7f4a8814c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:22.577 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.572+0000 7f4a8f66b700 1 --2- 172.21.15.192:0/342027201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a70004520 0x7f4a880c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:22.577 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.572+0000 7f4a8f66b700 1 --2- 172.21.15.192:0/342027201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a880c8010 0x7f4a880c6d40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:22.578 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.572+0000 7f4a8f66b700 1 -- 172.21.15.192:0/342027201 >> 172.21.15.192:0/342027201 conn(0x7f4a88062100 msgr2=0x7f4a880c2340 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:22.578 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.572+0000 7f4a8f66b700 1 -- 172.21.15.192:0/342027201 shutdown_connections 2020-11-20T11:48:22.578 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.572+0000 7f4a8f66b700 1 -- 172.21.15.192:0/342027201 wait complete. 2020-11-20T11:48:22.587 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-11-20T11:48:22.698 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.695+0000 7fc5b6003700 1 Processor -- start 2020-11-20T11:48:22.699 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.695+0000 7fc5b6003700 1 -- start start 2020-11-20T11:48:22.701 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.696+0000 7fc5b6003700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc5b0061bd0 0x7fc5b0151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:22.701 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.696+0000 7fc5b6003700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b0154610 con 0x7fc5b0150c70 2020-11-20T11:48:22.702 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.696+0000 7fc5b6003700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b01548b0 con 0x7fc5b00617f0 2020-11-20T11:48:22.702 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.696+0000 7fc5b6003700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b0154b50 con 0x7fc5b0061bd0 2020-11-20T11:48:22.702 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.696+0000 7fc5b5001700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fc5b00617f0 0x7fc5b0150560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52160/0 (socket says 172.21.15.192:52160) 2020-11-20T11:48:22.702 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.696+0000 7fc5b5001700 1 -- 172.21.15.192:0/4289052682 learned_addr learned my addr 172.21.15.192:0/4289052682 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:22.703 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.696+0000 7fc5b5802700 1 --2- 172.21.15.192:0/4289052682 >> v2:172.21.15.146:3300/0 conn(0x7fc5b0061bd0 0x7fc5b0151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:22.703 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.697+0000 7fc59ffff700 1 -- 172.21.15.192:0/4289052682 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1468858806 0 0) 0x7fc5b01548b0 con 0x7fc5b00617f0 2020-11-20T11:48:22.703 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.697+0000 7fc59ffff700 1 -- 172.21.15.192:0/4289052682 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc598003280 con 0x7fc5b00617f0 2020-11-20T11:48:22.703 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.697+0000 7fc5b5802700 1 -- 172.21.15.192:0/4289052682 >> v1:172.21.15.192:6789/0 conn(0x7fc5b00617f0 legacy=0x7fc5b0150560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:22.704 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.697+0000 7fc5b5802700 1 -- 172.21.15.192:0/4289052682 >> v1:172.21.15.146:6789/0 conn(0x7fc5b0150c70 legacy=0x7fc5b0151430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:22.704 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.697+0000 7fc5b5802700 1 -- 172.21.15.192:0/4289052682 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b0154df0 con 0x7fc5b0061bd0 2020-11-20T11:48:22.704 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.697+0000 7fc5b5802700 1 --2- 172.21.15.192:0/4289052682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5b0061bd0 0x7fc5b0151b40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fc5a8009ce0 tx=0x7fc5a8009220).ready entity=mon.1 client_cookie=3dad9e06ac0e0597 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:22.704 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.697+0000 7fc59ffff700 1 -- 172.21.15.192:0/4289052682 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a800ba40 con 0x7fc5b0061bd0 2020-11-20T11:48:22.705 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.697+0000 7fc59ffff700 1 -- 172.21.15.192:0/4289052682 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a800bba0 con 0x7fc5b0061bd0 2020-11-20T11:48:22.705 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.697+0000 7fc59ffff700 1 -- 172.21.15.192:0/4289052682 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8011400 con 0x7fc5b0061bd0 2020-11-20T11:48:22.705 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.698+0000 7fc5b6003700 1 -- 172.21.15.192:0/4289052682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5b0061bd0 msgr2=0x7fc5b0151b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:22.705 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.698+0000 7fc5b6003700 1 --2- 172.21.15.192:0/4289052682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5b0061bd0 0x7fc5b0151b40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fc5a8009ce0 tx=0x7fc5a8009220).stop 2020-11-20T11:48:22.705 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.698+0000 7fc5b6003700 1 -- 172.21.15.192:0/4289052682 shutdown_connections 2020-11-20T11:48:22.706 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.698+0000 7fc5b6003700 1 --2- 172.21.15.192:0/4289052682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5b0061bd0 0x7fc5b0151b40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:22.706 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.698+0000 7fc5b6003700 1 -- 172.21.15.192:0/4289052682 >> 172.21.15.192:0/4289052682 conn(0x7fc5b00c77f0 msgr2=0x7fc5b00c7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:22.706 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.698+0000 7fc5b6003700 1 -- 172.21.15.192:0/4289052682 shutdown_connections 2020-11-20T11:48:22.707 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.698+0000 7fc5b6003700 1 -- 172.21.15.192:0/4289052682 wait complete. 2020-11-20T11:48:22.710 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.699+0000 7fc5b6003700 1 Processor -- start 2020-11-20T11:48:22.710 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.699+0000 7fc5b6003700 1 -- start start 2020-11-20T11:48:22.710 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.700+0000 7fc5b6003700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5b00617f0 0x7fc5b00b1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:22.710 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.700+0000 7fc5b6003700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5b0061bd0 0x7fc5b014bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:22.710 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.700+0000 7fc5b6003700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5b0150c70 0x7fc5b014c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:22.711 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.700+0000 7fc5b6003700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b00c6280 con 0x7fc5b00617f0 2020-11-20T11:48:22.711 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.700+0000 7fc5b6003700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b00c6520 con 0x7fc5b0150c70 2020-11-20T11:48:22.711 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.700+0000 7fc5b6003700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b00c67c0 con 0x7fc5b0061bd0 2020-11-20T11:48:22.711 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.700+0000 7fc5b4800700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5b0061bd0 0x7fc5b014bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:22.711 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.700+0000 7fc5b4800700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5b0061bd0 0x7fc5b014bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49498/0 (socket says 172.21.15.192:49498) 2020-11-20T11:48:22.712 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.700+0000 7fc5b4800700 1 -- 172.21.15.192:0/3445414685 learned_addr learned my addr 172.21.15.192:0/3445414685 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:22.712 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.700+0000 7fc5b5802700 1 --2- 172.21.15.192:0/3445414685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5b0150c70 0x7fc5b014c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:22.712 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.700+0000 7fc5b5001700 1 --2- 172.21.15.192:0/3445414685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5b00617f0 0x7fc5b00b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:22.713 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.700+0000 7fc5b4800700 1 -- 172.21.15.192:0/3445414685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5b0150c70 msgr2=0x7fc5b014c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:22.713 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.700+0000 7fc5b4800700 1 --2- 172.21.15.192:0/3445414685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5b0150c70 0x7fc5b014c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:22.713 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.700+0000 7fc5b4800700 1 -- 172.21.15.192:0/3445414685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5b00617f0 msgr2=0x7fc5b00b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:22.713 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.700+0000 7fc5b4800700 1 --2- 172.21.15.192:0/3445414685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5b00617f0 0x7fc5b00b1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:22.713 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.700+0000 7fc5b4800700 1 -- 172.21.15.192:0/3445414685 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b00c6a60 con 0x7fc5b0061bd0 2020-11-20T11:48:22.714 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.700+0000 7fc5b5001700 1 --2- 172.21.15.192:0/3445414685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5b00617f0 0x7fc5b00b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:48:22.714 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.701+0000 7fc5b4800700 1 --2- 172.21.15.192:0/3445414685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5b0061bd0 0x7fc5b014bd70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fc5a0001eb0 tx=0x7fc5a0007c50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:22.714 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.701+0000 7fc59d7fa700 1 -- 172.21.15.192:0/3445414685 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a0010510 con 0x7fc5b0061bd0 2020-11-20T11:48:22.714 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.701+0000 7fc59d7fa700 1 -- 172.21.15.192:0/3445414685 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a0010670 con 0x7fc5b0061bd0 2020-11-20T11:48:22.714 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.701+0000 7fc5b6003700 1 -- 172.21.15.192:0/3445414685 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b00c6d00 con 0x7fc5b0061bd0 2020-11-20T11:48:22.715 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.701+0000 7fc59d7fa700 1 -- 172.21.15.192:0/3445414685 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a0010a10 con 0x7fc5b0061bd0 2020-11-20T11:48:22.715 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.701+0000 7fc5b6003700 1 -- 172.21.15.192:0/3445414685 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b0151b80 con 0x7fc5b0061bd0 2020-11-20T11:48:22.715 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.702+0000 7fc5b6003700 1 -- 172.21.15.192:0/3445414685 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b005ca80 con 0x7fc5b0061bd0 2020-11-20T11:48:22.715 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.702+0000 7fc59d7fa700 1 -- 172.21.15.192:0/3445414685 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fc5a0010070 con 0x7fc5b0061bd0 2020-11-20T11:48:22.715 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.703+0000 7fc59d7fa700 1 --2- 172.21.15.192:0/3445414685 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fc5880806a0 0x7fc588082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:22.716 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.703+0000 7fc59d7fa700 1 -- 172.21.15.192:0/3445414685 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fc5a00a24a0 con 0x7fc5b0061bd0 2020-11-20T11:48:22.716 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.703+0000 7fc5b5001700 1 --2- 172.21.15.192:0/3445414685 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fc5880806a0 0x7fc588082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:22.716 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.703+0000 7fc5b5001700 1 --2- 172.21.15.192:0/3445414685 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fc5880806a0 0x7fc588082b60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fc5ac0055e0 tx=0x7fc5ac009040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:22.716 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.706+0000 7fc59d7fa700 1 -- 172.21.15.192:0/3445414685 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fc5a0076eb0 con 0x7fc5b0061bd0 2020-11-20T11:48:22.849 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.845+0000 7fc5b6003700 1 -- 172.21.15.192:0/3445414685 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc5b00c6e90 con 0x7fc5b0061bd0 2020-11-20T11:48:22.849 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.845+0000 7fc59d7fa700 1 -- 172.21.15.192:0/3445414685 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc5a0007d70 con 0x7fc5b0061bd0 2020-11-20T11:48:22.850 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 8 2020-11-20T11:48:22.851 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.847+0000 7fc5b6003700 1 -- 172.21.15.192:0/3445414685 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fc5880806a0 msgr2=0x7fc588082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:22.851 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.847+0000 7fc5b6003700 1 --2- 172.21.15.192:0/3445414685 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fc5880806a0 0x7fc588082b60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fc5ac0055e0 tx=0x7fc5ac009040).stop 2020-11-20T11:48:22.851 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.847+0000 7fc5b6003700 1 -- 172.21.15.192:0/3445414685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5b0061bd0 msgr2=0x7fc5b014bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:22.851 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.847+0000 7fc5b6003700 1 --2- 172.21.15.192:0/3445414685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5b0061bd0 0x7fc5b014bd70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fc5a0001eb0 tx=0x7fc5a0007c50).stop 2020-11-20T11:48:22.852 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.847+0000 7fc5b6003700 1 -- 172.21.15.192:0/3445414685 shutdown_connections 2020-11-20T11:48:22.852 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.847+0000 7fc5b6003700 1 --2- 172.21.15.192:0/3445414685 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fc5880806a0 0x7fc588082b60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:22.852 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.847+0000 7fc5b6003700 1 --2- 172.21.15.192:0/3445414685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5b0150c70 0x7fc5b014c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:22.852 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.847+0000 7fc5b6003700 1 --2- 172.21.15.192:0/3445414685 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc5b00617f0 0x7fc5b00b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:22.852 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.847+0000 7fc5b6003700 1 --2- 172.21.15.192:0/3445414685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5b0061bd0 0x7fc5b014bd70 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:22.853 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.847+0000 7fc5b6003700 1 -- 172.21.15.192:0/3445414685 >> 172.21.15.192:0/3445414685 conn(0x7fc5b00c77f0 msgr2=0x7fc5b00c12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:22.853 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.847+0000 7fc5b6003700 1 -- 172.21.15.192:0/3445414685 shutdown_connections 2020-11-20T11:48:22.853 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.847+0000 7fc5b6003700 1 -- 172.21.15.192:0/3445414685 wait complete. 2020-11-20T11:48:22.862 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-11-20T11:48:22.974 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.971+0000 7fa422b35700 1 Processor -- start 2020-11-20T11:48:22.974 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.971+0000 7fa422b35700 1 -- start start 2020-11-20T11:48:22.976 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.972+0000 7fa422b35700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa41c154920 0x7fa41c060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:22.976 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.972+0000 7fa422b35700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa41c151e80 con 0x7fa41c060370 2020-11-20T11:48:22.977 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.972+0000 7fa422b35700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa41c152120 con 0x7fa41c064c40 2020-11-20T11:48:22.977 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.972+0000 7fa422b35700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa41c064260 con 0x7fa41c154920 2020-11-20T11:48:22.977 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.972+0000 7fa41bfff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa41c154920 0x7fa41c060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:22.977 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.972+0000 7fa41bfff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa41c154920 0x7fa41c060750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49504/0 (socket says 172.21.15.192:49504) 2020-11-20T11:48:22.977 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.972+0000 7fa41bfff700 1 -- 172.21.15.192:0/2111776999 learned_addr learned my addr 172.21.15.192:0/2111776999 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:22.978 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.972+0000 7fa41bfff700 1 -- 172.21.15.192:0/2111776999 >> v1:172.21.15.146:6789/0 conn(0x7fa41c064c40 legacy=0x7fa41c151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:22.978 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.972+0000 7fa41bfff700 1 -- 172.21.15.192:0/2111776999 >> v1:172.21.15.87:6789/0 conn(0x7fa41c060370 legacy=0x7fa41c0c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:22.978 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.972+0000 7fa41bfff700 1 -- 172.21.15.192:0/2111776999 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa41c064500 con 0x7fa41c154920 2020-11-20T11:48:22.978 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.972+0000 7fa41bfff700 1 --2- 172.21.15.192:0/2111776999 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa41c154920 0x7fa41c060750 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fa408009a10 tx=0x7fa408006ef0).ready entity=mon.2 client_cookie=89dff1fcf392c31a server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:22.978 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.972+0000 7fa41b7fe700 1 -- 172.21.15.192:0/2111776999 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40800b8f0 con 0x7fa41c154920 2020-11-20T11:48:22.979 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.972+0000 7fa41b7fe700 1 -- 172.21.15.192:0/2111776999 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa408000e90 con 0x7fa41c154920 2020-11-20T11:48:22.979 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.972+0000 7fa41b7fe700 1 -- 172.21.15.192:0/2111776999 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40800bc60 con 0x7fa41c154920 2020-11-20T11:48:22.979 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.973+0000 7fa422b35700 1 -- 172.21.15.192:0/2111776999 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa41c154920 msgr2=0x7fa41c060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:22.979 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.973+0000 7fa422b35700 1 --2- 172.21.15.192:0/2111776999 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa41c154920 0x7fa41c060750 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fa408009a10 tx=0x7fa408006ef0).stop 2020-11-20T11:48:22.979 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.973+0000 7fa422b35700 1 -- 172.21.15.192:0/2111776999 shutdown_connections 2020-11-20T11:48:22.980 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.973+0000 7fa422b35700 1 --2- 172.21.15.192:0/2111776999 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa41c154920 0x7fa41c060750 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:22.980 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.973+0000 7fa422b35700 1 -- 172.21.15.192:0/2111776999 >> 172.21.15.192:0/2111776999 conn(0x7fa41c062100 msgr2=0x7fa41c0c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:22.980 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.973+0000 7fa422b35700 1 -- 172.21.15.192:0/2111776999 shutdown_connections 2020-11-20T11:48:22.980 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.973+0000 7fa422b35700 1 -- 172.21.15.192:0/2111776999 wait complete. 2020-11-20T11:48:22.983 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.974+0000 7fa422b35700 1 Processor -- start 2020-11-20T11:48:22.983 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.974+0000 7fa422b35700 1 -- start start 2020-11-20T11:48:22.984 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.975+0000 7fa422b35700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa41c060370 0x7fa41c0c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:22.984 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.975+0000 7fa422b35700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa41c064c40 0x7fa41c0c2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:22.984 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.975+0000 7fa422b35700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa41c154920 0x7fa41c0c2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:22.984 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.975+0000 7fa422b35700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c14d670 con 0x7fa41c064c40 2020-11-20T11:48:22.984 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.975+0000 7fa422b35700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c148210 con 0x7fa41c154920 2020-11-20T11:48:22.985 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.975+0000 7fa422b35700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c14cbf0 con 0x7fa41c060370 2020-11-20T11:48:22.985 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.975+0000 7fa4208d1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa41c060370 0x7fa41c0c70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:22.985 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.975+0000 7fa4208d1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa41c060370 0x7fa41c0c70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49512/0 (socket says 172.21.15.192:49512) 2020-11-20T11:48:22.985 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.975+0000 7fa4208d1700 1 -- 172.21.15.192:0/3135581397 learned_addr learned my addr 172.21.15.192:0/3135581397 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:22.985 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.975+0000 7fa41bfff700 1 --2- 172.21.15.192:0/3135581397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa41c064c40 0x7fa41c0c2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:22.986 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.975+0000 7fa4210d2700 1 --2- 172.21.15.192:0/3135581397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa41c154920 0x7fa41c0c2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:22.986 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.975+0000 7fa4208d1700 1 -- 172.21.15.192:0/3135581397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa41c154920 msgr2=0x7fa41c0c2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:22.986 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.975+0000 7fa4208d1700 1 --2- 172.21.15.192:0/3135581397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa41c154920 0x7fa41c0c2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:22.986 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.975+0000 7fa4208d1700 1 -- 172.21.15.192:0/3135581397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa41c064c40 msgr2=0x7fa41c0c2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:22.987 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.975+0000 7fa4208d1700 1 --2- 172.21.15.192:0/3135581397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa41c064c40 0x7fa41c0c2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:22.987 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.975+0000 7fa4208d1700 1 -- 172.21.15.192:0/3135581397 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa41c14ce90 con 0x7fa41c060370 2020-11-20T11:48:22.987 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.975+0000 7fa4208d1700 1 --2- 172.21.15.192:0/3135581397 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa41c060370 0x7fa41c0c70b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fa41000c710 tx=0x7fa410007c90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:22.987 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.976+0000 7fa418ff9700 1 -- 172.21.15.192:0/3135581397 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa410007020 con 0x7fa41c060370 2020-11-20T11:48:22.987 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.976+0000 7fa418ff9700 1 -- 172.21.15.192:0/3135581397 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa410007180 con 0x7fa41c060370 2020-11-20T11:48:22.988 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.976+0000 7fa422b35700 1 -- 172.21.15.192:0/3135581397 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa41c14d130 con 0x7fa41c060370 2020-11-20T11:48:22.988 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.976+0000 7fa418ff9700 1 -- 172.21.15.192:0/3135581397 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa410006530 con 0x7fa41c060370 2020-11-20T11:48:22.988 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.976+0000 7fa422b35700 1 -- 172.21.15.192:0/3135581397 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa41c0c2380 con 0x7fa41c060370 2020-11-20T11:48:22.988 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.977+0000 7fa422b35700 1 -- 172.21.15.192:0/3135581397 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa41c0699a0 con 0x7fa41c060370 2020-11-20T11:48:22.988 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.977+0000 7fa418ff9700 1 -- 172.21.15.192:0/3135581397 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fa410018020 con 0x7fa41c060370 2020-11-20T11:48:22.989 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.978+0000 7fa418ff9700 1 --2- 172.21.15.192:0/3135581397 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fa3f40806a0 0x7fa3f4082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:22.989 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.978+0000 7fa418ff9700 1 -- 172.21.15.192:0/3135581397 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fa4100a2330 con 0x7fa41c060370 2020-11-20T11:48:22.989 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.978+0000 7fa41bfff700 1 --2- 172.21.15.192:0/3135581397 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fa3f40806a0 0x7fa3f4082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:22.989 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.978+0000 7fa41bfff700 1 --2- 172.21.15.192:0/3135581397 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fa3f40806a0 0x7fa3f4082b60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fa408009a10 tx=0x7fa408016000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:22.990 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:22.981+0000 7fa418ff9700 1 -- 172.21.15.192:0/3135581397 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fa410076d40 con 0x7fa41c060370 2020-11-20T11:48:23.126 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.123+0000 7fa422b35700 1 -- 172.21.15.192:0/3135581397 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa41c05ca80 con 0x7fa41c060370 2020-11-20T11:48:23.126 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.123+0000 7fa418ff9700 1 -- 172.21.15.192:0/3135581397 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+10 (secure 0 0 0) 0x7fa41007a360 con 0x7fa41c060370 2020-11-20T11:48:23.127 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 8 2020-11-20T11:48:23.128 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.125+0000 7fa422b35700 1 -- 172.21.15.192:0/3135581397 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fa3f40806a0 msgr2=0x7fa3f4082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:23.128 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.125+0000 7fa422b35700 1 --2- 172.21.15.192:0/3135581397 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fa3f40806a0 0x7fa3f4082b60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fa408009a10 tx=0x7fa408016000).stop 2020-11-20T11:48:23.128 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.125+0000 7fa422b35700 1 -- 172.21.15.192:0/3135581397 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa41c060370 msgr2=0x7fa41c0c70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:23.128 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.125+0000 7fa422b35700 1 --2- 172.21.15.192:0/3135581397 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa41c060370 0x7fa41c0c70b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fa41000c710 tx=0x7fa410007c90).stop 2020-11-20T11:48:23.129 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.125+0000 7fa422b35700 1 -- 172.21.15.192:0/3135581397 shutdown_connections 2020-11-20T11:48:23.129 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.125+0000 7fa422b35700 1 --2- 172.21.15.192:0/3135581397 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fa3f40806a0 0x7fa3f4082b60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:23.129 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.125+0000 7fa422b35700 1 --2- 172.21.15.192:0/3135581397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa41c154920 0x7fa41c0c2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:23.129 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.125+0000 7fa422b35700 1 --2- 172.21.15.192:0/3135581397 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa41c060370 0x7fa41c0c70b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:23.129 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.125+0000 7fa422b35700 1 --2- 172.21.15.192:0/3135581397 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa41c064c40 0x7fa41c0c2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:23.130 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.125+0000 7fa422b35700 1 -- 172.21.15.192:0/3135581397 >> 172.21.15.192:0/3135581397 conn(0x7fa41c062100 msgr2=0x7fa41c1522b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:23.130 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.125+0000 7fa422b35700 1 -- 172.21.15.192:0/3135581397 shutdown_connections 2020-11-20T11:48:23.130 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.125+0000 7fa422b35700 1 -- 172.21.15.192:0/3135581397 wait complete. 2020-11-20T11:48:23.139 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-11-20T11:48:23.250 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.247+0000 7f2beb59e700 1 Processor -- start 2020-11-20T11:48:23.251 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.247+0000 7f2beb59e700 1 -- start start 2020-11-20T11:48:23.254 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.248+0000 7f2beb59e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2bec063d80 0x7f2bec066ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:23.255 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.248+0000 7f2beb59e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bec066a70 con 0x7f2bec0673c0 2020-11-20T11:48:23.255 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.248+0000 7f2beb59e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bec1517c0 con 0x7f2bec0639a0 2020-11-20T11:48:23.255 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.248+0000 7f2beb59e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bec151a60 con 0x7f2bec063d80 2020-11-20T11:48:23.255 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.248+0000 7f2bea59c700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f2bec0639a0 0x7f2bec151010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52186/0 (socket says 172.21.15.192:52186) 2020-11-20T11:48:23.255 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.248+0000 7f2bea59c700 1 -- 172.21.15.192:0/218169652 learned_addr learned my addr 172.21.15.192:0/218169652 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:23.256 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.249+0000 7f2be9d9b700 1 -- 172.21.15.192:0/218169652 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1057708004 0 0) 0x7f2bec1517c0 con 0x7f2bec0639a0 2020-11-20T11:48:23.256 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.249+0000 7f2be9d9b700 1 -- 172.21.15.192:0/218169652 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bcc003280 con 0x7f2bec0639a0 2020-11-20T11:48:23.256 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.249+0000 7f2be3fff700 1 --2- 172.21.15.192:0/218169652 >> v2:172.21.15.146:3300/0 conn(0x7f2bec063d80 0x7f2bec066ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:23.256 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.249+0000 7f2be9d9b700 1 -- 172.21.15.192:0/218169652 <== mon.2 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2782350878 0 0) 0x7f2bcc003280 con 0x7f2bec0639a0 2020-11-20T11:48:23.256 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.249+0000 7f2be9d9b700 1 -- 172.21.15.192:0/218169652 >> v2:172.21.15.146:3300/0 conn(0x7f2bec063d80 msgr2=0x7f2bec066ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:23.257 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.249+0000 7f2be9d9b700 1 --2- 172.21.15.192:0/218169652 >> v2:172.21.15.146:3300/0 conn(0x7f2bec063d80 0x7f2bec066ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:23.257 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.249+0000 7f2be9d9b700 1 -- 172.21.15.192:0/218169652 >> v1:172.21.15.146:6789/0 conn(0x7f2bec0673c0 legacy=0x7f2bec0bb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:23.257 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.249+0000 7f2be9d9b700 1 -- 172.21.15.192:0/218169652 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bec151d00 con 0x7f2bec0639a0 2020-11-20T11:48:23.257 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.249+0000 7f2be9d9b700 1 -- 172.21.15.192:0/218169652 <== mon.2 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3985397220 0 0) 0x7f2bdc001520 con 0x7f2bec0639a0 2020-11-20T11:48:23.258 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.249+0000 7f2be9d9b700 1 -- 172.21.15.192:0/218169652 >> v1:172.21.15.192:6789/0 conn(0x7f2bec0639a0 legacy=0x7f2bec151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:23.258 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.249+0000 7f2be9d9b700 1 --2- 172.21.15.192:0/218169652 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bcc0037c0 0x7f2bcc003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:23.258 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.249+0000 7f2be9d9b700 1 --2- 172.21.15.192:0/218169652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bcc004520 0x7f2bcc0049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:23.258 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.249+0000 7f2be9d9b700 1 --2- 172.21.15.192:0/218169652 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bcc004e90 0x7f2bcc00b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:23.258 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.249+0000 7f2be9d9b700 1 -- 172.21.15.192:0/218169652 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bec151a60 con 0x7f2bcc004e90 2020-11-20T11:48:23.259 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.249+0000 7f2be9d9b700 1 -- 172.21.15.192:0/218169652 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bcc005340 con 0x7f2bcc0037c0 2020-11-20T11:48:23.259 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.249+0000 7f2be9d9b700 1 -- 172.21.15.192:0/218169652 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bcc00bc60 con 0x7f2bcc004520 2020-11-20T11:48:23.259 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.249+0000 7f2be3fff700 1 --2- 172.21.15.192:0/218169652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bcc004520 0x7f2bcc0049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:23.259 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.249+0000 7f2bea59c700 1 --2- 172.21.15.192:0/218169652 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bcc0037c0 0x7f2bcc003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:23.259 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.249+0000 7f2be3fff700 1 -- 172.21.15.192:0/218169652 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bcc0037c0 msgr2=0x7f2bcc003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:23.260 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.249+0000 7f2be3fff700 1 --2- 172.21.15.192:0/218169652 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bcc0037c0 0x7f2bcc003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:23.260 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.249+0000 7f2be3fff700 1 -- 172.21.15.192:0/218169652 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bcc004e90 msgr2=0x7f2bcc00b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:23.260 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.249+0000 7f2be3fff700 1 --2- 172.21.15.192:0/218169652 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bcc004e90 0x7f2bcc00b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T11:48:23.260 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.249+0000 7f2be3fff700 1 -- 172.21.15.192:0/218169652 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bcc003280 con 0x7f2bcc004520 2020-11-20T11:48:23.260 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.249+0000 7f2bead9d700 1 -- 172.21.15.192:0/218169652 reap_dead start 2020-11-20T11:48:23.261 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.249+0000 7f2be3fff700 1 --2- 172.21.15.192:0/218169652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bcc004520 0x7f2bcc0049a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f2bd400bc40 tx=0x7f2bd4006e30).ready entity=mon.2 client_cookie=38b0b685d07c122f server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:23.261 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.249+0000 7f2be9d9b700 1 -- 172.21.15.192:0/218169652 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd400b350 con 0x7f2bcc004520 2020-11-20T11:48:23.261 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.249+0000 7f2be9d9b700 1 -- 172.21.15.192:0/218169652 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd400ea00 con 0x7f2bcc004520 2020-11-20T11:48:23.261 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.249+0000 7f2be9d9b700 1 -- 172.21.15.192:0/218169652 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd400ed80 con 0x7f2bcc004520 2020-11-20T11:48:23.261 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.250+0000 7f2beb59e700 1 -- 172.21.15.192:0/218169652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bcc004520 msgr2=0x7f2bcc0049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:23.262 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.250+0000 7f2beb59e700 1 --2- 172.21.15.192:0/218169652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bcc004520 0x7f2bcc0049a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f2bd400bc40 tx=0x7f2bd4006e30).stop 2020-11-20T11:48:23.262 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.250+0000 7f2beb59e700 1 -- 172.21.15.192:0/218169652 shutdown_connections 2020-11-20T11:48:23.262 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.250+0000 7f2beb59e700 1 --2- 172.21.15.192:0/218169652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bcc004520 0x7f2bcc0049a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:23.262 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.250+0000 7f2beb59e700 1 -- 172.21.15.192:0/218169652 >> 172.21.15.192:0/218169652 conn(0x7f2bec060c80 msgr2=0x7f2bec0c5600 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:23.262 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.250+0000 7f2beb59e700 1 -- 172.21.15.192:0/218169652 shutdown_connections 2020-11-20T11:48:23.263 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.250+0000 7f2beb59e700 1 -- 172.21.15.192:0/218169652 wait complete. 2020-11-20T11:48:23.263 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.251+0000 7f2beb59e700 1 Processor -- start 2020-11-20T11:48:23.263 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.251+0000 7f2beb59e700 1 -- start start 2020-11-20T11:48:23.266 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.252+0000 7f2beb59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bcc004520 0x7f2bec0bc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:23.266 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.252+0000 7f2beb59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bec150a70 0x7f2bec160e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:23.266 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.252+0000 7f2beb59e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bec0bd190 0x7f2bec154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:23.266 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.252+0000 7f2beb59e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bec0bccc0 con 0x7f2bec0bd190 2020-11-20T11:48:23.267 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.252+0000 7f2beb59e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bec153440 con 0x7f2bec150a70 2020-11-20T11:48:23.267 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.252+0000 7f2beb59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bec1536e0 con 0x7f2bcc004520 2020-11-20T11:48:23.267 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.252+0000 7f2bea59c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bcc004520 0x7f2bec0bc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:23.267 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.252+0000 7f2bea59c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bcc004520 0x7f2bec0bc640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49530/0 (socket says 172.21.15.192:49530) 2020-11-20T11:48:23.267 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.252+0000 7f2bea59c700 1 -- 172.21.15.192:0/2989706068 learned_addr learned my addr 172.21.15.192:0/2989706068 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:23.268 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.252+0000 7f2be3fff700 1 --2- 172.21.15.192:0/2989706068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bec150a70 0x7f2bec160e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:23.268 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.252+0000 7f2bea59c700 1 -- 172.21.15.192:0/2989706068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bec150a70 msgr2=0x7f2bec160e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:23.268 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.252+0000 7f2bea59c700 1 --2- 172.21.15.192:0/2989706068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bec150a70 0x7f2bec160e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:23.268 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.252+0000 7f2bea59c700 1 -- 172.21.15.192:0/2989706068 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bec0bd190 msgr2=0x7f2bec154670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:23.268 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.252+0000 7f2bea59c700 1 --2- 172.21.15.192:0/2989706068 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bec0bd190 0x7f2bec154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:48:23.269 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.252+0000 7f2bea59c700 1 -- 172.21.15.192:0/2989706068 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bec153980 con 0x7f2bcc004520 2020-11-20T11:48:23.269 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.252+0000 7f2bea59c700 1 --2- 172.21.15.192:0/2989706068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bcc004520 0x7f2bec0bc640 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f2bdc004b20 tx=0x7f2bec151e90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:23.269 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.252+0000 7f2be27fc700 1 -- 172.21.15.192:0/2989706068 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc00fa30 con 0x7f2bcc004520 2020-11-20T11:48:23.269 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.252+0000 7f2be27fc700 1 -- 172.21.15.192:0/2989706068 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bdc00fb90 con 0x7f2bcc004520 2020-11-20T11:48:23.270 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.252+0000 7f2beb59e700 1 -- 172.21.15.192:0/2989706068 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bec1541d0 con 0x7f2bcc004520 2020-11-20T11:48:23.270 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.252+0000 7f2be27fc700 1 -- 172.21.15.192:0/2989706068 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc012350 con 0x7f2bcc004520 2020-11-20T11:48:23.270 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.252+0000 7f2beb59e700 1 -- 172.21.15.192:0/2989706068 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bec14ebb0 con 0x7f2bcc004520 2020-11-20T11:48:23.270 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.253+0000 7f2beb59e700 1 -- 172.21.15.192:0/2989706068 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bec154030 con 0x7f2bcc004520 2020-11-20T11:48:23.270 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.254+0000 7f2be27fc700 1 -- 172.21.15.192:0/2989706068 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f2bdc01b030 con 0x7f2bcc004520 2020-11-20T11:48:23.270 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.254+0000 7f2be27fc700 1 --2- 172.21.15.192:0/2989706068 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f2bc80806a0 0x7f2bc8082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:23.271 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.255+0000 7f2be27fc700 1 -- 172.21.15.192:0/2989706068 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f2bdc0a2310 con 0x7f2bcc004520 2020-11-20T11:48:23.271 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.255+0000 7f2be3fff700 1 --2- 172.21.15.192:0/2989706068 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f2bc80806a0 0x7f2bc8082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:23.271 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.255+0000 7f2be3fff700 1 --2- 172.21.15.192:0/2989706068 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f2bc80806a0 0x7f2bc8082b60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f2bec0bf680 tx=0x7f2bd4019000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:23.271 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.258+0000 7f2be27fc700 1 -- 172.21.15.192:0/2989706068 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f2bec154030 con 0x7f2bcc004520 2020-11-20T11:48:23.402 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.398+0000 7f2beb59e700 1 -- 172.21.15.192:0/2989706068 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2bec154030 con 0x7f2bcc004520 2020-11-20T11:48:23.403 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.399+0000 7f2be27fc700 1 -- 172.21.15.192:0/2989706068 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+10 (secure 0 0 0) 0x7f2bec154030 con 0x7f2bcc004520 2020-11-20T11:48:23.403 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 8 2020-11-20T11:48:23.404 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.400+0000 7f2beb59e700 1 -- 172.21.15.192:0/2989706068 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f2bc80806a0 msgr2=0x7f2bc8082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:23.404 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.400+0000 7f2beb59e700 1 --2- 172.21.15.192:0/2989706068 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f2bc80806a0 0x7f2bc8082b60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f2bec0bf680 tx=0x7f2bd4019000).stop 2020-11-20T11:48:23.404 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.400+0000 7f2beb59e700 1 -- 172.21.15.192:0/2989706068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bcc004520 msgr2=0x7f2bec0bc640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:23.405 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.400+0000 7f2beb59e700 1 --2- 172.21.15.192:0/2989706068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bcc004520 0x7f2bec0bc640 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f2bdc004b20 tx=0x7f2bec151e90).stop 2020-11-20T11:48:23.405 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.400+0000 7f2beb59e700 1 -- 172.21.15.192:0/2989706068 shutdown_connections 2020-11-20T11:48:23.405 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.400+0000 7f2beb59e700 1 --2- 172.21.15.192:0/2989706068 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f2bc80806a0 0x7f2bc8082b60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:23.405 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.400+0000 7f2beb59e700 1 --2- 172.21.15.192:0/2989706068 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bec0bd190 0x7f2bec154670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:48:23.405 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.400+0000 7f2beb59e700 1 --2- 172.21.15.192:0/2989706068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bcc004520 0x7f2bec0bc640 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:23.406 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.400+0000 7f2beb59e700 1 --2- 172.21.15.192:0/2989706068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bec150a70 0x7f2bec160e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:23.406 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.400+0000 7f2beb59e700 1 -- 172.21.15.192:0/2989706068 >> 172.21.15.192:0/2989706068 conn(0x7f2bec060c80 msgr2=0x7f2bec0662d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:23.406 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.400+0000 7f2beb59e700 1 -- 172.21.15.192:0/2989706068 shutdown_connections 2020-11-20T11:48:23.406 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.400+0000 7f2beb59e700 1 -- 172.21.15.192:0/2989706068 wait complete. 2020-11-20T11:48:23.415 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-11-20T11:48:23.523 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.520+0000 7fda53775700 1 Processor -- start 2020-11-20T11:48:23.523 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.520+0000 7fda53775700 1 -- start start 2020-11-20T11:48:23.525 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.521+0000 7fda53775700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fda4c060370 0x7fda4c060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:23.526 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.521+0000 7fda53775700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fda4c154920 0x7fda4c064c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:23.526 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.521+0000 7fda53775700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda4c065130 con 0x7fda4c0c2340 2020-11-20T11:48:23.526 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.521+0000 7fda53775700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda4c151e80 con 0x7fda4c154920 2020-11-20T11:48:23.526 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.521+0000 7fda53775700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda4c152120 con 0x7fda4c060370 2020-11-20T11:48:23.526 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.521+0000 7fda51511700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fda4c060370 0x7fda4c060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:23.527 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.521+0000 7fda51d12700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fda4c0c2340 0x7fda4c151340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52208/0 (socket says 172.21.15.192:52208) 2020-11-20T11:48:23.527 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.521+0000 7fda51d12700 1 -- 172.21.15.192:0/1165801251 learned_addr learned my addr 172.21.15.192:0/1165801251 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:23.527 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.521+0000 7fda50d10700 1 --2- 172.21.15.192:0/1165801251 >> v2:172.21.15.146:3300/0 conn(0x7fda4c154920 0x7fda4c064c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:23.527 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.521+0000 7fda51511700 1 -- 172.21.15.192:0/1165801251 >> v2:172.21.15.146:3300/0 conn(0x7fda4c154920 msgr2=0x7fda4c064c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:23.527 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.521+0000 7fda51511700 1 --2- 172.21.15.192:0/1165801251 >> v2:172.21.15.146:3300/0 conn(0x7fda4c154920 0x7fda4c064c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:23.528 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.521+0000 7fda51511700 1 -- 172.21.15.192:0/1165801251 >> v1:172.21.15.192:6789/0 conn(0x7fda4c0c2340 legacy=0x7fda4c151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:23.528 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.521+0000 7fda51511700 1 -- 172.21.15.192:0/1165801251 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda4c064260 con 0x7fda4c060370 2020-11-20T11:48:23.528 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.521+0000 7fda50d10700 1 --2- 172.21.15.192:0/1165801251 >> v2:172.21.15.146:3300/0 conn(0x7fda4c154920 0x7fda4c064c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:48:23.528 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.521+0000 7fda4bfff700 1 -- 172.21.15.192:0/1165801251 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1737127361 0 0) 0x7fda4c065130 con 0x7fda4c0c2340 2020-11-20T11:48:23.528 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.521+0000 7fda51511700 1 --2- 172.21.15.192:0/1165801251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda4c060370 0x7fda4c060750 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fda4c0c5450 tx=0x7fda3c006e30).ready entity=mon.2 client_cookie=8bd0d197459f359b server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:23.530 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.522+0000 7fda4bfff700 1 -- 172.21.15.192:0/1165801251 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c009840 con 0x7fda4c060370 2020-11-20T11:48:23.530 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.522+0000 7fda4bfff700 1 -- 172.21.15.192:0/1165801251 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3c000e90 con 0x7fda4c060370 2020-11-20T11:48:23.530 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.522+0000 7fda4bfff700 1 -- 172.21.15.192:0/1165801251 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c009bb0 con 0x7fda4c060370 2020-11-20T11:48:23.530 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.522+0000 7fda53775700 1 -- 172.21.15.192:0/1165801251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda4c060370 msgr2=0x7fda4c060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:23.530 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.522+0000 7fda53775700 1 --2- 172.21.15.192:0/1165801251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda4c060370 0x7fda4c060750 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fda4c0c5450 tx=0x7fda3c006e30).stop 2020-11-20T11:48:23.531 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.522+0000 7fda53775700 1 -- 172.21.15.192:0/1165801251 shutdown_connections 2020-11-20T11:48:23.531 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.522+0000 7fda53775700 1 --2- 172.21.15.192:0/1165801251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda4c060370 0x7fda4c060750 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:23.531 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.522+0000 7fda53775700 1 --2- 172.21.15.192:0/1165801251 >> v2:172.21.15.146:3300/0 conn(0x7fda4c154920 0x7fda4c064c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:23.531 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.522+0000 7fda53775700 1 -- 172.21.15.192:0/1165801251 >> 172.21.15.192:0/1165801251 conn(0x7fda4c062100 msgr2=0x7fda4c0c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:23.531 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.522+0000 7fda53775700 1 -- 172.21.15.192:0/1165801251 shutdown_connections 2020-11-20T11:48:23.532 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.522+0000 7fda53775700 1 -- 172.21.15.192:0/1165801251 wait complete. 2020-11-20T11:48:23.537 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.523+0000 7fda53775700 1 Processor -- start 2020-11-20T11:48:23.537 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.523+0000 7fda53775700 1 -- start start 2020-11-20T11:48:23.538 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.524+0000 7fda53775700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda4c060370 0x7fda4c0c0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:23.538 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.524+0000 7fda53775700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda4c0c2340 0x7fda4c0c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:23.538 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.524+0000 7fda53775700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda4c154920 0x7fda4c0c7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:23.538 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.524+0000 7fda53775700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4c0c0a60 con 0x7fda4c0c2340 2020-11-20T11:48:23.538 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.524+0000 7fda53775700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4c0b0880 con 0x7fda4c154920 2020-11-20T11:48:23.539 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.524+0000 7fda53775700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4c0b0b20 con 0x7fda4c060370 2020-11-20T11:48:23.539 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.524+0000 7fda51511700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda4c060370 0x7fda4c0c0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:23.539 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.524+0000 7fda51511700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda4c060370 0x7fda4c0c0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49546/0 (socket says 172.21.15.192:49546) 2020-11-20T11:48:23.539 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.524+0000 7fda51511700 1 -- 172.21.15.192:0/3868447854 learned_addr learned my addr 172.21.15.192:0/3868447854 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:23.540 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.524+0000 7fda50d10700 1 --2- 172.21.15.192:0/3868447854 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda4c0c2340 0x7fda4c0c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:23.540 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.524+0000 7fda51511700 1 -- 172.21.15.192:0/3868447854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda4c154920 msgr2=0x7fda4c0c7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:23.540 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.524+0000 7fda51511700 1 --2- 172.21.15.192:0/3868447854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda4c154920 0x7fda4c0c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:48:23.541 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.524+0000 7fda51511700 1 -- 172.21.15.192:0/3868447854 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda4c0c2340 msgr2=0x7fda4c0c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:23.541 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.524+0000 7fda51511700 1 --2- 172.21.15.192:0/3868447854 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda4c0c2340 0x7fda4c0c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:23.541 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.524+0000 7fda51511700 1 -- 172.21.15.192:0/3868447854 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda4c0bfb90 con 0x7fda4c060370 2020-11-20T11:48:23.541 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.525+0000 7fda51511700 1 --2- 172.21.15.192:0/3868447854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda4c060370 0x7fda4c0c0570 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fda4c152260 tx=0x7fda3c015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:23.541 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.525+0000 7fda497fa700 1 -- 172.21.15.192:0/3868447854 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c006b60 con 0x7fda4c060370 2020-11-20T11:48:23.542 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.525+0000 7fda497fa700 1 -- 172.21.15.192:0/3868447854 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3c01e460 con 0x7fda4c060370 2020-11-20T11:48:23.542 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.525+0000 7fda53775700 1 -- 172.21.15.192:0/3868447854 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda4c0bfe30 con 0x7fda4c060370 2020-11-20T11:48:23.542 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.525+0000 7fda497fa700 1 -- 172.21.15.192:0/3868447854 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c01e7e0 con 0x7fda4c060370 2020-11-20T11:48:23.542 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.525+0000 7fda53775700 1 -- 172.21.15.192:0/3868447854 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda4c0c5cc0 con 0x7fda4c060370 2020-11-20T11:48:23.542 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.526+0000 7fda53775700 1 -- 172.21.15.192:0/3868447854 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda4c0699a0 con 0x7fda4c060370 2020-11-20T11:48:23.543 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.526+0000 7fda497fa700 1 -- 172.21.15.192:0/3868447854 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fda3c025030 con 0x7fda4c060370 2020-11-20T11:48:23.543 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.527+0000 7fda497fa700 1 --2- 172.21.15.192:0/3868447854 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fda24080670 0x7fda24082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:23.543 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.527+0000 7fda497fa700 1 -- 172.21.15.192:0/3868447854 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fda3c0a4130 con 0x7fda4c060370 2020-11-20T11:48:23.543 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.527+0000 7fda50d10700 1 --2- 172.21.15.192:0/3868447854 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fda24080670 0x7fda24082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:23.543 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.527+0000 7fda50d10700 1 --2- 172.21.15.192:0/3868447854 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fda24080670 0x7fda24082b30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fda4c14e5f0 tx=0x7fda40008040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:23.544 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.530+0000 7fda497fa700 1 -- 172.21.15.192:0/3868447854 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fda3c078b40 con 0x7fda4c060370 2020-11-20T11:48:23.720 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.717+0000 7fda53775700 1 -- 172.21.15.192:0/3868447854 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda4c05ca80 con 0x7fda4c060370 2020-11-20T11:48:23.721 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.718+0000 7fda497fa700 1 -- 172.21.15.192:0/3868447854 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2483 (secure 0 0 0) 0x7fda3c023020 con 0x7fda4c060370 2020-11-20T11:48:23.722 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:48:23.722 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4296,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/3791880310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3791880310},{"type":"v1","addr":"172.21.15.87:6833","nonce":3791880310}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":2},{"gid":4307,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/56648167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":56648167},{"type":"v1","addr":"172.21.15.192:6835","nonce":56648167}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-11-20T11:48:09.832534+0000","modified":"2020-11-20T11:48:11.842814+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4319":{"gid":4319,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6833/1982840368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1982840368},{"type":"v1","addr":"172.21.15.146:6833","nonce":1982840368}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-11-20T11:48:23.723 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.719+0000 7fda53775700 1 -- 172.21.15.192:0/3868447854 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fda24080670 msgr2=0x7fda24082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:23.723 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.719+0000 7fda53775700 1 --2- 172.21.15.192:0/3868447854 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fda24080670 0x7fda24082b30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fda4c14e5f0 tx=0x7fda40008040).stop 2020-11-20T11:48:23.723 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.719+0000 7fda53775700 1 -- 172.21.15.192:0/3868447854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda4c060370 msgr2=0x7fda4c0c0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:23.724 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.719+0000 7fda53775700 1 --2- 172.21.15.192:0/3868447854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda4c060370 0x7fda4c0c0570 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fda4c152260 tx=0x7fda3c015000).stop 2020-11-20T11:48:23.724 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.719+0000 7fda53775700 1 -- 172.21.15.192:0/3868447854 shutdown_connections 2020-11-20T11:48:23.724 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.719+0000 7fda53775700 1 --2- 172.21.15.192:0/3868447854 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fda24080670 0x7fda24082b30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:23.724 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.719+0000 7fda53775700 1 --2- 172.21.15.192:0/3868447854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fda4c154920 0x7fda4c0c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T11:48:23.725 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.719+0000 7fda53775700 1 --2- 172.21.15.192:0/3868447854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda4c060370 0x7fda4c0c0570 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:23.725 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.719+0000 7fda53775700 1 --2- 172.21.15.192:0/3868447854 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fda4c0c2340 0x7fda4c0c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:23.725 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.719+0000 7fda53775700 1 -- 172.21.15.192:0/3868447854 >> 172.21.15.192:0/3868447854 conn(0x7fda4c062100 msgr2=0x7fda4c14d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:23.726 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.719+0000 7fda53775700 1 -- 172.21.15.192:0/3868447854 shutdown_connections 2020-11-20T11:48:23.726 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:23.719+0000 7fda53775700 1 -- 172.21.15.192:0/3868447854 wait complete. 2020-11-20T11:48:23.726 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 6 2020-11-20T11:48:24.035 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-11-20T11:48:09.832534+0000', 'modified': '2020-11-20T11:48:11.842814+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4319}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4319': {'gid': 4319, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6833/1982840368', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6832', 'nonce': 1982840368}, {'type': 'v1', 'addr': '172.21.15.146:6833', 'nonce': 1982840368}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138297136906239, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-11-20T11:48:24.035 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-11-20T11:48:24.036 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2020-11-20T11:48:24.176 INFO:teuthology.orchestra.run.smithi146.stdout:{"cluster_fsid":"4871390d-d110-4379-8302-5810d7b54f34","whoami":0,"id":4319,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":14.329415242,"mdsmap_epoch":6,"osdmap_epoch":28,"osdmap_epoch_barrier":28,"uptime":20.703178506} 2020-11-20T11:48:24.177 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "4871390d-d110-4379-8302-5810d7b54f34", "fs_name": "cephfs", "id": 4319, "mdsmap_epoch": 6, "osdmap_epoch": 28, "osdmap_epoch_barrier": 28, "rank_uptime": 14.329415242, "state": "up:active", "uptime": 20.703178506, "want_state": "up:active", "whoami": 0 } 2020-11-20T11:48:24.177 INFO:teuthology.run_tasks:Running task kclient... 2020-11-20T11:48:24.199 INFO:tasks.kclient:Mounting kernel clients... 2020-11-20T11:48:24.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:48:24.200 INFO:teuthology.orchestra.run.smithi192:> ip netns list 2020-11-20T11:48:24.201 INFO:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:48:24.204 INFO:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:48:24.206 INFO:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:48:24.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:48:24.217 INFO:teuthology.orchestra.run.smithi192:> sudo ip link delete ceph-brx 2020-11-20T11:48:24.282 INFO:teuthology.orchestra.run.smithi192.stderr:Cannot find device "ceph-brx" 2020-11-20T11:48:24.283 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T11:48:24.284 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2020-11-20T11:48:24.284 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2020-11-20T11:48:24.285 INFO:tasks.cephfs.mount:self.client.name = client.0 2020-11-20T11:48:24.285 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2020-11-20T11:48:24.285 INFO:tasks.cephfs.mount:self.cephfs_name = None 2020-11-20T11:48:24.286 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2020-11-20T11:48:24.286 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2020-11-20T11:48:24.286 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2020-11-20T11:48:24.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:48:24.287 INFO:teuthology.orchestra.run.smithi192:> ip addr 2020-11-20T11:48:24.376 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-11-20T11:48:24.377 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-11-20T11:48:24.377 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2020-11-20T11:48:24.377 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2020-11-20T11:48:24.377 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2020-11-20T11:48:24.378 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2020-11-20T11:48:24.378 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-11-20T11:48:24.378 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2020-11-20T11:48:24.378 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-11-20T11:48:24.378 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2020-11-20T11:48:24.379 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-11-20T11:48:24.379 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2020-11-20T11:48:24.379 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-11-20T11:48:24.379 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2020-11-20T11:48:24.379 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-11-20T11:48:24.380 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42777sec preferred_lft 42777sec 2020-11-20T11:48:24.380 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link 2020-11-20T11:48:24.380 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2020-11-20T11:48:24.381 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-11-20T11:48:24.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:48:24.381 INFO:teuthology.orchestra.run.smithi192:> (cd / && exec sudo bash -c ' 2020-11-20T11:48:24.382 INFO:teuthology.orchestra.run.smithi192:> set -e 2020-11-20T11:48:24.382 INFO:teuthology.orchestra.run.smithi192:> sudo ip link add name ceph-brx type bridge 2020-11-20T11:48:24.382 INFO:teuthology.orchestra.run.smithi192:> sudo ip addr flush dev ceph-brx 2020-11-20T11:48:24.383 INFO:teuthology.orchestra.run.smithi192:> sudo ip link set ceph-brx up 2020-11-20T11:48:24.383 INFO:teuthology.orchestra.run.smithi192:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2020-11-20T11:48:24.383 INFO:teuthology.orchestra.run.smithi192:> ') 2020-11-20T11:48:24.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:48:24.547 INFO:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2020-11-20T11:48:24.579 INFO:teuthology.orchestra.run.smithi192.stdout:1 2020-11-20T11:48:24.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:48:24.581 INFO:teuthology.orchestra.run.smithi192:> route 2020-11-20T11:48:24.646 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2020-11-20T11:48:24.647 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-11-20T11:48:24.647 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-11-20T11:48:24.647 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2020-11-20T11:48:24.648 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2020-11-20T11:48:24.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:48:24.649 INFO:teuthology.orchestra.run.smithi192:> (cd / && exec sudo bash -c ' 2020-11-20T11:48:24.649 INFO:teuthology.orchestra.run.smithi192:> set -e 2020-11-20T11:48:24.649 INFO:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2020-11-20T11:48:24.649 INFO:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2020-11-20T11:48:24.650 INFO:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2020-11-20T11:48:24.650 INFO:teuthology.orchestra.run.smithi192:> ') 2020-11-20T11:48:24.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:48:24.851 INFO:teuthology.orchestra.run.smithi192:> ip netns list 2020-11-20T11:48:24.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:48:24.891 INFO:teuthology.orchestra.run.smithi192:> ip netns list-id 2020-11-20T11:48:24.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:48:24.959 INFO:teuthology.orchestra.run.smithi192:> (cd / && exec sudo bash -c ' 2020-11-20T11:48:24.959 INFO:teuthology.orchestra.run.smithi192:> set -e 2020-11-20T11:48:24.960 INFO:teuthology.orchestra.run.smithi192:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2020-11-20T11:48:24.960 INFO:teuthology.orchestra.run.smithi192:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2020-11-20T11:48:24.960 INFO:teuthology.orchestra.run.smithi192:> ') 2020-11-20T11:48:25.053 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-11-20T11:48:25.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:48:25.054 INFO:teuthology.orchestra.run.smithi192:> (cd / && exec sudo bash -c ' 2020-11-20T11:48:25.054 INFO:teuthology.orchestra.run.smithi192:> set -e 2020-11-20T11:48:25.055 INFO:teuthology.orchestra.run.smithi192:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2020-11-20T11:48:25.055 INFO:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2020-11-20T11:48:25.055 INFO:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2020-11-20T11:48:25.056 INFO:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2020-11-20T11:48:25.056 INFO:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2020-11-20T11:48:25.056 INFO:teuthology.orchestra.run.smithi192:> ') 2020-11-20T11:48:25.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:48:25.237 INFO:teuthology.orchestra.run.smithi192:> (cd / && exec sudo bash -c ' 2020-11-20T11:48:25.237 INFO:teuthology.orchestra.run.smithi192:> set -e 2020-11-20T11:48:25.237 INFO:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2020-11-20T11:48:25.238 INFO:teuthology.orchestra.run.smithi192:> sudo ip link set dev brx.0 master ceph-brx 2020-11-20T11:48:25.238 INFO:teuthology.orchestra.run.smithi192:> ') 2020-11-20T11:48:25.341 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:48:25.454 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.450+0000 7f64fab38700 1 Processor -- start 2020-11-20T11:48:25.454 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.450+0000 7f64fab38700 1 -- start start 2020-11-20T11:48:25.459 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.451+0000 7f64fab38700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f64f4060370 0x7f64f41519d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:25.460 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.451+0000 7f64fab38700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f40bd980 con 0x7f64f4060750 2020-11-20T11:48:25.460 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.451+0000 7f64fab38700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f414dc50 con 0x7f64f40bce00 2020-11-20T11:48:25.460 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.451+0000 7f64fab38700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64f414def0 con 0x7f64f4060370 2020-11-20T11:48:25.460 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.451+0000 7f64f90d5700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f64f40bce00 0x7f64f40bd270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52224/0 (socket says 172.21.15.192:52224) 2020-11-20T11:48:25.461 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.451+0000 7f64f90d5700 1 -- 172.21.15.192:0/819928788 learned_addr learned my addr 172.21.15.192:0/819928788 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:25.461 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.452+0000 7f64f88d4700 1 --2- 172.21.15.192:0/819928788 >> v2:172.21.15.146:3300/0 conn(0x7f64f4060370 0x7f64f41519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:25.461 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.452+0000 7f64f37fe700 1 -- 172.21.15.192:0/819928788 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3394863427 0 0) 0x7f64f414dc50 con 0x7f64f40bce00 2020-11-20T11:48:25.461 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.452+0000 7f64f37fe700 1 -- 172.21.15.192:0/819928788 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64d8003280 con 0x7f64f40bce00 2020-11-20T11:48:25.461 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.452+0000 7f64f37fe700 1 -- 172.21.15.192:0/819928788 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1066381509 0 0) 0x7f64e0001110 con 0x7f64f4060750 2020-11-20T11:48:25.462 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.452+0000 7f64f37fe700 1 -- 172.21.15.192:0/819928788 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64f414dc50 con 0x7f64f4060750 2020-11-20T11:48:25.462 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.452+0000 7f64f37fe700 1 -- 172.21.15.192:0/819928788 <== mon.2 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3282912272 0 0) 0x7f64d8003280 con 0x7f64f40bce00 2020-11-20T11:48:25.462 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.452+0000 7f64f37fe700 1 -- 172.21.15.192:0/819928788 >> v2:172.21.15.146:3300/0 conn(0x7f64f4060370 msgr2=0x7f64f41519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:25.462 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.452+0000 7f64f37fe700 1 --2- 172.21.15.192:0/819928788 >> v2:172.21.15.146:3300/0 conn(0x7f64f4060370 0x7f64f41519d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:25.462 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.452+0000 7f64f37fe700 1 -- 172.21.15.192:0/819928788 >> v1:172.21.15.87:6789/0 conn(0x7f64f4060750 legacy=0x7f64f40bbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:25.463 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.452+0000 7f64f37fe700 1 -- 172.21.15.192:0/819928788 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f414e190 con 0x7f64f40bce00 2020-11-20T11:48:25.463 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.452+0000 7f64f37fe700 1 -- 172.21.15.192:0/819928788 <== mon.2 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3985397220 0 0) 0x7f64ec0018a0 con 0x7f64f40bce00 2020-11-20T11:48:25.463 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.452+0000 7f64f37fe700 1 -- 172.21.15.192:0/819928788 >> v1:172.21.15.192:6789/0 conn(0x7f64f40bce00 legacy=0x7f64f40bd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:25.463 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.452+0000 7f64f37fe700 1 --2- 172.21.15.192:0/819928788 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64d8003950 0x7f64d8003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:25.463 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.452+0000 7f64f37fe700 1 --2- 172.21.15.192:0/819928788 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64d8004520 0x7f64d80049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:25.464 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.452+0000 7f64f37fe700 1 --2- 172.21.15.192:0/819928788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64d8004e90 0x7f64d800b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:25.464 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.452+0000 7f64f37fe700 1 -- 172.21.15.192:0/819928788 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f414def0 con 0x7f64d8004520 2020-11-20T11:48:25.464 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.452+0000 7f64f37fe700 1 -- 172.21.15.192:0/819928788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d800bc60 con 0x7f64d8004e90 2020-11-20T11:48:25.464 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.452+0000 7f64f37fe700 1 -- 172.21.15.192:0/819928788 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d800bda0 con 0x7f64d8003950 2020-11-20T11:48:25.464 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.452+0000 7f64f88d4700 1 --2- 172.21.15.192:0/819928788 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64d8003950 0x7f64d8003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:25.465 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.452+0000 7f64f3fff700 1 --2- 172.21.15.192:0/819928788 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64d8004520 0x7f64d80049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:25.465 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.452+0000 7f64f90d5700 1 --2- 172.21.15.192:0/819928788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64d8004e90 0x7f64d800b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:25.465 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.452+0000 7f64f88d4700 1 -- 172.21.15.192:0/819928788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64d8004e90 msgr2=0x7f64d800b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:25.465 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.452+0000 7f64f88d4700 1 --2- 172.21.15.192:0/819928788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64d8004e90 0x7f64d800b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:25.465 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.453+0000 7f64f88d4700 1 -- 172.21.15.192:0/819928788 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64d8004520 msgr2=0x7f64d80049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:25.466 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.453+0000 7f64f88d4700 1 --2- 172.21.15.192:0/819928788 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64d8004520 0x7f64d80049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:25.466 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.453+0000 7f64f90d5700 1 -- 172.21.15.192:0/819928788 reap_dead start 2020-11-20T11:48:25.466 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.453+0000 7f64f88d4700 1 -- 172.21.15.192:0/819928788 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d8003280 con 0x7f64d8003950 2020-11-20T11:48:25.466 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.453+0000 7f64f88d4700 1 --2- 172.21.15.192:0/819928788 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64d8003950 0x7f64d8003d50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f64e800cd20 tx=0x7f64e8006ec0).ready entity=mon.2 client_cookie=c62cf286491c0880 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:25.466 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.453+0000 7f64f37fe700 1 -- 172.21.15.192:0/819928788 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e800ce80 con 0x7f64d8003950 2020-11-20T11:48:25.467 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.453+0000 7f64f37fe700 1 -- 172.21.15.192:0/819928788 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e800c440 con 0x7f64d8003950 2020-11-20T11:48:25.467 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.453+0000 7f64f37fe700 1 -- 172.21.15.192:0/819928788 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e8010cd0 con 0x7f64d8003950 2020-11-20T11:48:25.467 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.453+0000 7f64fab38700 1 -- 172.21.15.192:0/819928788 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64d8003950 msgr2=0x7f64d8003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:25.467 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.453+0000 7f64fab38700 1 --2- 172.21.15.192:0/819928788 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64d8003950 0x7f64d8003d50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f64e800cd20 tx=0x7f64e8006ec0).stop 2020-11-20T11:48:25.467 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.453+0000 7f64fab38700 1 -- 172.21.15.192:0/819928788 shutdown_connections 2020-11-20T11:48:25.468 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.453+0000 7f64fab38700 1 --2- 172.21.15.192:0/819928788 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64d8003950 0x7f64d8003d50 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:25.468 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.453+0000 7f64fab38700 1 -- 172.21.15.192:0/819928788 >> 172.21.15.192:0/819928788 conn(0x7f64f4062100 msgr2=0x7f64f40c3590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:25.468 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.453+0000 7f64fab38700 1 -- 172.21.15.192:0/819928788 shutdown_connections 2020-11-20T11:48:25.468 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.453+0000 7f64fab38700 1 -- 172.21.15.192:0/819928788 wait complete. 2020-11-20T11:48:25.468 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.454+0000 7f64fab38700 1 Processor -- start 2020-11-20T11:48:25.469 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.455+0000 7f64fab38700 1 -- start start 2020-11-20T11:48:25.469 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.455+0000 7f64fab38700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64d8003950 0x7f64f40c1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:25.469 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.455+0000 7f64fab38700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64f4160a40 0x7f64f40b2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:25.469 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.455+0000 7f64fab38700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64f40c1a70 0x7f64f40b2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:25.469 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.455+0000 7f64fab38700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f415c800 con 0x7f64f4160a40 2020-11-20T11:48:25.470 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.455+0000 7f64fab38700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f415c9e0 con 0x7f64d8003950 2020-11-20T11:48:25.470 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.455+0000 7f64fab38700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f415cc80 con 0x7f64f40c1a70 2020-11-20T11:48:25.470 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.456+0000 7f64f90d5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64f40c1a70 0x7f64f40b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:25.470 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.456+0000 7f64f90d5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64f40c1a70 0x7f64f40b2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49568/0 (socket says 172.21.15.192:49568) 2020-11-20T11:48:25.470 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.456+0000 7f64f90d5700 1 -- 172.21.15.192:0/412174468 learned_addr learned my addr 172.21.15.192:0/412174468 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:25.470 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.456+0000 7f64f88d4700 1 --2- 172.21.15.192:0/412174468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64d8003950 0x7f64f40c1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:25.471 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.456+0000 7f64f3fff700 1 --2- 172.21.15.192:0/412174468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64f4160a40 0x7f64f40b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:25.471 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.456+0000 7f64f90d5700 1 -- 172.21.15.192:0/412174468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64d8003950 msgr2=0x7f64f40c1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:25.471 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.456+0000 7f64f90d5700 1 --2- 172.21.15.192:0/412174468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64d8003950 0x7f64f40c1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:25.471 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.456+0000 7f64f90d5700 1 -- 172.21.15.192:0/412174468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64f4160a40 msgr2=0x7f64f40b2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:25.471 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.456+0000 7f64f90d5700 1 --2- 172.21.15.192:0/412174468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64f4160a40 0x7f64f40b2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:25.472 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.456+0000 7f64f90d5700 1 -- 172.21.15.192:0/412174468 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f415cf20 con 0x7f64f40c1a70 2020-11-20T11:48:25.472 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.456+0000 7f64f90d5700 1 --2- 172.21.15.192:0/412174468 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64f40c1a70 0x7f64f40b2930 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f64f4063c70 tx=0x7f64f40666b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:25.472 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.456+0000 7f64f0ff9700 1 -- 172.21.15.192:0/412174468 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec00f9d0 con 0x7f64f40c1a70 2020-11-20T11:48:25.472 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.456+0000 7f64f0ff9700 1 -- 172.21.15.192:0/412174468 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ec00fb30 con 0x7f64f40c1a70 2020-11-20T11:48:25.472 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.456+0000 7f64fab38700 1 -- 172.21.15.192:0/412174468 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64f415d1c0 con 0x7f64f40c1a70 2020-11-20T11:48:25.473 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.456+0000 7f64f0ff9700 1 -- 172.21.15.192:0/412174468 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec00feb0 con 0x7f64f40c1a70 2020-11-20T11:48:25.473 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.456+0000 7f64fab38700 1 -- 172.21.15.192:0/412174468 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64f40b2e20 con 0x7f64f40c1a70 2020-11-20T11:48:25.474 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.457+0000 7f64fab38700 1 -- 172.21.15.192:0/412174468 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64f415d540 con 0x7f64f40c1a70 2020-11-20T11:48:25.475 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.458+0000 7f64f0ff9700 1 -- 172.21.15.192:0/412174468 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f64ec012560 con 0x7f64f40c1a70 2020-11-20T11:48:25.475 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.458+0000 7f64f0ff9700 1 --2- 172.21.15.192:0/412174468 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f64cc080670 0x7f64cc082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:25.475 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.458+0000 7f64f0ff9700 1 -- 172.21.15.192:0/412174468 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f64ec0a21b0 con 0x7f64f40c1a70 2020-11-20T11:48:25.475 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.458+0000 7f64f88d4700 1 --2- 172.21.15.192:0/412174468 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f64cc080670 0x7f64cc082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:25.475 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.459+0000 7f64f88d4700 1 --2- 172.21.15.192:0/412174468 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f64cc080670 0x7f64cc082b30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f64e8006f00 tx=0x7f64e801a000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:25.476 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.462+0000 7f64f0ff9700 1 -- 172.21.15.192:0/412174468 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f64ec044fd0 con 0x7f64f40c1a70 2020-11-20T11:48:25.606 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.603+0000 7f64fab38700 1 -- 172.21.15.192:0/412174468 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64f414a6c0 con 0x7f64f40c1a70 2020-11-20T11:48:25.607 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.604+0000 7f64f0ff9700 1 -- 172.21.15.192:0/412174468 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21795 (secure 0 0 0) 0x7f64ec019020 con 0x7f64f40c1a70 2020-11-20T11:48:25.608 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:48:25.608 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":28,"fsid":"4871390d-d110-4379-8302-5810d7b54f34","created":"2020-11-20T11:47:49.059675+0000","modified":"2020-11-20T11:48:09.832333+0000","last_up_change":"2020-11-20T11:47:57.317253+0000","last_in_change":"2020-11-20T11:47:57.317253+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:47:52.327778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:48:01.912951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:48:04.793810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:48:07.506705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77a5e1d9-0fb0-450c-872e-4aee77dede49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":23242},{"type":"v1","addr":"172.21.15.192:6827","nonce":23242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":23242},{"type":"v1","addr":"172.21.15.192:6829","nonce":23242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":23242},{"type":"v1","addr":"172.21.15.192:6833","nonce":23242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":23242},{"type":"v1","addr":"172.21.15.192:6831","nonce":23242}]},"public_addr":"172.21.15.192:6827/23242","cluster_addr":"172.21.15.192:6829/23242","heartbeat_back_addr":"172.21.15.192:6833/23242","heartbeat_front_addr":"172.21.15.192:6831/23242","state":["exists","up"]},{"osd":1,"uuid":"564330c6-5c45-4ef6-8718-bbfa97848e6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":22856},{"type":"v1","addr":"172.21.15.146:6801","nonce":22856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":22856},{"type":"v1","addr":"172.21.15.146:6803","nonce":22856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":22856},{"type":"v1","addr":"172.21.15.146:6807","nonce":22856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":22856},{"type":"v1","addr":"172.21.15.146:6805","nonce":22856}]},"public_addr":"172.21.15.146:6801/22856","cluster_addr":"172.21.15.146:6803/22856","heartbeat_back_addr":"172.21.15.146:6807/22856","heartbeat_front_addr":"172.21.15.146:6805/22856","state":["exists","up"]},{"osd":2,"uuid":"128ddb77-579b-4fa3-a0cb-7465ad959f3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6815","nonce":23326},{"type":"v1","addr":"172.21.15.87:6817","nonce":23326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":23326},{"type":"v1","addr":"172.21.15.87:6819","nonce":23326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":23326},{"type":"v1","addr":"172.21.15.87:6823","nonce":23326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":23326},{"type":"v1","addr":"172.21.15.87:6821","nonce":23326}]},"public_addr":"172.21.15.87:6817/23326","cluster_addr":"172.21.15.87:6819/23326","heartbeat_back_addr":"172.21.15.87:6823/23326","heartbeat_front_addr":"172.21.15.87:6821/23326","state":["exists","up"]},{"osd":3,"uuid":"4668cfdf-d172-4f30-95b8-ac842108a520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":23243},{"type":"v1","addr":"172.21.15.192:6803","nonce":23243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":23243},{"type":"v1","addr":"172.21.15.192:6805","nonce":23243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":23243},{"type":"v1","addr":"172.21.15.192:6809","nonce":23243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":23243},{"type":"v1","addr":"172.21.15.192:6807","nonce":23243}]},"public_addr":"172.21.15.192:6803/23243","cluster_addr":"172.21.15.192:6805/23243","heartbeat_back_addr":"172.21.15.192:6809/23243","heartbeat_front_addr":"172.21.15.192:6807/23243","state":["exists","up"]},{"osd":4,"uuid":"c4bc8ba5-0d22-49f5-97a6-2ca71e3a8c62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":22857},{"type":"v1","addr":"172.21.15.146:6809","nonce":22857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":22857},{"type":"v1","addr":"172.21.15.146:6811","nonce":22857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":22857},{"type":"v1","addr":"172.21.15.146:6815","nonce":22857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":22857},{"type":"v1","addr":"172.21.15.146:6813","nonce":22857}]},"public_addr":"172.21.15.146:6809/22857","cluster_addr":"172.21.15.146:6811/22857","heartbeat_back_addr":"172.21.15.146:6815/22857","heartbeat_front_addr":"172.21.15.146:6813/22857","state":["exists","up"]},{"osd":5,"uuid":"2d15f1db-e580-4715-9728-8fe5dd7e34d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":23316},{"type":"v1","addr":"172.21.15.87:6801","nonce":23316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":23316},{"type":"v1","addr":"172.21.15.87:6803","nonce":23316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":23316},{"type":"v1","addr":"172.21.15.87:6807","nonce":23316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":23316},{"type":"v1","addr":"172.21.15.87:6805","nonce":23316}]},"public_addr":"172.21.15.87:6801/23316","cluster_addr":"172.21.15.87:6803/23316","heartbeat_back_addr":"172.21.15.87:6807/23316","heartbeat_front_addr":"172.21.15.87:6805/23316","state":["exists","up"]},{"osd":6,"uuid":"a659da2b-bdce-42ac-8b30-b8c69b4c7041","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":23246},{"type":"v1","addr":"172.21.15.192:6811","nonce":23246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":23246},{"type":"v1","addr":"172.21.15.192:6813","nonce":23246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":23246},{"type":"v1","addr":"172.21.15.192:6817","nonce":23246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":23246},{"type":"v1","addr":"172.21.15.192:6815","nonce":23246}]},"public_addr":"172.21.15.192:6811/23246","cluster_addr":"172.21.15.192:6813/23246","heartbeat_back_addr":"172.21.15.192:6817/23246","heartbeat_front_addr":"172.21.15.192:6815/23246","state":["exists","up"]},{"osd":7,"uuid":"d6e41ac5-bab7-49e2-a17a-ef794bcc4a09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":22858},{"type":"v1","addr":"172.21.15.146:6818","nonce":22858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":22858},{"type":"v1","addr":"172.21.15.146:6822","nonce":22858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":22858},{"type":"v1","addr":"172.21.15.146:6830","nonce":22858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":22858},{"type":"v1","addr":"172.21.15.146:6826","nonce":22858}]},"public_addr":"172.21.15.146:6818/22858","cluster_addr":"172.21.15.146:6822/22858","heartbeat_back_addr":"172.21.15.146:6830/22858","heartbeat_front_addr":"172.21.15.146:6826/22858","state":["exists","up"]},{"osd":8,"uuid":"c4907993-7513-4162-974f-07dcb0a260a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":23333},{"type":"v1","addr":"172.21.15.87:6825","nonce":23333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":23333},{"type":"v1","addr":"172.21.15.87:6827","nonce":23333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":23333},{"type":"v1","addr":"172.21.15.87:6831","nonce":23333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":23333},{"type":"v1","addr":"172.21.15.87:6829","nonce":23333}]},"public_addr":"172.21.15.87:6825/23333","cluster_addr":"172.21.15.87:6827/23333","heartbeat_back_addr":"172.21.15.87:6831/23333","heartbeat_front_addr":"172.21.15.87:6829/23333","state":["exists","up"]},{"osd":9,"uuid":"3523676f-c9b8-47ae-86c0-4930dca17831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":23254},{"type":"v1","addr":"172.21.15.192:6819","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":23254},{"type":"v1","addr":"172.21.15.192:6821","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":23254},{"type":"v1","addr":"172.21.15.192:6825","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":23254},{"type":"v1","addr":"172.21.15.192:6823","nonce":23254}]},"public_addr":"172.21.15.192:6819/23254","cluster_addr":"172.21.15.192:6821/23254","heartbeat_back_addr":"172.21.15.192:6825/23254","heartbeat_front_addr":"172.21.15.192:6823/23254","state":["exists","up"]},{"osd":10,"uuid":"88d5c251-0bb1-4624-8fa2-7f3b74bd1bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":22859},{"type":"v1","addr":"172.21.15.146:6819","nonce":22859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6821","nonce":22859},{"type":"v1","addr":"172.21.15.146:6823","nonce":22859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":22859},{"type":"v1","addr":"172.21.15.146:6831","nonce":22859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6825","nonce":22859},{"type":"v1","addr":"172.21.15.146:6827","nonce":22859}]},"public_addr":"172.21.15.146:6819/22859","cluster_addr":"172.21.15.146:6823/22859","heartbeat_back_addr":"172.21.15.146:6831/22859","heartbeat_front_addr":"172.21.15.146:6827/22859","state":["exists","up"]},{"osd":11,"uuid":"31f650d6-ba1e-4f29-92ff-6abee04c0f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":23317},{"type":"v1","addr":"172.21.15.87:6809","nonce":23317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":23317},{"type":"v1","addr":"172.21.15.87:6811","nonce":23317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":23317},{"type":"v1","addr":"172.21.15.87:6816","nonce":23317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":23317},{"type":"v1","addr":"172.21.15.87:6813","nonce":23317}]},"public_addr":"172.21.15.87:6809/23317","cluster_addr":"172.21.15.87:6811/23317","heartbeat_back_addr":"172.21.15.87:6816/23317","heartbeat_front_addr":"172.21.15.87:6813/23317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.538863+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.552293+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.585265+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.505194+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.550032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.558089+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.565622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.587102+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.654330+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.599072+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.645833+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.596236+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:48:25.610 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.605+0000 7f64fab38700 1 -- 172.21.15.192:0/412174468 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f64cc080670 msgr2=0x7f64cc082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:25.610 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.605+0000 7f64fab38700 1 --2- 172.21.15.192:0/412174468 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f64cc080670 0x7f64cc082b30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f64e8006f00 tx=0x7f64e801a000).stop 2020-11-20T11:48:25.610 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.605+0000 7f64fab38700 1 -- 172.21.15.192:0/412174468 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64f40c1a70 msgr2=0x7f64f40b2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:25.611 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.606+0000 7f64fab38700 1 --2- 172.21.15.192:0/412174468 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64f40c1a70 0x7f64f40b2930 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f64f4063c70 tx=0x7f64f40666b0).stop 2020-11-20T11:48:25.611 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.606+0000 7f64fab38700 1 -- 172.21.15.192:0/412174468 shutdown_connections 2020-11-20T11:48:25.611 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.606+0000 7f64fab38700 1 --2- 172.21.15.192:0/412174468 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f64cc080670 0x7f64cc082b30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:25.611 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.606+0000 7f64fab38700 1 --2- 172.21.15.192:0/412174468 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64f40c1a70 0x7f64f40b2930 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:25.611 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.606+0000 7f64fab38700 1 --2- 172.21.15.192:0/412174468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f64d8003950 0x7f64f40c1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:25.612 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.606+0000 7f64fab38700 1 --2- 172.21.15.192:0/412174468 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f64f4160a40 0x7f64f40b2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:25.612 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.606+0000 7f64fab38700 1 -- 172.21.15.192:0/412174468 >> 172.21.15.192:0/412174468 conn(0x7f64f4062100 msgr2=0x7f64f40be4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:25.612 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.606+0000 7f64fab38700 1 -- 172.21.15.192:0/412174468 shutdown_connections 2020-11-20T11:48:25.613 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.606+0000 7f64fab38700 1 -- 172.21.15.192:0/412174468 wait complete. 2020-11-20T11:48:25.620 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-20T11:47:52.327778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-20T11:48:01.912951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-11-20T11:48:04.793810+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-11-20T11:48:07.506705+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-11-20T11:48:25.621 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2020-11-20T11:48:25.732 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.728+0000 7f6ba75cf700 1 Processor -- start 2020-11-20T11:48:25.732 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.729+0000 7f6ba75cf700 1 -- start start 2020-11-20T11:48:25.734 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.729+0000 7f6ba75cf700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6ba0060750 0x7f6ba0064c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:25.734 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.729+0000 7f6ba75cf700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ba0065130 con 0x7f6ba0060370 2020-11-20T11:48:25.734 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.729+0000 7f6ba75cf700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ba0151e80 con 0x7f6ba0154920 2020-11-20T11:48:25.735 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.729+0000 7f6ba75cf700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ba0152120 con 0x7f6ba0060750 2020-11-20T11:48:25.735 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.730+0000 7f6ba5b6c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6ba0060750 0x7f6ba0064c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:25.735 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.730+0000 7f6ba4b6a700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6ba0154920 0x7f6ba0151340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.192:33298/0 (socket says 172.21.15.192:33298) 2020-11-20T11:48:25.735 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.730+0000 7f6ba4b6a700 1 -- 172.21.15.192:0/1079785942 learned_addr learned my addr 172.21.15.192:0/1079785942 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:25.735 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.730+0000 7f6ba536b700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f6ba0060370 0x7f6ba00c2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.192:38956/0 (socket says 172.21.15.192:38956) 2020-11-20T11:48:25.736 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.730+0000 7f6ba5b6c700 1 -- 172.21.15.192:0/1079785942 >> v1:172.21.15.146:6789/0 conn(0x7f6ba0154920 legacy=0x7f6ba0151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:25.736 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.730+0000 7f6ba5b6c700 1 -- 172.21.15.192:0/1079785942 >> v1:172.21.15.87:6789/0 conn(0x7f6ba0060370 legacy=0x7f6ba00c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:25.736 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.730+0000 7f6ba5b6c700 1 -- 172.21.15.192:0/1079785942 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba0064260 con 0x7f6ba0060750 2020-11-20T11:48:25.736 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.730+0000 7f6ba5b6c700 1 --2- 172.21.15.192:0/1079785942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ba0060750 0x7f6ba0064c40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f6b98009ce0 tx=0x7f6b98009220).ready entity=mon.1 client_cookie=75fe8d8b5e0614c server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:25.736 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.730+0000 7f6b8ffff700 1 -- 172.21.15.192:0/1079785942 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9800bc80 con 0x7f6ba0060750 2020-11-20T11:48:25.737 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.730+0000 7f6b8ffff700 1 -- 172.21.15.192:0/1079785942 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9800bde0 con 0x7f6ba0060750 2020-11-20T11:48:25.737 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.730+0000 7f6b8ffff700 1 -- 172.21.15.192:0/1079785942 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b98011610 con 0x7f6ba0060750 2020-11-20T11:48:25.737 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.731+0000 7f6ba75cf700 1 -- 172.21.15.192:0/1079785942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ba0060750 msgr2=0x7f6ba0064c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:25.737 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.731+0000 7f6ba75cf700 1 --2- 172.21.15.192:0/1079785942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ba0060750 0x7f6ba0064c40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f6b98009ce0 tx=0x7f6b98009220).stop 2020-11-20T11:48:25.737 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.731+0000 7f6ba75cf700 1 -- 172.21.15.192:0/1079785942 shutdown_connections 2020-11-20T11:48:25.738 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.731+0000 7f6ba75cf700 1 --2- 172.21.15.192:0/1079785942 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ba0060750 0x7f6ba0064c40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:25.738 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.731+0000 7f6ba75cf700 1 -- 172.21.15.192:0/1079785942 >> 172.21.15.192:0/1079785942 conn(0x7f6ba0062100 msgr2=0x7f6ba00c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:25.738 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.731+0000 7f6ba75cf700 1 -- 172.21.15.192:0/1079785942 shutdown_connections 2020-11-20T11:48:25.738 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.731+0000 7f6ba75cf700 1 -- 172.21.15.192:0/1079785942 wait complete. 2020-11-20T11:48:25.741 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.732+0000 7f6ba75cf700 1 Processor -- start 2020-11-20T11:48:25.741 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.732+0000 7f6ba75cf700 1 -- start start 2020-11-20T11:48:25.741 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.733+0000 7f6ba75cf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ba0060370 0x7f6ba00c19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:25.741 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.733+0000 7f6ba75cf700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ba0060750 0x7f6ba00b4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:25.742 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.733+0000 7f6ba75cf700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ba0154920 0x7f6ba00c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:25.742 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.733+0000 7f6ba75cf700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba00b4b50 con 0x7f6ba0154920 2020-11-20T11:48:25.742 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.733+0000 7f6ba75cf700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba0163d40 con 0x7f6ba0060370 2020-11-20T11:48:25.742 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.733+0000 7f6ba75cf700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba0163fe0 con 0x7f6ba0060750 2020-11-20T11:48:25.742 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.733+0000 7f6ba4b6a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ba0060750 0x7f6ba00b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:25.743 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.733+0000 7f6ba4b6a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ba0060750 0x7f6ba00b4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49578/0 (socket says 172.21.15.192:49578) 2020-11-20T11:48:25.743 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.733+0000 7f6ba4b6a700 1 -- 172.21.15.192:0/2828966564 learned_addr learned my addr 172.21.15.192:0/2828966564 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:25.743 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.733+0000 7f6ba536b700 1 --2- 172.21.15.192:0/2828966564 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ba0060370 0x7f6ba00c19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:25.743 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.733+0000 7f6ba5b6c700 1 --2- 172.21.15.192:0/2828966564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ba0154920 0x7f6ba00c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:25.743 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.733+0000 7f6ba4b6a700 1 -- 172.21.15.192:0/2828966564 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ba0060370 msgr2=0x7f6ba00c19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:25.744 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.733+0000 7f6ba4b6a700 1 --2- 172.21.15.192:0/2828966564 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ba0060370 0x7f6ba00c19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:25.744 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.733+0000 7f6ba4b6a700 1 -- 172.21.15.192:0/2828966564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ba0154920 msgr2=0x7f6ba00c6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:25.744 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.733+0000 7f6ba4b6a700 1 --2- 172.21.15.192:0/2828966564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ba0154920 0x7f6ba00c6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:25.744 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.733+0000 7f6ba4b6a700 1 -- 172.21.15.192:0/2828966564 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba0164280 con 0x7f6ba0060750 2020-11-20T11:48:25.744 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.733+0000 7f6ba5b6c700 1 --2- 172.21.15.192:0/2828966564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ba0154920 0x7f6ba00c6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:48:25.744 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.733+0000 7f6ba4b6a700 1 --2- 172.21.15.192:0/2828966564 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ba0060750 0x7f6ba00b4260 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f6b9000c710 tx=0x7f6b90007c80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:25.745 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.733+0000 7f6b8d7fa700 1 -- 172.21.15.192:0/2828966564 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b90007320 con 0x7f6ba0060750 2020-11-20T11:48:25.745 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.733+0000 7f6ba75cf700 1 -- 172.21.15.192:0/2828966564 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba0164520 con 0x7f6ba0060750 2020-11-20T11:48:25.745 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.733+0000 7f6b8d7fa700 1 -- 172.21.15.192:0/2828966564 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b90007480 con 0x7f6ba0060750 2020-11-20T11:48:25.745 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.733+0000 7f6b8d7fa700 1 -- 172.21.15.192:0/2828966564 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b90005840 con 0x7f6ba0060750 2020-11-20T11:48:25.745 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.734+0000 7f6ba75cf700 1 -- 172.21.15.192:0/2828966564 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba00b4750 con 0x7f6ba0060750 2020-11-20T11:48:25.746 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.734+0000 7f6ba75cf700 1 -- 172.21.15.192:0/2828966564 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba0154760 con 0x7f6ba0060750 2020-11-20T11:48:25.746 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.735+0000 7f6b8d7fa700 1 -- 172.21.15.192:0/2828966564 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f6b90010030 con 0x7f6ba0060750 2020-11-20T11:48:25.746 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.735+0000 7f6b8d7fa700 1 --2- 172.21.15.192:0/2828966564 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f6b7c080670 0x7f6b7c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:25.746 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.736+0000 7f6b8d7fa700 1 -- 172.21.15.192:0/2828966564 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f6b900a27e0 con 0x7f6ba0060750 2020-11-20T11:48:25.746 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.736+0000 7f6ba536b700 1 --2- 172.21.15.192:0/2828966564 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f6b7c080670 0x7f6b7c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:25.747 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.736+0000 7f6ba536b700 1 --2- 172.21.15.192:0/2828966564 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f6b7c080670 0x7f6b7c082b30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f6b9c001410 tx=0x7f6b9c009040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:25.747 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.739+0000 7f6b8d7fa700 1 -- 172.21.15.192:0/2828966564 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f6b900771f0 con 0x7f6ba0060750 2020-11-20T11:48:25.883 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.880+0000 7f6ba75cf700 1 -- 172.21.15.192:0/2828966564 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6ba00699a0 con 0x7f6ba0060750 2020-11-20T11:48:25.883 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.880+0000 7f6b8d7fa700 1 -- 172.21.15.192:0/2828966564 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v28) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6b9007a810 con 0x7f6ba0060750 2020-11-20T11:48:25.883 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2020-11-20T11:48:25.885 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.881+0000 7f6ba75cf700 1 -- 172.21.15.192:0/2828966564 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f6b7c080670 msgr2=0x7f6b7c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:25.885 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.881+0000 7f6ba75cf700 1 --2- 172.21.15.192:0/2828966564 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f6b7c080670 0x7f6b7c082b30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f6b9c001410 tx=0x7f6b9c009040).stop 2020-11-20T11:48:25.885 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.881+0000 7f6ba75cf700 1 -- 172.21.15.192:0/2828966564 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ba0060750 msgr2=0x7f6ba00b4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:25.885 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.881+0000 7f6ba75cf700 1 --2- 172.21.15.192:0/2828966564 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ba0060750 0x7f6ba00b4260 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f6b9000c710 tx=0x7f6b90007c80).stop 2020-11-20T11:48:25.885 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.881+0000 7f6ba75cf700 1 -- 172.21.15.192:0/2828966564 shutdown_connections 2020-11-20T11:48:25.886 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.881+0000 7f6ba75cf700 1 --2- 172.21.15.192:0/2828966564 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f6b7c080670 0x7f6b7c082b30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:25.886 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.881+0000 7f6ba75cf700 1 --2- 172.21.15.192:0/2828966564 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f6ba0154920 0x7f6ba00c6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:25.886 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.881+0000 7f6ba75cf700 1 --2- 172.21.15.192:0/2828966564 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ba0060370 0x7f6ba00c19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:25.886 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.881+0000 7f6ba75cf700 1 --2- 172.21.15.192:0/2828966564 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ba0060750 0x7f6ba00b4260 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:25.886 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.881+0000 7f6ba75cf700 1 -- 172.21.15.192:0/2828966564 >> 172.21.15.192:0/2828966564 conn(0x7f6ba0062100 msgr2=0x7f6ba00c2340 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:25.887 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.882+0000 7f6ba75cf700 1 -- 172.21.15.192:0/2828966564 shutdown_connections 2020-11-20T11:48:25.887 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:25.882+0000 7f6ba75cf700 1 -- 172.21.15.192:0/2828966564 wait complete. 2020-11-20T11:48:25.896 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-11-20T11:48:26.007 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.004+0000 7fb4ae934700 1 Processor -- start 2020-11-20T11:48:26.008 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.004+0000 7fb4ae934700 1 -- start start 2020-11-20T11:48:26.014 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.004+0000 7fb4ae934700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb4a80bf540 0x7fb4a8151be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:26.014 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.004+0000 7fb4ae934700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4a8152680 con 0x7fb4a80bf160 2020-11-20T11:48:26.014 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.004+0000 7fb4ae934700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4a8064730 con 0x7fb4a81537d0 2020-11-20T11:48:26.014 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.004+0000 7fb4ae934700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4a81520d0 con 0x7fb4a80bf540 2020-11-20T11:48:26.015 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.005+0000 7fb4a77fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb4a80bf540 0x7fb4a8151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:26.015 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.005+0000 7fb4aced1700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fb4a81537d0 0x7fb4a8153c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52258/0 (socket says 172.21.15.192:52258) 2020-11-20T11:48:26.015 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.005+0000 7fb4aced1700 1 -- 172.21.15.192:0/4240871194 learned_addr learned my addr 172.21.15.192:0/4240871194 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:26.015 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.005+0000 7fb4a77fe700 1 -- 172.21.15.192:0/4240871194 >> v1:172.21.15.192:6789/0 conn(0x7fb4a81537d0 legacy=0x7fb4a8153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:26.015 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.005+0000 7fb4a77fe700 1 -- 172.21.15.192:0/4240871194 >> v1:172.21.15.87:6789/0 conn(0x7fb4a80bf160 legacy=0x7fb4a8062740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:26.016 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.005+0000 7fb4a6ffd700 1 -- 172.21.15.192:0/4240871194 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 911593947 0 0) 0x7fb4a8064730 con 0x7fb4a81537d0 2020-11-20T11:48:26.016 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.005+0000 7fb4a77fe700 1 -- 172.21.15.192:0/4240871194 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a81528b0 con 0x7fb4a80bf540 2020-11-20T11:48:26.016 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.005+0000 7fb4a77fe700 1 --2- 172.21.15.192:0/4240871194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4a80bf540 0x7fb4a8151be0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fb49c00ba30 tx=0x7fb49c006e30).ready entity=mon.2 client_cookie=6cfce729eb67082e server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:26.016 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.005+0000 7fb4a6ffd700 1 -- 172.21.15.192:0/4240871194 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c0097f0 con 0x7fb4a80bf540 2020-11-20T11:48:26.016 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.005+0000 7fb4a6ffd700 1 -- 172.21.15.192:0/4240871194 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49c000e90 con 0x7fb4a80bf540 2020-11-20T11:48:26.017 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.005+0000 7fb4a6ffd700 1 -- 172.21.15.192:0/4240871194 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c009b60 con 0x7fb4a80bf540 2020-11-20T11:48:26.017 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.006+0000 7fb4ae934700 1 -- 172.21.15.192:0/4240871194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4a80bf540 msgr2=0x7fb4a8151be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:26.017 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.006+0000 7fb4ae934700 1 --2- 172.21.15.192:0/4240871194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4a80bf540 0x7fb4a8151be0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fb49c00ba30 tx=0x7fb49c006e30).stop 2020-11-20T11:48:26.017 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.006+0000 7fb4ae934700 1 -- 172.21.15.192:0/4240871194 shutdown_connections 2020-11-20T11:48:26.017 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.006+0000 7fb4ae934700 1 --2- 172.21.15.192:0/4240871194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4a80bf540 0x7fb4a8151be0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:26.018 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.006+0000 7fb4ae934700 1 -- 172.21.15.192:0/4240871194 >> 172.21.15.192:0/4240871194 conn(0x7fb4a80601b0 msgr2=0x7fb4a80605c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:26.018 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.006+0000 7fb4ae934700 1 -- 172.21.15.192:0/4240871194 shutdown_connections 2020-11-20T11:48:26.018 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.006+0000 7fb4ae934700 1 -- 172.21.15.192:0/4240871194 wait complete. 2020-11-20T11:48:26.018 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.007+0000 7fb4ae934700 1 Processor -- start 2020-11-20T11:48:26.018 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.007+0000 7fb4ae934700 1 -- start start 2020-11-20T11:48:26.019 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.008+0000 7fb4ae934700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4a80bf160 0x7fb4a8154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:26.019 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.008+0000 7fb4ae934700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4a80bf540 0x7fb4a814f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:26.019 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.008+0000 7fb4ae934700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4a81537d0 0x7fb4a814f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:26.019 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.008+0000 7fb4ae934700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a8154b00 con 0x7fb4a81537d0 2020-11-20T11:48:26.019 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.008+0000 7fb4ae934700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a81109e0 con 0x7fb4a80bf160 2020-11-20T11:48:26.020 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.008+0000 7fb4ae934700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a81104a0 con 0x7fb4a80bf540 2020-11-20T11:48:26.020 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.008+0000 7fb4a77fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4a80bf540 0x7fb4a814f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:26.020 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.008+0000 7fb4a77fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4a80bf540 0x7fb4a814f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49594/0 (socket says 172.21.15.192:49594) 2020-11-20T11:48:26.020 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.008+0000 7fb4a77fe700 1 -- 172.21.15.192:0/1900872398 learned_addr learned my addr 172.21.15.192:0/1900872398 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:26.020 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.008+0000 7fb4aced1700 1 --2- 172.21.15.192:0/1900872398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4a81537d0 0x7fb4a814f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:26.021 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.008+0000 7fb4a7fff700 1 --2- 172.21.15.192:0/1900872398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4a80bf160 0x7fb4a8154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:26.021 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.008+0000 7fb4a77fe700 1 -- 172.21.15.192:0/1900872398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4a80bf160 msgr2=0x7fb4a8154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:26.021 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.008+0000 7fb4a77fe700 1 --2- 172.21.15.192:0/1900872398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4a80bf160 0x7fb4a8154610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:26.021 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.008+0000 7fb4a77fe700 1 -- 172.21.15.192:0/1900872398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4a81537d0 msgr2=0x7fb4a814f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:26.021 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.008+0000 7fb4a77fe700 1 --2- 172.21.15.192:0/1900872398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4a81537d0 0x7fb4a814f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:26.022 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.008+0000 7fb4a77fe700 1 -- 172.21.15.192:0/1900872398 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a8110740 con 0x7fb4a80bf540 2020-11-20T11:48:26.022 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.008+0000 7fb4a77fe700 1 --2- 172.21.15.192:0/1900872398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4a80bf540 0x7fb4a814f190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fb4a8069200 tx=0x7fb49c015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:26.022 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.008+0000 7fb487fff700 1 -- 172.21.15.192:0/1900872398 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c01d450 con 0x7fb4a80bf540 2020-11-20T11:48:26.023 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.008+0000 7fb487fff700 1 -- 172.21.15.192:0/1900872398 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49c01d5b0 con 0x7fb4a80bf540 2020-11-20T11:48:26.023 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.009+0000 7fb487fff700 1 -- 172.21.15.192:0/1900872398 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c01d950 con 0x7fb4a80bf540 2020-11-20T11:48:26.023 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.009+0000 7fb4ae934700 1 -- 172.21.15.192:0/1900872398 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4a814ea50 con 0x7fb4a80bf540 2020-11-20T11:48:26.023 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.009+0000 7fb4ae934700 1 -- 172.21.15.192:0/1900872398 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a8110120 con 0x7fb4a80bf540 2020-11-20T11:48:26.023 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.009+0000 7fb4ae934700 1 -- 172.21.15.192:0/1900872398 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4a814eeb0 con 0x7fb4a80bf540 2020-11-20T11:48:26.024 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.010+0000 7fb487fff700 1 -- 172.21.15.192:0/1900872398 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fb49c00f070 con 0x7fb4a80bf540 2020-11-20T11:48:26.024 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.010+0000 7fb487fff700 1 --2- 172.21.15.192:0/1900872398 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fb480080670 0x7fb480082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:26.024 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.011+0000 7fb487fff700 1 -- 172.21.15.192:0/1900872398 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fb49c0a4a00 con 0x7fb4a80bf540 2020-11-20T11:48:26.024 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.011+0000 7fb4a7fff700 1 --2- 172.21.15.192:0/1900872398 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fb480080670 0x7fb480082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:26.025 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.011+0000 7fb4a7fff700 1 --2- 172.21.15.192:0/1900872398 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fb480080670 0x7fb480082b30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fb498007fd0 tx=0x7fb498009040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:26.025 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.014+0000 7fb487fff700 1 -- 172.21.15.192:0/1900872398 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fb49c079390 con 0x7fb4a80bf540 2020-11-20T11:48:26.158 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.154+0000 7fb4ae934700 1 -- 172.21.15.192:0/1900872398 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb4a805ca80 con 0x7fb4a80bf540 2020-11-20T11:48:26.159 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.155+0000 7fb487fff700 1 -- 172.21.15.192:0/1900872398 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb49c07c9b0 con 0x7fb4a80bf540 2020-11-20T11:48:26.160 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 8 2020-11-20T11:48:26.162 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.156+0000 7fb4ae934700 1 -- 172.21.15.192:0/1900872398 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fb480080670 msgr2=0x7fb480082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:26.163 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.156+0000 7fb4ae934700 1 --2- 172.21.15.192:0/1900872398 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fb480080670 0x7fb480082b30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fb498007fd0 tx=0x7fb498009040).stop 2020-11-20T11:48:26.163 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.156+0000 7fb4ae934700 1 -- 172.21.15.192:0/1900872398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4a80bf540 msgr2=0x7fb4a814f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:26.164 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.156+0000 7fb4ae934700 1 --2- 172.21.15.192:0/1900872398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4a80bf540 0x7fb4a814f190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fb4a8069200 tx=0x7fb49c015000).stop 2020-11-20T11:48:26.164 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.157+0000 7fb4ae934700 1 -- 172.21.15.192:0/1900872398 shutdown_connections 2020-11-20T11:48:26.165 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.157+0000 7fb4ae934700 1 --2- 172.21.15.192:0/1900872398 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fb480080670 0x7fb480082b30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:26.165 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.157+0000 7fb4ae934700 1 --2- 172.21.15.192:0/1900872398 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fb4a81537d0 0x7fb4a814f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:26.166 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.157+0000 7fb4ae934700 1 --2- 172.21.15.192:0/1900872398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4a80bf160 0x7fb4a8154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:26.167 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.157+0000 7fb4ae934700 1 --2- 172.21.15.192:0/1900872398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4a80bf540 0x7fb4a814f190 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:26.167 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.157+0000 7fb4ae934700 1 -- 172.21.15.192:0/1900872398 >> 172.21.15.192:0/1900872398 conn(0x7fb4a80601b0 msgr2=0x7fb4a80c2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:26.168 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.157+0000 7fb4ae934700 1 -- 172.21.15.192:0/1900872398 shutdown_connections 2020-11-20T11:48:26.169 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.157+0000 7fb4ae934700 1 -- 172.21.15.192:0/1900872398 wait complete. 2020-11-20T11:48:26.171 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-11-20T11:48:26.311 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.308+0000 7fdeb70aa700 1 Processor -- start 2020-11-20T11:48:26.311 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.308+0000 7fdeb70aa700 1 -- start start 2020-11-20T11:48:26.313 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.309+0000 7fdeb70aa700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdeb0154920 0x7fdeb0060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:26.313 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.309+0000 7fdeb70aa700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdeb0064c40 0x7fdeb0151340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:26.313 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.309+0000 7fdeb70aa700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeb0151e80 con 0x7fdeb0060370 2020-11-20T11:48:26.313 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.309+0000 7fdeb70aa700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeb0152120 con 0x7fdeb0064c40 2020-11-20T11:48:26.314 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.309+0000 7fdeb70aa700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeb0064260 con 0x7fdeb0154920 2020-11-20T11:48:26.314 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.309+0000 7fdeb5647700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdeb0064c40 0x7fdeb0151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:26.314 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.309+0000 7fdeaffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdeb0154920 0x7fdeb0060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:26.314 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.309+0000 7fdeaffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdeb0154920 0x7fdeb0060750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.192:53690/0 (socket says 172.21.15.192:53690) 2020-11-20T11:48:26.314 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.309+0000 7fdeb5647700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fdeb0064c40 0x7fdeb0151340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.192:59044/0 (socket says 172.21.15.192:59044) 2020-11-20T11:48:26.315 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.309+0000 7fdeb4e46700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fdeb0060370 0x7fdeb00c2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.192:38984/0 (socket says 172.21.15.192:38984) 2020-11-20T11:48:26.315 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.309+0000 7fdeaffff700 1 -- 172.21.15.192:0/1798069619 learned_addr learned my addr 172.21.15.192:0/1798069619 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:26.315 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.309+0000 7fdeb5647700 1 -- 172.21.15.192:0/1798069619 >> v2:172.21.15.146:3300/0 conn(0x7fdeb0154920 msgr2=0x7fdeb0060750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:26.315 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.309+0000 7fdeb5647700 1 --2- 172.21.15.192:0/1798069619 >> v2:172.21.15.146:3300/0 conn(0x7fdeb0154920 0x7fdeb0060750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:26.315 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.309+0000 7fdeb5647700 1 -- 172.21.15.192:0/1798069619 >> v1:172.21.15.87:6789/0 conn(0x7fdeb0060370 legacy=0x7fdeb00c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:26.316 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.309+0000 7fdeb5647700 1 -- 172.21.15.192:0/1798069619 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb0064500 con 0x7fdeb0064c40 2020-11-20T11:48:26.316 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.309+0000 7fdeaffff700 1 --2- 172.21.15.192:0/1798069619 >> v2:172.21.15.146:3300/0 conn(0x7fdeb0154920 0x7fdeb0060750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:48:26.316 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.310+0000 7fdeb5647700 1 --2- 172.21.15.192:0/1798069619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdeb0064c40 0x7fdeb0151340 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fdeb0060f60 tx=0x7fdea8009220).ready entity=mon.0 client_cookie=85860b24b0753a8e server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:26.316 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.310+0000 7fdeaf7fe700 1 -- 172.21.15.192:0/1798069619 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea800ba90 con 0x7fdeb0064c40 2020-11-20T11:48:26.316 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.310+0000 7fdeaf7fe700 1 -- 172.21.15.192:0/1798069619 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea800bbf0 con 0x7fdeb0064c40 2020-11-20T11:48:26.317 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.310+0000 7fdeaf7fe700 1 -- 172.21.15.192:0/1798069619 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea8011400 con 0x7fdeb0064c40 2020-11-20T11:48:26.319 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.310+0000 7fdeb70aa700 1 -- 172.21.15.192:0/1798069619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdeb0064c40 msgr2=0x7fdeb0151340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:26.320 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.310+0000 7fdeb70aa700 1 --2- 172.21.15.192:0/1798069619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdeb0064c40 0x7fdeb0151340 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fdeb0060f60 tx=0x7fdea8009220).stop 2020-11-20T11:48:26.320 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.310+0000 7fdeb70aa700 1 -- 172.21.15.192:0/1798069619 shutdown_connections 2020-11-20T11:48:26.320 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.310+0000 7fdeb70aa700 1 --2- 172.21.15.192:0/1798069619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdeb0064c40 0x7fdeb0151340 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:26.320 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.310+0000 7fdeb70aa700 1 --2- 172.21.15.192:0/1798069619 >> v2:172.21.15.146:3300/0 conn(0x7fdeb0154920 0x7fdeb0060750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:26.320 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.310+0000 7fdeb70aa700 1 -- 172.21.15.192:0/1798069619 >> 172.21.15.192:0/1798069619 conn(0x7fdeb0062100 msgr2=0x7fdeb00c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:26.321 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.310+0000 7fdeb70aa700 1 -- 172.21.15.192:0/1798069619 shutdown_connections 2020-11-20T11:48:26.321 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.310+0000 7fdeb70aa700 1 -- 172.21.15.192:0/1798069619 wait complete. 2020-11-20T11:48:26.321 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.311+0000 7fdeb70aa700 1 Processor -- start 2020-11-20T11:48:26.321 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.311+0000 7fdeb70aa700 1 -- start start 2020-11-20T11:48:26.321 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.312+0000 7fdeb70aa700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdeb0060370 0x7fdeb00c2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:26.322 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.312+0000 7fdeb70aa700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdeb0064c40 0x7fdeb00bffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:26.322 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.312+0000 7fdeb70aa700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdeb0154920 0x7fdeb00c04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:26.322 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.312+0000 7fdeb70aa700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb00c09b0 con 0x7fdeb0064c40 2020-11-20T11:48:26.322 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.312+0000 7fdeb70aa700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb00c3240 con 0x7fdeb0060370 2020-11-20T11:48:26.322 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.312+0000 7fdeb70aa700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb00b0450 con 0x7fdeb0154920 2020-11-20T11:48:26.323 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.312+0000 7fdeb5647700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdeb0154920 0x7fdeb00c04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:26.323 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.312+0000 7fdeb5647700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdeb0154920 0x7fdeb00c04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49610/0 (socket says 172.21.15.192:49610) 2020-11-20T11:48:26.323 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.312+0000 7fdeb5647700 1 -- 172.21.15.192:0/558267808 learned_addr learned my addr 172.21.15.192:0/558267808 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:26.323 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.312+0000 7fdeaffff700 1 --2- 172.21.15.192:0/558267808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdeb0064c40 0x7fdeb00bffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:26.323 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.312+0000 7fdeb4e46700 1 --2- 172.21.15.192:0/558267808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdeb0060370 0x7fdeb00c2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:26.324 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.313+0000 7fdeb5647700 1 -- 172.21.15.192:0/558267808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdeb0060370 msgr2=0x7fdeb00c2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:26.324 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.313+0000 7fdeb5647700 1 --2- 172.21.15.192:0/558267808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdeb0060370 0x7fdeb00c2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:26.324 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.313+0000 7fdeb5647700 1 -- 172.21.15.192:0/558267808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdeb0064c40 msgr2=0x7fdeb00bffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:26.324 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.313+0000 7fdeb5647700 1 --2- 172.21.15.192:0/558267808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdeb0064c40 0x7fdeb00bffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:26.324 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.313+0000 7fdeb5647700 1 -- 172.21.15.192:0/558267808 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb00b06f0 con 0x7fdeb0154920 2020-11-20T11:48:26.325 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.313+0000 7fdeb4e46700 1 --2- 172.21.15.192:0/558267808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdeb0060370 0x7fdeb00c2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:48:26.325 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.313+0000 7fdeb5647700 1 --2- 172.21.15.192:0/558267808 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdeb0154920 0x7fdeb00c04c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fdea80090b0 tx=0x7fdea8016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:26.325 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.313+0000 7fdeacff9700 1 -- 172.21.15.192:0/558267808 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea801b6b0 con 0x7fdeb0154920 2020-11-20T11:48:26.325 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.313+0000 7fdeacff9700 1 -- 172.21.15.192:0/558267808 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea801b810 con 0x7fdeb0154920 2020-11-20T11:48:26.325 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.313+0000 7fdeb70aa700 1 -- 172.21.15.192:0/558267808 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeb00b0990 con 0x7fdeb0154920 2020-11-20T11:48:26.326 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.313+0000 7fdeacff9700 1 -- 172.21.15.192:0/558267808 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea801bbd0 con 0x7fdeb0154920 2020-11-20T11:48:26.326 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.313+0000 7fdeb70aa700 1 -- 172.21.15.192:0/558267808 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeb00bfb30 con 0x7fdeb0154920 2020-11-20T11:48:26.326 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.314+0000 7fdeb70aa700 1 -- 172.21.15.192:0/558267808 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeb00699a0 con 0x7fdeb0154920 2020-11-20T11:48:26.326 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.314+0000 7fdeacff9700 1 -- 172.21.15.192:0/558267808 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fdea8017070 con 0x7fdeb0154920 2020-11-20T11:48:26.326 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.315+0000 7fdeacff9700 1 --2- 172.21.15.192:0/558267808 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fde880806a0 0x7fde88082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:26.327 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.315+0000 7fdeacff9700 1 -- 172.21.15.192:0/558267808 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fdea80a49c0 con 0x7fdeb0154920 2020-11-20T11:48:26.327 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.315+0000 7fdeb4e46700 1 --2- 172.21.15.192:0/558267808 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fde880806a0 0x7fde88082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:26.327 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.315+0000 7fdeb4e46700 1 --2- 172.21.15.192:0/558267808 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fde880806a0 0x7fde88082b60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fdea4005620 tx=0x7fdea4000bc0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:26.327 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.318+0000 7fdeacff9700 1 -- 172.21.15.192:0/558267808 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fdea80793d0 con 0x7fdeb0154920 2020-11-20T11:48:26.465 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.461+0000 7fdeb70aa700 1 -- 172.21.15.192:0/558267808 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdeb00bfcf0 con 0x7fdeb0154920 2020-11-20T11:48:26.465 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.461+0000 7fdeacff9700 1 -- 172.21.15.192:0/558267808 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+10 (secure 0 0 0) 0x7fdea8015070 con 0x7fdeb0154920 2020-11-20T11:48:26.465 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 8 2020-11-20T11:48:26.467 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.463+0000 7fdeb70aa700 1 -- 172.21.15.192:0/558267808 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fde880806a0 msgr2=0x7fde88082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:26.467 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.463+0000 7fdeb70aa700 1 --2- 172.21.15.192:0/558267808 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fde880806a0 0x7fde88082b60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fdea4005620 tx=0x7fdea4000bc0).stop 2020-11-20T11:48:26.467 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.463+0000 7fdeb70aa700 1 -- 172.21.15.192:0/558267808 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdeb0154920 msgr2=0x7fdeb00c04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:26.467 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.463+0000 7fdeb70aa700 1 --2- 172.21.15.192:0/558267808 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdeb0154920 0x7fdeb00c04c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fdea80090b0 tx=0x7fdea8016000).stop 2020-11-20T11:48:26.468 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.463+0000 7fdeb70aa700 1 -- 172.21.15.192:0/558267808 shutdown_connections 2020-11-20T11:48:26.468 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.463+0000 7fdeb70aa700 1 --2- 172.21.15.192:0/558267808 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fde880806a0 0x7fde88082b60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:26.468 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.463+0000 7fdeb70aa700 1 --2- 172.21.15.192:0/558267808 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdeb0154920 0x7fdeb00c04c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:26.468 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.463+0000 7fdeb70aa700 1 --2- 172.21.15.192:0/558267808 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdeb0060370 0x7fdeb00c2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:26.468 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.463+0000 7fdeb70aa700 1 --2- 172.21.15.192:0/558267808 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fdeb0064c40 0x7fdeb00bffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:26.469 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.463+0000 7fdeb70aa700 1 -- 172.21.15.192:0/558267808 >> 172.21.15.192:0/558267808 conn(0x7fdeb0062100 msgr2=0x7fdeb0152750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:26.469 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.463+0000 7fdeb70aa700 1 -- 172.21.15.192:0/558267808 shutdown_connections 2020-11-20T11:48:26.469 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.463+0000 7fdeb70aa700 1 -- 172.21.15.192:0/558267808 wait complete. 2020-11-20T11:48:26.478 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-11-20T11:48:26.591 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.588+0000 7f8dc6c12700 1 Processor -- start 2020-11-20T11:48:26.592 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.588+0000 7f8dc6c12700 1 -- start start 2020-11-20T11:48:26.594 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.589+0000 7f8dc6c12700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8dc0150c70 0x7f8dc0061bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:26.594 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.589+0000 7f8dc6c12700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8dc0151430 0x7f8dc0151890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:26.595 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.589+0000 7f8dc6c12700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dc0154610 con 0x7f8dc00617f0 2020-11-20T11:48:26.595 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.589+0000 7f8dc6c12700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc01548b0 con 0x7f8dc0151430 2020-11-20T11:48:26.595 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.589+0000 7f8dc6c12700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc0154b50 con 0x7f8dc0150c70 2020-11-20T11:48:26.596 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.590+0000 7f8dc540f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8dc0150c70 0x7f8dc0061bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:26.596 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.590+0000 7f8dc540f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8dc0150c70 0x7f8dc0061bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49618/0 (socket says 172.21.15.192:49618) 2020-11-20T11:48:26.596 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.590+0000 7f8dc540f700 1 -- 172.21.15.192:0/2760355232 learned_addr learned my addr 172.21.15.192:0/2760355232 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:26.596 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.590+0000 7f8dc6411700 1 --2- 172.21.15.192:0/2760355232 >> v2:172.21.15.146:3300/0 conn(0x7f8dc0151430 0x7f8dc0151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:26.596 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.590+0000 7f8dc540f700 1 -- 172.21.15.192:0/2760355232 >> v2:172.21.15.146:3300/0 conn(0x7f8dc0151430 msgr2=0x7f8dc0151890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:26.597 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.590+0000 7f8dc540f700 1 --2- 172.21.15.192:0/2760355232 >> v2:172.21.15.146:3300/0 conn(0x7f8dc0151430 0x7f8dc0151890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:26.597 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.590+0000 7f8dc540f700 1 -- 172.21.15.192:0/2760355232 >> v1:172.21.15.146:6789/0 conn(0x7f8dc00617f0 legacy=0x7f8dc0150560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:26.597 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.590+0000 7f8dc540f700 1 -- 172.21.15.192:0/2760355232 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc0154df0 con 0x7f8dc0150c70 2020-11-20T11:48:26.597 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.590+0000 7f8dc6411700 1 --2- 172.21.15.192:0/2760355232 >> v2:172.21.15.146:3300/0 conn(0x7f8dc0151430 0x7f8dc0151890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:48:26.598 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.590+0000 7f8dc540f700 1 --2- 172.21.15.192:0/2760355232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8dc0150c70 0x7f8dc0061bd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f8db0009a10 tx=0x7f8db0006ef0).ready entity=mon.2 client_cookie=95c9535751da42fb server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:26.598 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.590+0000 7f8dc4c0e700 1 -- 172.21.15.192:0/2760355232 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db000b820 con 0x7f8dc0150c70 2020-11-20T11:48:26.598 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.590+0000 7f8dc4c0e700 1 -- 172.21.15.192:0/2760355232 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db0000e90 con 0x7f8dc0150c70 2020-11-20T11:48:26.598 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.590+0000 7f8dc4c0e700 1 -- 172.21.15.192:0/2760355232 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db000bb90 con 0x7f8dc0150c70 2020-11-20T11:48:26.598 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.591+0000 7f8dc6c12700 1 -- 172.21.15.192:0/2760355232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8dc0150c70 msgr2=0x7f8dc0061bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:26.599 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.591+0000 7f8dc6c12700 1 --2- 172.21.15.192:0/2760355232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8dc0150c70 0x7f8dc0061bd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f8db0009a10 tx=0x7f8db0006ef0).stop 2020-11-20T11:48:26.599 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.591+0000 7f8dc6c12700 1 -- 172.21.15.192:0/2760355232 shutdown_connections 2020-11-20T11:48:26.599 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.591+0000 7f8dc6c12700 1 --2- 172.21.15.192:0/2760355232 >> v2:172.21.15.146:3300/0 conn(0x7f8dc0151430 0x7f8dc0151890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:26.599 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.591+0000 7f8dc6c12700 1 --2- 172.21.15.192:0/2760355232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8dc0150c70 0x7f8dc0061bd0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:26.599 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.591+0000 7f8dc6c12700 1 -- 172.21.15.192:0/2760355232 >> 172.21.15.192:0/2760355232 conn(0x7f8dc00c77f0 msgr2=0x7f8dc00c7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:26.600 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.591+0000 7f8dc6c12700 1 -- 172.21.15.192:0/2760355232 shutdown_connections 2020-11-20T11:48:26.600 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.591+0000 7f8dc6c12700 1 -- 172.21.15.192:0/2760355232 wait complete. 2020-11-20T11:48:26.602 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.592+0000 7f8dc6c12700 1 Processor -- start 2020-11-20T11:48:26.603 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.592+0000 7f8dc6c12700 1 -- start start 2020-11-20T11:48:26.603 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.592+0000 7f8dc6c12700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8dc00617f0 0x7f8dc00b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:26.603 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.593+0000 7f8dc6c12700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8dc0150c70 0x7f8dc00b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:26.603 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.593+0000 7f8dc6c12700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dc0151430 0x7f8dc014a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:26.604 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.593+0000 7f8dc6c12700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc014e0b0 con 0x7f8dc0151430 2020-11-20T11:48:26.604 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.593+0000 7f8dc6c12700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc00be340 con 0x7f8dc00617f0 2020-11-20T11:48:26.604 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.593+0000 7f8dc6c12700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc00b0ed0 con 0x7f8dc0150c70 2020-11-20T11:48:26.604 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.593+0000 7f8dc540f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8dc0150c70 0x7f8dc00b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:26.604 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.593+0000 7f8dc540f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8dc0150c70 0x7f8dc00b2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49622/0 (socket says 172.21.15.192:49622) 2020-11-20T11:48:26.605 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.593+0000 7f8dc540f700 1 -- 172.21.15.192:0/2536800385 learned_addr learned my addr 172.21.15.192:0/2536800385 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:26.605 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.593+0000 7f8dc5c10700 1 --2- 172.21.15.192:0/2536800385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8dc00617f0 0x7f8dc00b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:26.605 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.593+0000 7f8dc540f700 1 -- 172.21.15.192:0/2536800385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8dc00617f0 msgr2=0x7f8dc00b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:26.605 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.593+0000 7f8dc540f700 1 --2- 172.21.15.192:0/2536800385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8dc00617f0 0x7f8dc00b2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:26.605 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.593+0000 7f8dc540f700 1 -- 172.21.15.192:0/2536800385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dc0151430 msgr2=0x7f8dc014a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:26.606 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.593+0000 7f8dc6411700 1 --2- 172.21.15.192:0/2536800385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dc0151430 0x7f8dc014a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:26.606 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.593+0000 7f8dc540f700 1 --2- 172.21.15.192:0/2536800385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dc0151430 0x7f8dc014a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:26.606 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.593+0000 7f8dc540f700 1 -- 172.21.15.192:0/2536800385 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc00b1170 con 0x7f8dc0150c70 2020-11-20T11:48:26.606 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.593+0000 7f8dc540f700 1 --2- 172.21.15.192:0/2536800385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8dc0150c70 0x7f8dc00b2f60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f8db0011000 tx=0x7f8db0016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:26.606 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.593+0000 7f8dadffb700 1 -- 172.21.15.192:0/2536800385 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db0011d30 con 0x7f8dc0150c70 2020-11-20T11:48:26.607 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.593+0000 7f8dadffb700 1 -- 172.21.15.192:0/2536800385 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db0011e90 con 0x7f8dc0150c70 2020-11-20T11:48:26.607 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.593+0000 7f8dc6c12700 1 -- 172.21.15.192:0/2536800385 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dc00b1410 con 0x7f8dc0150c70 2020-11-20T11:48:26.607 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.593+0000 7f8dadffb700 1 -- 172.21.15.192:0/2536800385 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db001c6a0 con 0x7f8dc0150c70 2020-11-20T11:48:26.607 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.593+0000 7f8dc6c12700 1 -- 172.21.15.192:0/2536800385 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc00b16b0 con 0x7f8dc0150c70 2020-11-20T11:48:26.607 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.594+0000 7f8dc6c12700 1 -- 172.21.15.192:0/2536800385 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dc005ca80 con 0x7f8dc0150c70 2020-11-20T11:48:26.608 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.595+0000 7f8dadffb700 1 -- 172.21.15.192:0/2536800385 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f8db0017070 con 0x7f8dc0150c70 2020-11-20T11:48:26.608 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.595+0000 7f8dadffb700 1 --2- 172.21.15.192:0/2536800385 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f8d98080670 0x7f8d98082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:26.608 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.596+0000 7f8dadffb700 1 -- 172.21.15.192:0/2536800385 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f8db00a44b0 con 0x7f8dc0150c70 2020-11-20T11:48:26.608 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.596+0000 7f8dc5c10700 1 --2- 172.21.15.192:0/2536800385 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f8d98080670 0x7f8d98082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:26.608 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.596+0000 7f8dc5c10700 1 --2- 172.21.15.192:0/2536800385 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f8d98080670 0x7f8d98082b30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f8dbc000c00 tx=0x7f8dbc009040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:26.609 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.599+0000 7f8dadffb700 1 -- 172.21.15.192:0/2536800385 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f8db0078ec0 con 0x7f8dc0150c70 2020-11-20T11:48:26.741 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.738+0000 7f8dc6c12700 1 -- 172.21.15.192:0/2536800385 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8dc0064710 con 0x7f8dc0150c70 2020-11-20T11:48:26.742 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.739+0000 7f8dadffb700 1 -- 172.21.15.192:0/2536800385 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+10 (secure 0 0 0) 0x7f8db0015030 con 0x7f8dc0150c70 2020-11-20T11:48:26.742 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 8 2020-11-20T11:48:26.744 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.740+0000 7f8dc6c12700 1 -- 172.21.15.192:0/2536800385 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f8d98080670 msgr2=0x7f8d98082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:26.744 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.740+0000 7f8dc6c12700 1 --2- 172.21.15.192:0/2536800385 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f8d98080670 0x7f8d98082b30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f8dbc000c00 tx=0x7f8dbc009040).stop 2020-11-20T11:48:26.744 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.740+0000 7f8dc6c12700 1 -- 172.21.15.192:0/2536800385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8dc0150c70 msgr2=0x7f8dc00b2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:26.744 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.740+0000 7f8dc6c12700 1 --2- 172.21.15.192:0/2536800385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8dc0150c70 0x7f8dc00b2f60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f8db0011000 tx=0x7f8db0016000).stop 2020-11-20T11:48:26.744 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.740+0000 7f8dc6c12700 1 -- 172.21.15.192:0/2536800385 shutdown_connections 2020-11-20T11:48:26.745 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.740+0000 7f8dc6c12700 1 --2- 172.21.15.192:0/2536800385 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f8d98080670 0x7f8d98082b30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:26.745 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.740+0000 7f8dc6c12700 1 --2- 172.21.15.192:0/2536800385 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8dc0151430 0x7f8dc014a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:26.745 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.740+0000 7f8dc6c12700 1 --2- 172.21.15.192:0/2536800385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8dc00617f0 0x7f8dc00b2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:26.745 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.740+0000 7f8dc6c12700 1 --2- 172.21.15.192:0/2536800385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8dc0150c70 0x7f8dc00b2f60 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:26.746 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.740+0000 7f8dc6c12700 1 -- 172.21.15.192:0/2536800385 >> 172.21.15.192:0/2536800385 conn(0x7f8dc00c77f0 msgr2=0x7f8dc00c15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:26.746 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.740+0000 7f8dc6c12700 1 -- 172.21.15.192:0/2536800385 shutdown_connections 2020-11-20T11:48:26.746 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.740+0000 7f8dc6c12700 1 -- 172.21.15.192:0/2536800385 wait complete. 2020-11-20T11:48:26.755 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-11-20T11:48:26.756 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-11-20T11:48:26.864 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.860+0000 7f200c41f700 1 Processor -- start 2020-11-20T11:48:26.864 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.860+0000 7f200c41f700 1 -- start start 2020-11-20T11:48:26.869 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.861+0000 7f200c41f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2004154920 0x7f2004060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:26.869 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.861+0000 7f200c41f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2004151e80 con 0x7f2004060370 2020-11-20T11:48:26.869 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.861+0000 7f200c41f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2004152120 con 0x7f2004064c40 2020-11-20T11:48:26.870 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.861+0000 7f200c41f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2004064260 con 0x7f2004154920 2020-11-20T11:48:26.870 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.861+0000 7f200a9bc700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f2004064c40 0x7f2004151340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52298/0 (socket says 172.21.15.192:52298) 2020-11-20T11:48:26.870 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.861+0000 7f200a9bc700 1 -- 172.21.15.192:0/1184797344 learned_addr learned my addr 172.21.15.192:0/1184797344 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T11:48:26.870 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.862+0000 7f20099ba700 1 --2- 172.21.15.192:0/1184797344 >> v2:172.21.15.146:3300/0 conn(0x7f2004154920 0x7f2004060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:26.870 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.862+0000 7f20091b9700 1 -- 172.21.15.192:0/1184797344 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3396905800 0 0) 0x7f2004152120 con 0x7f2004064c40 2020-11-20T11:48:26.871 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.862+0000 7f20091b9700 1 -- 172.21.15.192:0/1184797344 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fec003280 con 0x7f2004064c40 2020-11-20T11:48:26.871 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.862+0000 7f20091b9700 1 -- 172.21.15.192:0/1184797344 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2863876927 0 0) 0x7f2004151e80 con 0x7f2004060370 2020-11-20T11:48:26.871 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.862+0000 7f20091b9700 1 -- 172.21.15.192:0/1184797344 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2004152120 con 0x7f2004060370 2020-11-20T11:48:26.871 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.862+0000 7f20091b9700 1 -- 172.21.15.192:0/1184797344 <== mon.2 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2801811615 0 0) 0x7f1fec003280 con 0x7f2004064c40 2020-11-20T11:48:26.871 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.862+0000 7f20091b9700 1 -- 172.21.15.192:0/1184797344 >> v2:172.21.15.146:3300/0 conn(0x7f2004154920 msgr2=0x7f2004060750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:26.871 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.862+0000 7f20091b9700 1 --2- 172.21.15.192:0/1184797344 >> v2:172.21.15.146:3300/0 conn(0x7f2004154920 0x7f2004060750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:26.872 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.862+0000 7f20091b9700 1 -- 172.21.15.192:0/1184797344 >> v1:172.21.15.146:6789/0 conn(0x7f2004060370 legacy=0x7f20040c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:26.872 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.862+0000 7f20091b9700 1 -- 172.21.15.192:0/1184797344 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2004064500 con 0x7f2004064c40 2020-11-20T11:48:26.872 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.862+0000 7f20091b9700 1 -- 172.21.15.192:0/1184797344 <== mon.2 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3985397220 0 0) 0x7f1ffc0018a0 con 0x7f2004064c40 2020-11-20T11:48:26.872 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.862+0000 7f20091b9700 1 -- 172.21.15.192:0/1184797344 >> v1:172.21.15.192:6789/0 conn(0x7f2004064c40 legacy=0x7f2004151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:26.872 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.862+0000 7f20091b9700 1 --2- 172.21.15.192:0/1184797344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1fec003950 0x7f1fec003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:26.873 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.862+0000 7f20091b9700 1 --2- 172.21.15.192:0/1184797344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fec004520 0x7f1fec0049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:26.873 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.862+0000 7f20091b9700 1 --2- 172.21.15.192:0/1184797344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fec004e90 0x7f1fec00b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:26.873 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.862+0000 7f20091b9700 1 -- 172.21.15.192:0/1184797344 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2004064260 con 0x7f1fec003950 2020-11-20T11:48:26.873 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.862+0000 7f20091b9700 1 -- 172.21.15.192:0/1184797344 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec00bc60 con 0x7f1fec004520 2020-11-20T11:48:26.873 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.862+0000 7f20091b9700 1 -- 172.21.15.192:0/1184797344 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec00bda0 con 0x7f1fec004e90 2020-11-20T11:48:26.874 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.862+0000 7f200a9bc700 1 --2- 172.21.15.192:0/1184797344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fec004e90 0x7f1fec00b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:26.874 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.862+0000 7f20099ba700 1 --2- 172.21.15.192:0/1184797344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fec004520 0x7f1fec0049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:26.874 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.862+0000 7f200a9bc700 1 -- 172.21.15.192:0/1184797344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fec004520 msgr2=0x7f1fec0049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:26.874 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.862+0000 7f200a9bc700 1 --2- 172.21.15.192:0/1184797344 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fec004520 0x7f1fec0049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:26.874 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.862+0000 7f200a9bc700 1 -- 172.21.15.192:0/1184797344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1fec003950 msgr2=0x7f1fec003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:48:26.875 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.862+0000 7f200a1bb700 1 --2- 172.21.15.192:0/1184797344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1fec003950 0x7f1fec003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:26.875 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.862+0000 7f200a9bc700 1 --2- 172.21.15.192:0/1184797344 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1fec003950 0x7f1fec003d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:26.875 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.862+0000 7f200a9bc700 1 -- 172.21.15.192:0/1184797344 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fec003280 con 0x7f1fec004e90 2020-11-20T11:48:26.875 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.862+0000 7f200a9bc700 1 -- 172.21.15.192:0/1184797344 reap_dead start 2020-11-20T11:48:26.875 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.862+0000 7f200a9bc700 1 --2- 172.21.15.192:0/1184797344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fec004e90 0x7f1fec00b770 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f1ffc00c840 tx=0x7f20041522b0).ready entity=mon.2 client_cookie=a5d7b2bf50d41f83 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:26.876 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.863+0000 7f20091b9700 1 -- 172.21.15.192:0/1184797344 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc005bc0 con 0x7f1fec004e90 2020-11-20T11:48:26.876 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.863+0000 7f20091b9700 1 -- 172.21.15.192:0/1184797344 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ffc005d20 con 0x7f1fec004e90 2020-11-20T11:48:26.876 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.863+0000 7f20091b9700 1 -- 172.21.15.192:0/1184797344 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc007320 con 0x7f1fec004e90 2020-11-20T11:48:26.876 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.863+0000 7f200c41f700 1 -- 172.21.15.192:0/1184797344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fec004e90 msgr2=0x7f1fec00b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:26.876 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.863+0000 7f200c41f700 1 --2- 172.21.15.192:0/1184797344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fec004e90 0x7f1fec00b770 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f1ffc00c840 tx=0x7f20041522b0).stop 2020-11-20T11:48:26.877 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.863+0000 7f200c41f700 1 -- 172.21.15.192:0/1184797344 shutdown_connections 2020-11-20T11:48:26.877 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.863+0000 7f200c41f700 1 --2- 172.21.15.192:0/1184797344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fec004e90 0x7f1fec00b770 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:26.877 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.863+0000 7f200c41f700 1 -- 172.21.15.192:0/1184797344 >> 172.21.15.192:0/1184797344 conn(0x7f2004062100 msgr2=0x7f20040c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:26.877 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.863+0000 7f200c41f700 1 -- 172.21.15.192:0/1184797344 shutdown_connections 2020-11-20T11:48:26.877 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.863+0000 7f200c41f700 1 -- 172.21.15.192:0/1184797344 wait complete. 2020-11-20T11:48:26.878 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.864+0000 7f200c41f700 1 Processor -- start 2020-11-20T11:48:26.878 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.864+0000 7f200c41f700 1 -- start start 2020-11-20T11:48:26.878 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.865+0000 7f200c41f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fec004e90 0x7f2004160ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:26.878 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.865+0000 7f200c41f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20040c0120 0x7f2004161860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:26.878 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.865+0000 7f200c41f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20040c1280 0x7f2004067a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:26.879 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.865+0000 7f200c41f700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20040b1370 con 0x7f20040c0120 2020-11-20T11:48:26.879 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.865+0000 7f200c41f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20040b1610 con 0x7f1fec004e90 2020-11-20T11:48:26.879 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.865+0000 7f200c41f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20040b18b0 con 0x7f20040c1280 2020-11-20T11:48:26.879 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.865+0000 7f200a9bc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20040c1280 0x7f2004067a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:26.879 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.865+0000 7f200a9bc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20040c1280 0x7f2004067a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49644/0 (socket says 172.21.15.192:49644) 2020-11-20T11:48:26.880 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.865+0000 7f200a9bc700 1 -- 172.21.15.192:0/4015743606 learned_addr learned my addr 172.21.15.192:0/4015743606 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T11:48:26.880 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.865+0000 7f20099ba700 1 --2- 172.21.15.192:0/4015743606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20040c0120 0x7f2004161860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:26.880 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.865+0000 7f200a1bb700 1 --2- 172.21.15.192:0/4015743606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fec004e90 0x7f2004160ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:26.880 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.865+0000 7f200a9bc700 1 -- 172.21.15.192:0/4015743606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fec004e90 msgr2=0x7f2004160ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:26.880 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.865+0000 7f200a9bc700 1 --2- 172.21.15.192:0/4015743606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fec004e90 0x7f2004160ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:26.881 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.865+0000 7f200a9bc700 1 -- 172.21.15.192:0/4015743606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20040c0120 msgr2=0x7f2004161860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:26.881 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.865+0000 7f200a9bc700 1 --2- 172.21.15.192:0/4015743606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20040c0120 0x7f2004161860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:26.881 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.865+0000 7f200a9bc700 1 -- 172.21.15.192:0/4015743606 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20041604e0 con 0x7f20040c1280 2020-11-20T11:48:26.881 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.865+0000 7f200a1bb700 1 --2- 172.21.15.192:0/4015743606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fec004e90 0x7f2004160ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:48:26.881 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.865+0000 7f200a9bc700 1 --2- 172.21.15.192:0/4015743606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20040c1280 0x7f2004067a40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f1ffc006000 tx=0x7f1ffc010000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:26.882 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.866+0000 7f1ff27fc700 1 -- 172.21.15.192:0/4015743606 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc004ad0 con 0x7f20040c1280 2020-11-20T11:48:26.882 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.866+0000 7f1ff27fc700 1 -- 172.21.15.192:0/4015743606 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ffc004c30 con 0x7f20040c1280 2020-11-20T11:48:26.882 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.866+0000 7f200c41f700 1 -- 172.21.15.192:0/4015743606 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2004160780 con 0x7f20040c1280 2020-11-20T11:48:26.882 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.866+0000 7f1ff27fc700 1 -- 172.21.15.192:0/4015743606 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc0138b0 con 0x7f20040c1280 2020-11-20T11:48:26.883 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.866+0000 7f200c41f700 1 -- 172.21.15.192:0/4015743606 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20040c05a0 con 0x7f20040c1280 2020-11-20T11:48:26.884 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.867+0000 7f200c41f700 1 -- 172.21.15.192:0/4015743606 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20040699a0 con 0x7f20040c1280 2020-11-20T11:48:26.884 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.867+0000 7f1ff27fc700 1 -- 172.21.15.192:0/4015743606 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f1ffc026070 con 0x7f20040c1280 2020-11-20T11:48:26.884 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.868+0000 7f1ff27fc700 1 --2- 172.21.15.192:0/4015743606 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f1fdc0806a0 0x7f1fdc082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:48:26.884 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.868+0000 7f1ff27fc700 1 -- 172.21.15.192:0/4015743606 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f1ffc0a3890 con 0x7f20040c1280 2020-11-20T11:48:26.885 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.868+0000 7f200a1bb700 1 --2- 172.21.15.192:0/4015743606 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f1fdc0806a0 0x7f1fdc082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:48:26.885 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.868+0000 7f200a1bb700 1 --2- 172.21.15.192:0/4015743606 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f1fdc0806a0 0x7f1fdc082b60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f2000000c00 tx=0x7f2000009040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:48:26.885 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:26.871+0000 7f1ff27fc700 1 -- 172.21.15.192:0/4015743606 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f1ffc0782a0 con 0x7f20040c1280 2020-11-20T11:48:27.065 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:27.061+0000 7f200c41f700 1 -- 172.21.15.192:0/4015743606 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2004160be0 con 0x7f20040c1280 2020-11-20T11:48:27.065 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:27.062+0000 7f1ff27fc700 1 -- 172.21.15.192:0/4015743606 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2483 (secure 0 0 0) 0x7f1ffc07b8c0 con 0x7f20040c1280 2020-11-20T11:48:27.066 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T11:48:27.066 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4296,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.87:6833/3791880310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6832","nonce":3791880310},{"type":"v1","addr":"172.21.15.87:6833","nonce":3791880310}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":2},{"gid":4307,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/56648167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":56648167},{"type":"v1","addr":"172.21.15.192:6835","nonce":56648167}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-11-20T11:48:09.832534+0000","modified":"2020-11-20T11:48:11.842814+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4319":{"gid":4319,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6833/1982840368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":1982840368},{"type":"v1","addr":"172.21.15.146:6833","nonce":1982840368}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-11-20T11:48:27.067 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:27.064+0000 7f200c41f700 1 -- 172.21.15.192:0/4015743606 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f1fdc0806a0 msgr2=0x7f1fdc082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:27.067 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:27.064+0000 7f200c41f700 1 --2- 172.21.15.192:0/4015743606 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f1fdc0806a0 0x7f1fdc082b60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f2000000c00 tx=0x7f2000009040).stop 2020-11-20T11:48:27.067 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:27.064+0000 7f200c41f700 1 -- 172.21.15.192:0/4015743606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20040c1280 msgr2=0x7f2004067a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:48:27.068 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:27.064+0000 7f200c41f700 1 --2- 172.21.15.192:0/4015743606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20040c1280 0x7f2004067a40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f1ffc006000 tx=0x7f1ffc010000).stop 2020-11-20T11:48:27.068 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:27.064+0000 7f200c41f700 1 -- 172.21.15.192:0/4015743606 shutdown_connections 2020-11-20T11:48:27.068 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:27.064+0000 7f200c41f700 1 --2- 172.21.15.192:0/4015743606 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f1fdc0806a0 0x7f1fdc082b60 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:27.068 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:27.064+0000 7f200c41f700 1 --2- 172.21.15.192:0/4015743606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20040c1280 0x7f2004067a40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:27.068 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:27.064+0000 7f200c41f700 1 --2- 172.21.15.192:0/4015743606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fec004e90 0x7f2004160ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:27.069 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:27.064+0000 7f200c41f700 1 --2- 172.21.15.192:0/4015743606 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f20040c0120 0x7f2004161860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:48:27.069 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:27.064+0000 7f200c41f700 1 -- 172.21.15.192:0/4015743606 >> 172.21.15.192:0/4015743606 conn(0x7f2004062100 msgr2=0x7f20040c78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:48:27.069 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:27.064+0000 7f200c41f700 1 -- 172.21.15.192:0/4015743606 shutdown_connections 2020-11-20T11:48:27.069 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T11:48:27.064+0000 7f200c41f700 1 -- 172.21.15.192:0/4015743606 wait complete. 2020-11-20T11:48:27.070 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 6 2020-11-20T11:48:27.380 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-11-20T11:48:09.832534+0000', 'modified': '2020-11-20T11:48:11.842814+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4319}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4319': {'gid': 4319, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6833/1982840368', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6832', 'nonce': 1982840368}, {'type': 'v1', 'addr': '172.21.15.146:6833', 'nonce': 1982840368}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138297136906239, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-11-20T11:48:27.381 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-11-20T11:48:27.382 INFO:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2020-11-20T11:48:27.522 INFO:teuthology.orchestra.run.smithi146.stdout:{"cluster_fsid":"4871390d-d110-4379-8302-5810d7b54f34","whoami":0,"id":4319,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":17.675197231999999,"mdsmap_epoch":6,"osdmap_epoch":28,"osdmap_epoch_barrier":28,"uptime":24.048961367} 2020-11-20T11:48:27.523 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "4871390d-d110-4379-8302-5810d7b54f34", "fs_name": "cephfs", "id": 4319, "mdsmap_epoch": 6, "osdmap_epoch": 28, "osdmap_epoch_barrier": 28, "rank_uptime": 17.675197232, "state": "up:active", "uptime": 24.048961367, "want_state": "up:active", "whoami": 0 } 2020-11-20T11:48:27.523 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2020-11-20T11:48:27.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:48:27.525 INFO:teuthology.orchestra.run.smithi192:> mkdir -p /home/ubuntu/cephtest/mnt.0 2020-11-20T11:48:27.542 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-11-20T11:48:27.544 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2020-11-20T11:48:27.636 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2020-11-20T11:48:27.637 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2020-11-20T11:48:27.755 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2020-11-20T11:48:27.755 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2020-11-20T11:48:27.770 INFO:tasks.cephfs.kernel_mount:mount command passed 2020-11-20T11:48:27.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:48:27.771 INFO:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2020-11-20T11:48:27.801 INFO:teuthology.run_tasks:Running task workunit... 2020-11-20T11:48:27.819 INFO:tasks.workunit:Pulling workunits from ref b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:48:27.820 INFO:tasks.workunit:Making a separate scratch dir for every client... 2020-11-20T11:48:27.820 INFO:tasks.workunit:timeout=3h 2020-11-20T11:48:27.821 INFO:tasks.workunit:cleanup=True 2020-11-20T11:48:27.821 INFO:teuthology.orchestra.run.smithi192:> stat -- /home/ubuntu/cephtest/mnt.0 2020-11-20T11:48:27.864 INFO:teuthology.orchestra.run.smithi192.stdout: File: /home/ubuntu/cephtest/mnt.0 2020-11-20T11:48:27.865 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2020-11-20T11:48:27.865 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 2eh/46d Inode: 1 Links: 2 2020-11-20T11:48:27.866 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:48:27.866 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:cephfs_t:s0 2020-11-20T11:48:27.866 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2020-11-20T11:48:27.866 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2020-11-20 11:48:09.836135130 +0000 2020-11-20T11:48:27.867 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2020-11-20 11:48:27.796539024 +0000 2020-11-20T11:48:27.867 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: - 2020-11-20T11:48:27.868 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2020-11-20T11:48:27.868 INFO:teuthology.orchestra.run.smithi192:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2020-11-20T11:48:27.939 INFO:teuthology.orchestra.run.smithi192:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:48:28.064 INFO:tasks.workunit.client.0.smithi192.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2020-11-20T11:48:54.323 INFO:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:48:54.326 INFO:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:48:54.328 INFO:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:49:18.831 INFO:tasks.workunit.client.0.smithi192.stderr:Note: switching to 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'. 2020-11-20T11:49:20.353 INFO:tasks.workunit.client.0.smithi192.stderr: 2020-11-20T11:49:20.354 INFO:tasks.workunit.client.0.smithi192.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2020-11-20T11:49:20.354 INFO:tasks.workunit.client.0.smithi192.stderr:changes and commit them, and you can discard any commits you make in this 2020-11-20T11:49:20.354 INFO:tasks.workunit.client.0.smithi192.stderr:state without impacting any branches by switching back to a branch. 2020-11-20T11:49:20.354 INFO:tasks.workunit.client.0.smithi192.stderr: 2020-11-20T11:49:20.354 INFO:tasks.workunit.client.0.smithi192.stderr:If you want to create a new branch to retain commits you create, you may 2020-11-20T11:49:20.355 INFO:tasks.workunit.client.0.smithi192.stderr:do so (now or later) by using -c with the switch command. Example: 2020-11-20T11:49:20.355 INFO:tasks.workunit.client.0.smithi192.stderr: 2020-11-20T11:49:20.355 INFO:tasks.workunit.client.0.smithi192.stderr: git switch -c 2020-11-20T11:49:20.355 INFO:tasks.workunit.client.0.smithi192.stderr: 2020-11-20T11:49:20.355 INFO:tasks.workunit.client.0.smithi192.stderr:Or undo this operation with: 2020-11-20T11:49:20.356 INFO:tasks.workunit.client.0.smithi192.stderr: 2020-11-20T11:49:20.356 INFO:tasks.workunit.client.0.smithi192.stderr: git switch - 2020-11-20T11:49:20.356 INFO:tasks.workunit.client.0.smithi192.stderr: 2020-11-20T11:49:20.356 INFO:tasks.workunit.client.0.smithi192.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2020-11-20T11:49:20.356 INFO:tasks.workunit.client.0.smithi192.stderr: 2020-11-20T11:49:20.357 INFO:tasks.workunit.client.0.smithi192.stderr:HEAD is now at b86e691bf1 Merge PR #37174 into wip-pdonnell-testing-20201120.053228 2020-11-20T11:49:20.358 INFO:teuthology.orchestra.run.smithi192:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2020-11-20T11:49:20.389 INFO:tasks.workunit.client.0.smithi192.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2020-11-20T11:49:20.391 INFO:tasks.workunit.client.0.smithi192.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-11-20T11:49:20.391 INFO:tasks.workunit.client.0.smithi192.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2020-11-20T11:49:21.054 INFO:tasks.workunit.client.0.smithi192.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2020-11-20T11:49:21.114 INFO:tasks.workunit.client.0.smithi192.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2020-11-20T11:49:21.152 INFO:tasks.workunit.client.0.smithi192.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-11-20T11:49:21.153 INFO:tasks.workunit.client.0.smithi192.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-11-20T11:49:21.154 INFO:tasks.workunit.client.0.smithi192.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2020-11-20T11:49:21.189 INFO:tasks.workunit.client.0.smithi192.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-11-20T11:49:21.192 INFO:teuthology.orchestra.run.smithi192:> set -ex 2020-11-20T11:49:21.192 INFO:teuthology.orchestra.run.smithi192:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2020-11-20T11:49:21.245 INFO:teuthology.orchestra.run.smithi192.stderr:+ dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2020-11-20T11:49:21.246 INFO:teuthology.orchestra.run.smithi192.stdout:mon/rbd_snaps_ops.shmon/osd.shmon/config.shmon/pg_autoscaler.shmon/test_mon_osdmap_prune.shmon/pool_ops.shmon/ping.pymon/crush_ops.shmon/test_mon_config_key.pymon/auth_caps.shmon/caps.shmon/test_config_key_caps.shpost-file.shtrue.shceph-helpers-root.shceph-tests/ceph-admin-commands.sherasure-code/bench.sherasure-code/encode-decode-non-regression.shrgw/test_rgw_reshard.pyrgw/test_rgw_throttle.shrgw/s3_bucket_quota.plrgw/test_rgw_gc_log.shrgw/test_rgw_obj.shrgw/s3_multipart_upload.plrgw/test_rgw_orphan_list.shrgw/s3_user_quota.plrgw/run-reshard.shrgw/run-s3tests.shcephtool/test_daemon.shcephtool/test_kvstore_tool.shcephtool/test.shsuites/cephfs_journal_tool_smoke.shsuites/iogen.shsuites/pjd.shsuites/dbench.shsuites/iozone-sync.shsuites/fsx.shsuites/fsstress.shsuites/fio.shsuites/iozone.shsuites/blogbench.shsuites/dbench-short.shsuites/bonnie.shsuites/fsync-tester.shsuites/ffsb.shlibcephfs/test.shcls/test_cls_cmpomap.shcls/test_cls_numops.shcls/test_cls_hello.shcls/test_cls_sdk.shcls/test_cls_rbd.shcls/test_cls_refcount.shcls/test_cls_2pc_queue.shcls/test_cls_lock.shcls/test_cls_journal.shcls/test_cls_log.shcls/test_cls_rgw.shosdc/stress_objectcacher.shrbd/merge_diff.shrbd/krbd_stable_pages_required.shrbd/rbd_mirror_ha.shrbd/diff_continuous.shrbd/test_librbd.shrbd/test_lock_fence.shrbd/qemu_rebuild_object_map.shrbd/qemu-iotests.shrbd/test_rbd_mirror.shrbd/krbd_udev_enumerate.shrbd/test_admin_socket.shrbd/krbd_wac.shrbd/notify_slave.shrbd/test_librbd_python.shrbd/rbd_mirror_bootstrap.shrbd/test_rbd_tasks.shrbd/rbd-ggate.shrbd/rbd_mirror_helpers.shrbd/test_rbdmap_RBDMAPFILE.shrbd/verify_pool.shrbd/cli_generic.shrbd/image_read.shrbd/rbd_mirror_fsx_compare.shrbd/read-flags.shrbd/map-unmap.shrbd/journal.shrbd/krbd_udev_netns.shrbd/huge-tickets.shrbd/qemu_dynamic_features.shrbd/simple_big.shrbd/krbd_latest_osdmap_on_map.shrbd/krbd_namespaces.shrbd/rbd_groups.shrbd/krbd_udev_symlinks.shrbd/rbd_mirror_stress.shrbd/permissions.shrbd/notify_master.shrbd/rbd_mirror_fsx_prepare.shrbd/import_export.shrbd/issue-20295.shrbd/map-snapshot-io.shrbd/concurrent.shrbd/qos.shrbd/krbd_huge_osdmap.shrbd/krbd_exclusive_option.shrbd/diff.shrbd/krbd_udev_netlink_enobufs.shrbd/rbd-nbd.shrbd/krbd_data_pool.shrbd/krbd_fallocate.shrbd/kernel.shrbd/rbd_mirror_journal.shrbd/rbd_mirror_snapshot.shkernel_untar_build.shmgr/test_localpool.shhadoop/terasort.shhadoop/repl.shhadoop/wordcount.shrestart/test-backtraces.pyfs/misc/mkpool_layout_vxattrs.shfs/misc/rstats.shfs/misc/subvolume.shfs/misc/filelock_interrupt.pyfs/misc/layout_vxattrs.shfs/misc/direct_io.pyfs/misc/filelock_deadlock.pyfs/misc/chmod.shfs/misc/multiple_rsync.shfs/misc/acl.shfs/misc/xattrs.shfs/misc/i_complete_vs_rename.shfs/misc/dirfrag.shfs/misc/trivial_sync.shfs/test_o_trunc.shfs/upgrade/volume_clientfs/test_python.shfs/multiclient_sync_read_eof.pyfs/quota/quota.shfs/snap-hierarchy.shfs/test_o_truncfs/norstats/kernel_untar_tar.shfs/snaps/snaptest-2.shfs/snaps/snaptest-xattrwb.shfs/snaps/snaptest-double-null.shfs/snaps/snaptest-0.shfs/snaps/snaptest-capwb.shfs/snaps/snaptest-git-ceph.shfs/snaps/untar_snap_rm.shfs/snaps/snaptest-intodir.shfs/snaps/snaptest-1.shfs/snaps/snaptest-dir-rename.shfs/snaps/snaptest-estale.shfs/snaps/snaptest-multiple-capsnaps.shfs/snaps/snaptest-upchildrealms.shfs/snaps/snaptest-parents.shfs/snaps/snaptest-snap-rename.shfs/snaps/snaptest-authwb.shfs/snaps/snaptest-realm-split.shfs/snaps/snap-rm-diff.shfs/snaps/snaptest-snap-rm-cmp.shfs/snaps/snaptest-hardlink.shobjectstore/test_fuse.shcephadm/test_adoption.shcephadm/test_dashboard_e2e.shcephadm/test_repos.shcephadm/create_iscsi_disks.shcephadm/test_cephadm.shcaps/mon_commands.shrest/test-restful.shrest/test_mgr_rest_api.pydirect_io/test_sync_iodirect_io/big.shdirect_io/test_short_dio_readdirect_io/misc.shdirect_io/direct_io_testrename/pri_nul.shrename/prepare.shrename/rem_nul.shrename/rem_pri.shrename/pri_rem.shrename/rem_rem.shrename/pri_pri.shrename/dir_pri_nul.shrename/dir_pri_pri.shrename/all.shrados/test_dedup_tool.shrados/test_large_omap_detection.pyrados/test_pool_access.shrados/test_rados_timeouts.shrados/stress_watch.shrados/clone.shrados/test_envlibrados_for_rocksdb.shrados/load-gen-mix.shrados/test.shrados/test_python.shrados/test_librados_build.shrados/test_hang.shrados/test_health_warnings.shrados/test_crash.shrados/load-gen-mix-small-long.shrados/test_cache_pool.shrados/test_alloc_hint.shrados/load-gen-big.shrados/load-gen-mostlyread.shrados/test_rados_tool.shrados/load-gen-mix-small.shrados/test_pool_quota.shrados/version_number_sanity.sh 2020-11-20T11:49:21.247 INFO:teuthology.orchestra.run.smithi192.stderr:9+1 records in 2020-11-20T11:49:21.247 INFO:teuthology.orchestra.run.smithi192.stderr:9+1 records out 2020-11-20T11:49:21.247 INFO:teuthology.orchestra.run.smithi192.stderr:4744 bytes (4.7 kB, 4.6 KiB) copied, 3.7351e-05 s, 127 MB/s 2020-11-20T11:49:21.248 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2020-11-20T11:49:21.249 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2020-11-20T11:49:21.249 INFO:teuthology.orchestra.run.smithi192:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b86e691bf191566922a8f08e2a5abf64fde8cfcb TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2020-11-20T11:49:21.330 INFO:tasks.workunit.client.0.smithi192.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2020-11-20T11:49:21.330 INFO:tasks.workunit.client.0.smithi192.stdout: 2020-11-20T11:49:21.331 INFO:tasks.workunit.client.0.smithi192.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2020-11-20T11:49:21.340 INFO:tasks.workunit.client.0.smithi192.stdout:0 of 1 processes prepared for launch 0 sec 2020-11-20T11:49:21.440 INFO:tasks.workunit.client.0.smithi192.stdout:1 of 1 processes prepared for launch 0 sec 2020-11-20T11:49:21.441 INFO:tasks.workunit.client.0.smithi192.stdout:releasing clients 2020-11-20T11:49:22.441 INFO:tasks.workunit.client.0.smithi192.stdout: 1 2591 29.00 MB/sec warmup 1 sec latency 10.417 ms 2020-11-20T11:49:23.441 INFO:tasks.workunit.client.0.smithi192.stdout: 1 4984 22.57 MB/sec warmup 2 sec latency 11.719 ms 2020-11-20T11:49:24.402 INFO:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:49:25.701 INFO:tasks.workunit.client.0.smithi192.stdout: 1 7572 19.73 MB/sec warmup 3 sec latency 30.132 ms 2020-11-20T11:49:25.701 INFO:tasks.workunit.client.0.smithi192.stdout: 1 10647 19.17 MB/sec warmup 4 sec latency 12.705 ms 2020-11-20T11:49:25.706 INFO:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:49:25.712 INFO:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:49:26.441 INFO:tasks.workunit.client.0.smithi192.stdout: 1 13094 17.09 MB/sec warmup 5 sec latency 11.790 ms 2020-11-20T11:49:27.441 INFO:tasks.workunit.client.0.smithi192.stdout: 1 15122 16.38 MB/sec warmup 6 sec latency 15.768 ms 2020-11-20T11:49:28.441 INFO:tasks.workunit.client.0.smithi192.stdout: 1 18173 16.65 MB/sec warmup 7 sec latency 9.747 ms 2020-11-20T11:49:29.441 INFO:tasks.workunit.client.0.smithi192.stdout: 1 20682 16.06 MB/sec warmup 8 sec latency 83.853 ms 2020-11-20T11:49:30.441 INFO:tasks.workunit.client.0.smithi192.stdout: 1 22734 15.64 MB/sec warmup 9 sec latency 17.230 ms 2020-11-20T11:49:31.442 INFO:tasks.workunit.client.0.smithi192.stdout: 1 25486 15.49 MB/sec warmup 10 sec latency 11.641 ms 2020-11-20T11:49:32.441 INFO:tasks.workunit.client.0.smithi192.stdout: 1 28640 15.79 MB/sec warmup 11 sec latency 10.648 ms 2020-11-20T11:49:33.441 INFO:tasks.workunit.client.0.smithi192.stdout: 1 30988 15.16 MB/sec warmup 12 sec latency 13.267 ms 2020-11-20T11:49:34.441 INFO:tasks.workunit.client.0.smithi192.stdout: 1 33349 15.24 MB/sec warmup 13 sec latency 39.642 ms 2020-11-20T11:49:35.441 INFO:tasks.workunit.client.0.smithi192.stdout: 1 35927 15.16 MB/sec warmup 14 sec latency 76.482 ms 2020-11-20T11:49:36.442 INFO:tasks.workunit.client.0.smithi192.stdout: 1 38701 15.04 MB/sec warmup 15 sec latency 11.261 ms 2020-11-20T11:49:37.441 INFO:tasks.workunit.client.0.smithi192.stdout: 1 40949 14.80 MB/sec warmup 16 sec latency 9.012 ms 2020-11-20T11:49:38.442 INFO:tasks.workunit.client.0.smithi192.stdout: 1 43400 14.76 MB/sec warmup 17 sec latency 11.922 ms 2020-11-20T11:49:39.442 INFO:tasks.workunit.client.0.smithi192.stdout: 1 46399 14.96 MB/sec warmup 18 sec latency 18.436 ms 2020-11-20T11:49:40.442 INFO:tasks.workunit.client.0.smithi192.stdout: 1 48582 14.56 MB/sec warmup 19 sec latency 77.611 ms 2020-11-20T11:49:41.442 INFO:tasks.workunit.client.0.smithi192.stdout: 1 50681 14.48 MB/sec warmup 20 sec latency 10.795 ms 2020-11-20T11:49:42.442 INFO:tasks.workunit.client.0.smithi192.stdout: 1 53684 14.66 MB/sec warmup 21 sec latency 9.118 ms 2020-11-20T11:49:43.442 INFO:tasks.workunit.client.0.smithi192.stdout: 1 56444 14.60 MB/sec warmup 22 sec latency 18.587 ms 2020-11-20T11:49:44.442 INFO:tasks.workunit.client.0.smithi192.stdout: 1 58980 14.47 MB/sec warmup 23 sec latency 8.141 ms 2020-11-20T11:49:45.442 INFO:tasks.workunit.client.0.smithi192.stdout: 1 61272 14.45 MB/sec warmup 24 sec latency 9.290 ms 2020-11-20T11:49:46.442 INFO:tasks.workunit.client.0.smithi192.stdout: 1 64119 14.59 MB/sec warmup 25 sec latency 122.775 ms 2020-11-20T11:49:47.442 INFO:tasks.workunit.client.0.smithi192.stdout: 1 66880 14.53 MB/sec warmup 26 sec latency 9.088 ms 2020-11-20T11:49:48.442 INFO:tasks.workunit.client.0.smithi192.stdout: 1 69294 14.43 MB/sec warmup 27 sec latency 8.498 ms 2020-11-20T11:49:49.442 INFO:tasks.workunit.client.0.smithi192.stdout: 1 71765 14.43 MB/sec warmup 28 sec latency 9.794 ms 2020-11-20T11:49:50.442 INFO:tasks.workunit.client.0.smithi192.stdout: 1 74821 14.56 MB/sec warmup 29 sec latency 22.453 ms 2020-11-20T11:49:51.442 INFO:tasks.workunit.client.0.smithi192.stdout: 1 77102 14.35 MB/sec warmup 30 sec latency 105.212 ms 2020-11-20T11:49:52.442 INFO:tasks.workunit.client.0.smithi192.stdout: 1 78970 14.27 MB/sec warmup 31 sec latency 38.355 ms 2020-11-20T11:49:53.442 INFO:tasks.workunit.client.0.smithi192.stdout: 1 82022 14.40 MB/sec warmup 32 sec latency 13.878 ms 2020-11-20T11:49:54.442 INFO:tasks.workunit.client.0.smithi192.stdout: 1 84647 14.35 MB/sec warmup 33 sec latency 9.482 ms 2020-11-20T11:49:55.442 INFO:tasks.workunit.client.0.smithi192.stdout: 1 86864 14.27 MB/sec warmup 34 sec latency 15.020 ms 2020-11-20T11:49:55.773 INFO:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:49:55.776 INFO:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:49:55.778 INFO:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:49:56.442 INFO:tasks.workunit.client.0.smithi192.stdout: 1 89470 14.27 MB/sec warmup 35 sec latency 10.760 ms 2020-11-20T11:49:57.442 INFO:tasks.workunit.client.0.smithi192.stdout: 1 92506 14.39 MB/sec warmup 36 sec latency 36.257 ms 2020-11-20T11:49:58.442 INFO:tasks.workunit.client.0.smithi192.stdout: 1 93757 14.14 MB/sec warmup 37 sec latency 95.050 ms 2020-11-20T11:49:59.442 INFO:tasks.workunit.client.0.smithi192.stdout: 1 96379 14.14 MB/sec warmup 38 sec latency 11.083 ms 2020-11-20T11:50:00.442 INFO:tasks.workunit.client.0.smithi192.stdout: 1 99325 14.22 MB/sec warmup 39 sec latency 14.858 ms 2020-11-20T11:50:01.442 INFO:tasks.workunit.client.0.smithi192.stdout: 1 101556 14.06 MB/sec warmup 40 sec latency 19.976 ms 2020-11-20T11:50:02.442 INFO:tasks.workunit.client.0.smithi192.stdout: 1 103492 14.04 MB/sec warmup 41 sec latency 73.086 ms 2020-11-20T11:50:03.442 INFO:tasks.workunit.client.0.smithi192.stdout: 1 105691 13.97 MB/sec warmup 42 sec latency 49.085 ms 2020-11-20T11:50:04.442 INFO:tasks.workunit.client.0.smithi192.stdout: 1 107853 13.95 MB/sec warmup 43 sec latency 9.323 ms 2020-11-20T11:50:05.442 INFO:tasks.workunit.client.0.smithi192.stdout: 1 110463 13.95 MB/sec warmup 44 sec latency 17.723 ms 2020-11-20T11:50:06.442 INFO:tasks.workunit.client.0.smithi192.stdout: 1 113176 13.93 MB/sec warmup 45 sec latency 21.836 ms 2020-11-20T11:50:07.442 INFO:tasks.workunit.client.0.smithi192.stdout: 1 115211 13.87 MB/sec warmup 46 sec latency 9.159 ms 2020-11-20T11:50:08.443 INFO:tasks.workunit.client.0.smithi192.stdout: 1 117366 13.87 MB/sec warmup 47 sec latency 192.671 ms 2020-11-20T11:50:09.443 INFO:tasks.workunit.client.0.smithi192.stdout: 1 119581 13.75 MB/sec warmup 48 sec latency 25.705 ms 2020-11-20T11:50:10.443 INFO:tasks.workunit.client.0.smithi192.stdout: 1 121892 13.74 MB/sec warmup 49 sec latency 7.876 ms 2020-11-20T11:50:11.443 INFO:tasks.workunit.client.0.smithi192.stdout: 1 124779 13.81 MB/sec warmup 50 sec latency 12.758 ms 2020-11-20T11:50:12.443 INFO:tasks.workunit.client.0.smithi192.stdout: 1 127951 13.90 MB/sec warmup 51 sec latency 10.070 ms 2020-11-20T11:50:13.443 INFO:tasks.workunit.client.0.smithi192.stdout: 1 129220 13.74 MB/sec warmup 52 sec latency 171.278 ms 2020-11-20T11:50:14.443 INFO:tasks.workunit.client.0.smithi192.stdout: 1 131708 13.75 MB/sec warmup 53 sec latency 18.375 ms 2020-11-20T11:50:15.443 INFO:tasks.workunit.client.0.smithi192.stdout: 1 134483 13.74 MB/sec warmup 54 sec latency 15.033 ms 2020-11-20T11:50:16.443 INFO:tasks.workunit.client.0.smithi192.stdout: 1 136515 13.69 MB/sec warmup 55 sec latency 11.252 ms 2020-11-20T11:50:17.443 INFO:tasks.workunit.client.0.smithi192.stdout: 1 139044 13.70 MB/sec warmup 56 sec latency 11.658 ms 2020-11-20T11:50:18.443 INFO:tasks.workunit.client.0.smithi192.stdout: 1 141344 13.67 MB/sec warmup 57 sec latency 85.722 ms 2020-11-20T11:50:19.443 INFO:tasks.workunit.client.0.smithi192.stdout: 1 142880 13.57 MB/sec warmup 58 sec latency 84.406 ms 2020-11-20T11:50:20.444 INFO:tasks.workunit.client.0.smithi192.stdout: 1 145833 13.64 MB/sec warmup 59 sec latency 11.359 ms 2020-11-20T11:50:21.443 INFO:tasks.workunit.client.0.smithi192.stdout: 1 148375 13.63 MB/sec warmup 60 sec latency 56.009 ms 2020-11-20T11:50:22.443 INFO:tasks.workunit.client.0.smithi192.stdout: 1 150506 13.59 MB/sec warmup 61 sec latency 9.725 ms 2020-11-20T11:50:23.443 INFO:tasks.workunit.client.0.smithi192.stdout: 1 152930 13.60 MB/sec warmup 62 sec latency 95.097 ms 2020-11-20T11:50:24.445 INFO:tasks.workunit.client.0.smithi192.stdout: 1 155145 13.51 MB/sec warmup 63 sec latency 29.153 ms 2020-11-20T11:50:25.444 INFO:tasks.workunit.client.0.smithi192.stdout: 1 157546 13.55 MB/sec warmup 64 sec latency 7.895 ms 2020-11-20T11:50:25.838 INFO:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:50:25.842 INFO:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:50:25.844 INFO:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:50:26.444 INFO:tasks.workunit.client.0.smithi192.stdout: 1 160362 13.57 MB/sec warmup 65 sec latency 12.267 ms 2020-11-20T11:50:27.444 INFO:tasks.workunit.client.0.smithi192.stdout: 1 163406 13.64 MB/sec warmup 66 sec latency 14.154 ms 2020-11-20T11:50:28.444 INFO:tasks.workunit.client.0.smithi192.stdout: 1 164958 13.52 MB/sec warmup 67 sec latency 55.401 ms 2020-11-20T11:50:29.445 INFO:tasks.workunit.client.0.smithi192.stdout: 1 167409 13.53 MB/sec warmup 68 sec latency 24.861 ms 2020-11-20T11:50:30.444 INFO:tasks.workunit.client.0.smithi192.stdout: 1 169660 13.51 MB/sec warmup 69 sec latency 237.920 ms 2020-11-20T11:50:31.444 INFO:tasks.workunit.client.0.smithi192.stdout: 1 171745 13.48 MB/sec warmup 70 sec latency 9.589 ms 2020-11-20T11:50:32.444 INFO:tasks.workunit.client.0.smithi192.stdout: 1 174418 13.49 MB/sec warmup 71 sec latency 13.348 ms 2020-11-20T11:50:33.444 INFO:tasks.workunit.client.0.smithi192.stdout: 1 176788 13.48 MB/sec warmup 72 sec latency 54.981 ms 2020-11-20T11:50:34.445 INFO:tasks.workunit.client.0.smithi192.stdout: 1 178438 13.41 MB/sec warmup 73 sec latency 27.886 ms 2020-11-20T11:50:35.444 INFO:tasks.workunit.client.0.smithi192.stdout: 1 181274 13.46 MB/sec warmup 74 sec latency 90.804 ms 2020-11-20T11:50:36.444 INFO:tasks.workunit.client.0.smithi192.stdout: 1 183791 13.43 MB/sec warmup 75 sec latency 37.101 ms 2020-11-20T11:50:37.444 INFO:tasks.workunit.client.0.smithi192.stdout: 1 185975 13.43 MB/sec warmup 76 sec latency 9.992 ms 2020-11-20T11:50:38.444 INFO:tasks.workunit.client.0.smithi192.stdout: 1 188473 13.43 MB/sec warmup 77 sec latency 38.168 ms 2020-11-20T11:50:39.447 INFO:tasks.workunit.client.0.smithi192.stdout: 1 190447 13.35 MB/sec warmup 78 sec latency 89.794 ms 2020-11-20T11:50:40.444 INFO:tasks.workunit.client.0.smithi192.stdout: 1 192605 13.36 MB/sec warmup 79 sec latency 8.903 ms 2020-11-20T11:50:41.448 INFO:tasks.workunit.client.0.smithi192.stdout: 1 195338 13.40 MB/sec warmup 80 sec latency 77.319 ms 2020-11-20T11:50:42.445 INFO:tasks.workunit.client.0.smithi192.stdout: 1 197697 13.34 MB/sec warmup 81 sec latency 10.732 ms 2020-11-20T11:50:43.445 INFO:tasks.workunit.client.0.smithi192.stdout: 1 199697 13.34 MB/sec warmup 82 sec latency 11.609 ms 2020-11-20T11:50:44.445 INFO:tasks.workunit.client.0.smithi192.stdout: 1 201995 13.33 MB/sec warmup 83 sec latency 73.408 ms 2020-11-20T11:50:45.445 INFO:tasks.workunit.client.0.smithi192.stdout: 1 204165 13.29 MB/sec warmup 84 sec latency 10.982 ms 2020-11-20T11:50:46.445 INFO:tasks.workunit.client.0.smithi192.stdout: 1 206469 13.30 MB/sec warmup 85 sec latency 15.155 ms 2020-11-20T11:50:47.445 INFO:tasks.workunit.client.0.smithi192.stdout: 1 209077 13.31 MB/sec warmup 86 sec latency 87.711 ms 2020-11-20T11:50:48.446 INFO:tasks.workunit.client.0.smithi192.stdout: 1 211257 13.27 MB/sec warmup 87 sec latency 10.915 ms 2020-11-20T11:50:49.445 INFO:tasks.workunit.client.0.smithi192.stdout: 1 213099 13.27 MB/sec warmup 88 sec latency 50.415 ms 2020-11-20T11:50:50.445 INFO:tasks.workunit.client.0.smithi192.stdout: 1 215372 13.21 MB/sec warmup 89 sec latency 25.769 ms 2020-11-20T11:50:51.445 INFO:tasks.workunit.client.0.smithi192.stdout: 1 217481 13.22 MB/sec warmup 90 sec latency 14.135 ms 2020-11-20T11:50:52.445 INFO:tasks.workunit.client.0.smithi192.stdout: 1 220175 13.26 MB/sec warmup 91 sec latency 87.139 ms 2020-11-20T11:50:53.445 INFO:tasks.workunit.client.0.smithi192.stdout: 1 222444 13.20 MB/sec warmup 92 sec latency 13.894 ms 2020-11-20T11:50:54.446 INFO:tasks.workunit.client.0.smithi192.stdout: 1 224303 13.18 MB/sec warmup 93 sec latency 104.285 ms 2020-11-20T11:50:55.445 INFO:tasks.workunit.client.0.smithi192.stdout: 1 227155 13.23 MB/sec warmup 94 sec latency 25.895 ms 2020-11-20T11:50:56.162 INFO:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:50:56.165 INFO:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:50:56.168 INFO:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:50:56.446 INFO:tasks.workunit.client.0.smithi192.stdout: 1 229445 13.18 MB/sec warmup 95 sec latency 16.708 ms 2020-11-20T11:50:57.445 INFO:tasks.workunit.client.0.smithi192.stdout: 1 231385 13.17 MB/sec warmup 96 sec latency 60.720 ms 2020-11-20T11:50:58.445 INFO:tasks.workunit.client.0.smithi192.stdout: 1 234359 13.22 MB/sec warmup 97 sec latency 33.505 ms 2020-11-20T11:50:59.445 INFO:tasks.workunit.client.0.smithi192.stdout: 1 235616 13.14 MB/sec warmup 98 sec latency 205.846 ms 2020-11-20T11:51:00.445 INFO:tasks.workunit.client.0.smithi192.stdout: 1 238064 13.15 MB/sec warmup 99 sec latency 22.102 ms 2020-11-20T11:51:01.445 INFO:tasks.workunit.client.0.smithi192.stdout: 1 240462 13.13 MB/sec warmup 100 sec latency 38.831 ms 2020-11-20T11:51:02.446 INFO:tasks.workunit.client.0.smithi192.stdout: 1 242217 13.09 MB/sec warmup 101 sec latency 27.606 ms 2020-11-20T11:51:03.446 INFO:tasks.workunit.client.0.smithi192.stdout: 1 245028 13.14 MB/sec warmup 102 sec latency 55.431 ms 2020-11-20T11:51:04.447 INFO:tasks.workunit.client.0.smithi192.stdout: 1 246454 13.06 MB/sec warmup 103 sec latency 63.369 ms 2020-11-20T11:51:05.449 INFO:tasks.workunit.client.0.smithi192.stdout: 1 248930 13.07 MB/sec warmup 104 sec latency 14.096 ms 2020-11-20T11:51:06.446 INFO:tasks.workunit.client.0.smithi192.stdout: 1 251523 13.08 MB/sec warmup 105 sec latency 59.392 ms 2020-11-20T11:51:07.446 INFO:tasks.workunit.client.0.smithi192.stdout: 1 253548 13.06 MB/sec warmup 106 sec latency 12.658 ms 2020-11-20T11:51:08.446 INFO:tasks.workunit.client.0.smithi192.stdout: 1 256029 13.06 MB/sec warmup 107 sec latency 16.056 ms 2020-11-20T11:51:09.447 INFO:tasks.workunit.client.0.smithi192.stdout: 1 257877 13.01 MB/sec warmup 108 sec latency 69.622 ms 2020-11-20T11:51:10.447 INFO:tasks.workunit.client.0.smithi192.stdout: 1 259760 13.00 MB/sec warmup 109 sec latency 19.410 ms 2020-11-20T11:51:11.446 INFO:tasks.workunit.client.0.smithi192.stdout: 1 262752 13.05 MB/sec warmup 110 sec latency 10.338 ms 2020-11-20T11:51:12.446 INFO:tasks.workunit.client.0.smithi192.stdout: 1 264967 13.00 MB/sec warmup 111 sec latency 11.844 ms 2020-11-20T11:51:13.446 INFO:tasks.workunit.client.0.smithi192.stdout: 1 267133 13.01 MB/sec warmup 112 sec latency 9.615 ms 2020-11-20T11:51:14.446 INFO:tasks.workunit.client.0.smithi192.stdout: 1 269677 13.03 MB/sec warmup 113 sec latency 202.958 ms 2020-11-20T11:51:15.446 INFO:tasks.workunit.client.0.smithi192.stdout: 1 270790 12.95 MB/sec warmup 114 sec latency 226.758 ms 2020-11-20T11:51:16.446 INFO:tasks.workunit.client.0.smithi192.stdout: 1 273609 12.99 MB/sec warmup 115 sec latency 11.636 ms 2020-11-20T11:51:17.447 INFO:tasks.workunit.client.0.smithi192.stdout: 1 276172 12.98 MB/sec warmup 116 sec latency 17.321 ms 2020-11-20T11:51:18.446 INFO:tasks.workunit.client.0.smithi192.stdout: 1 278252 12.97 MB/sec warmup 117 sec latency 9.556 ms 2020-11-20T11:51:19.446 INFO:tasks.workunit.client.0.smithi192.stdout: 1 280705 12.98 MB/sec warmup 118 sec latency 72.753 ms 2020-11-20T11:51:20.447 INFO:tasks.workunit.client.0.smithi192.stdout: 1 282272 12.92 MB/sec warmup 119 sec latency 135.578 ms 2020-11-20T11:51:22.446 INFO:tasks.workunit.client.0.smithi192.stdout: 1 287294 17.16 MB/sec execute 1 sec latency 28.649 ms 2020-11-20T11:51:23.447 INFO:tasks.workunit.client.0.smithi192.stdout: 1 289096 12.10 MB/sec execute 2 sec latency 91.774 ms 2020-11-20T11:51:24.446 INFO:tasks.workunit.client.0.smithi192.stdout: 1 291561 12.74 MB/sec execute 3 sec latency 9.920 ms 2020-11-20T11:51:25.447 INFO:tasks.workunit.client.0.smithi192.stdout: 1 293275 11.25 MB/sec execute 4 sec latency 148.740 ms 2020-11-20T11:51:26.447 INFO:tasks.workunit.client.0.smithi192.stdout: 1 295236 11.53 MB/sec execute 5 sec latency 11.491 ms 2020-11-20T11:51:26.539 INFO:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:51:26.545 INFO:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:51:26.556 INFO:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:51:27.447 INFO:tasks.workunit.client.0.smithi192.stdout: 1 298185 12.66 MB/sec execute 6 sec latency 17.743 ms 2020-11-20T11:51:28.447 INFO:tasks.workunit.client.0.smithi192.stdout: 1 300364 11.89 MB/sec execute 7 sec latency 12.813 ms 2020-11-20T11:51:29.447 INFO:tasks.workunit.client.0.smithi192.stdout: 1 302335 11.99 MB/sec execute 8 sec latency 13.758 ms 2020-11-20T11:51:30.447 INFO:tasks.workunit.client.0.smithi192.stdout: 1 304415 11.91 MB/sec execute 9 sec latency 65.104 ms 2020-11-20T11:51:31.447 INFO:tasks.workunit.client.0.smithi192.stdout: 1 306316 11.66 MB/sec execute 10 sec latency 9.095 ms 2020-11-20T11:51:32.447 INFO:tasks.workunit.client.0.smithi192.stdout: 1 309058 12.14 MB/sec execute 11 sec latency 17.013 ms 2020-11-20T11:51:33.447 INFO:tasks.workunit.client.0.smithi192.stdout: 1 311600 12.18 MB/sec execute 12 sec latency 19.587 ms 2020-11-20T11:51:34.447 INFO:tasks.workunit.client.0.smithi192.stdout: 1 313674 12.14 MB/sec execute 13 sec latency 11.151 ms 2020-11-20T11:51:35.448 INFO:tasks.workunit.client.0.smithi192.stdout: 1 314759 11.48 MB/sec execute 14 sec latency 345.636 ms 2020-11-20T11:51:36.447 INFO:tasks.workunit.client.0.smithi192.stdout: 1 315450 11.14 MB/sec execute 15 sec latency 435.602 ms 2020-11-20T11:51:37.447 INFO:tasks.workunit.client.0.smithi192.stdout: 1 316393 10.75 MB/sec execute 16 sec latency 49.400 ms 2020-11-20T11:51:38.449 INFO:tasks.workunit.client.0.smithi192.stdout: 1 318620 10.84 MB/sec execute 17 sec latency 19.714 ms 2020-11-20T11:51:39.447 INFO:tasks.workunit.client.0.smithi192.stdout: 1 320467 10.73 MB/sec execute 18 sec latency 10.160 ms 2020-11-20T11:51:40.447 INFO:tasks.workunit.client.0.smithi192.stdout: 1 323240 11.06 MB/sec execute 19 sec latency 9.070 ms 2020-11-20T11:51:41.447 INFO:tasks.workunit.client.0.smithi192.stdout: 1 325396 10.91 MB/sec execute 20 sec latency 65.542 ms 2020-11-20T11:51:42.447 INFO:tasks.workunit.client.0.smithi192.stdout: 1 327250 10.95 MB/sec execute 21 sec latency 35.718 ms 2020-11-20T11:51:43.447 INFO:tasks.workunit.client.0.smithi192.stdout: 1 330170 11.27 MB/sec execute 22 sec latency 23.009 ms 2020-11-20T11:51:44.447 INFO:tasks.workunit.client.0.smithi192.stdout: 1 332652 11.27 MB/sec execute 23 sec latency 9.956 ms 2020-11-20T11:51:45.448 INFO:tasks.workunit.client.0.smithi192.stdout: 1 334532 11.23 MB/sec execute 24 sec latency 11.713 ms 2020-11-20T11:51:46.448 INFO:tasks.workunit.client.0.smithi192.stdout: 1 337240 11.45 MB/sec execute 25 sec latency 18.527 ms 2020-11-20T11:51:47.448 INFO:tasks.workunit.client.0.smithi192.stdout: 1 339324 11.29 MB/sec execute 26 sec latency 60.498 ms 2020-11-20T11:51:48.449 INFO:tasks.workunit.client.0.smithi192.stdout: 1 341321 11.34 MB/sec execute 27 sec latency 11.382 ms 2020-11-20T11:51:49.448 INFO:tasks.workunit.client.0.smithi192.stdout: 1 344276 11.59 MB/sec execute 28 sec latency 15.011 ms 2020-11-20T11:51:50.449 INFO:tasks.workunit.client.0.smithi192.stdout: 1 346451 11.44 MB/sec execute 29 sec latency 15.602 ms 2020-11-20T11:51:51.448 INFO:tasks.workunit.client.0.smithi192.stdout: 1 348497 11.49 MB/sec execute 30 sec latency 11.855 ms 2020-11-20T11:51:52.448 INFO:tasks.workunit.client.0.smithi192.stdout: 1 351399 11.70 MB/sec execute 31 sec latency 24.662 ms 2020-11-20T11:51:53.448 INFO:tasks.workunit.client.0.smithi192.stdout: 1 353048 11.51 MB/sec execute 32 sec latency 103.981 ms 2020-11-20T11:51:54.448 INFO:tasks.workunit.client.0.smithi192.stdout: 1 355442 11.59 MB/sec execute 33 sec latency 11.660 ms 2020-11-20T11:51:55.448 INFO:tasks.workunit.client.0.smithi192.stdout: 1 358391 11.76 MB/sec execute 34 sec latency 17.304 ms 2020-11-20T11:51:56.448 INFO:tasks.workunit.client.0.smithi192.stdout: 1 360627 11.66 MB/sec execute 35 sec latency 12.365 ms 2020-11-20T11:51:56.676 INFO:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:51:56.691 INFO:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:51:56.704 INFO:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:51:57.448 INFO:tasks.workunit.client.0.smithi192.stdout: 1 362526 11.69 MB/sec execute 36 sec latency 72.595 ms 2020-11-20T11:51:58.448 INFO:tasks.workunit.client.0.smithi192.stdout: 1 365094 11.75 MB/sec execute 37 sec latency 92.276 ms 2020-11-20T11:51:59.448 INFO:tasks.workunit.client.0.smithi192.stdout: 1 366989 11.70 MB/sec execute 38 sec latency 13.555 ms 2020-11-20T11:52:00.448 INFO:tasks.workunit.client.0.smithi192.stdout: 1 369458 11.76 MB/sec execute 39 sec latency 12.009 ms 2020-11-20T11:52:01.448 INFO:tasks.workunit.client.0.smithi192.stdout: 1 372057 11.79 MB/sec execute 40 sec latency 15.225 ms 2020-11-20T11:52:02.448 INFO:tasks.workunit.client.0.smithi192.stdout: 1 373615 11.70 MB/sec execute 41 sec latency 36.459 ms 2020-11-20T11:52:03.448 INFO:tasks.workunit.client.0.smithi192.stdout: 1 376271 11.82 MB/sec execute 42 sec latency 50.144 ms 2020-11-20T11:52:04.448 INFO:tasks.workunit.client.0.smithi192.stdout: 1 378443 11.72 MB/sec execute 43 sec latency 72.250 ms 2020-11-20T11:52:05.448 INFO:tasks.workunit.client.0.smithi192.stdout: 1 380372 11.74 MB/sec execute 44 sec latency 9.591 ms 2020-11-20T11:52:06.449 INFO:tasks.workunit.client.0.smithi192.stdout: 1 383195 11.86 MB/sec execute 45 sec latency 13.759 ms 2020-11-20T11:52:07.451 INFO:tasks.workunit.client.0.smithi192.stdout: 1 384931 11.75 MB/sec execute 46 sec latency 14.604 ms 2020-11-20T11:52:08.448 INFO:tasks.workunit.client.0.smithi192.stdout: 1 387233 11.79 MB/sec execute 47 sec latency 14.086 ms 2020-11-20T11:52:09.448 INFO:tasks.workunit.client.0.smithi192.stdout: 1 389442 11.78 MB/sec execute 48 sec latency 84.186 ms 2020-11-20T11:52:10.448 INFO:tasks.workunit.client.0.smithi192.stdout: 1 391199 11.72 MB/sec execute 49 sec latency 9.150 ms 2020-11-20T11:52:11.448 INFO:tasks.workunit.client.0.smithi192.stdout: 1 391644 11.57 MB/sec execute 50 sec latency 571.916 ms 2020-11-20T11:52:12.449 INFO:tasks.workunit.client.0.smithi192.stdout: 1 392698 11.40 MB/sec execute 51 sec latency 743.311 ms 2020-11-20T11:52:13.449 INFO:tasks.workunit.client.0.smithi192.stdout: 1 394139 11.40 MB/sec execute 52 sec latency 18.039 ms 2020-11-20T11:52:14.449 INFO:tasks.workunit.client.0.smithi192.stdout: 1 395593 11.28 MB/sec execute 53 sec latency 24.640 ms 2020-11-20T11:52:15.449 INFO:tasks.workunit.client.0.smithi192.stdout: 1 397776 11.33 MB/sec execute 54 sec latency 32.501 ms 2020-11-20T11:52:16.449 INFO:tasks.workunit.client.0.smithi192.stdout: 1 400188 11.33 MB/sec execute 55 sec latency 14.202 ms 2020-11-20T11:52:17.449 INFO:tasks.workunit.client.0.smithi192.stdout: 1 401966 11.30 MB/sec execute 56 sec latency 11.719 ms 2020-11-20T11:52:18.449 INFO:tasks.workunit.client.0.smithi192.stdout: 1 404764 11.40 MB/sec execute 57 sec latency 19.964 ms 2020-11-20T11:52:19.449 INFO:tasks.workunit.client.0.smithi192.stdout: 1 406891 11.34 MB/sec execute 58 sec latency 18.029 ms 2020-11-20T11:52:20.449 INFO:tasks.workunit.client.0.smithi192.stdout: 1 408690 11.35 MB/sec execute 59 sec latency 69.201 ms 2020-11-20T11:52:21.449 INFO:tasks.workunit.client.0.smithi192.stdout: 1 411497 11.44 MB/sec execute 60 sec latency 21.090 ms 2020-11-20T11:52:22.449 INFO:tasks.workunit.client.0.smithi192.stdout: 1 413195 11.37 MB/sec execute 61 sec latency 19.174 ms 2020-11-20T11:52:23.449 INFO:tasks.workunit.client.0.smithi192.stdout: 1 415705 11.41 MB/sec execute 62 sec latency 11.078 ms 2020-11-20T11:52:24.449 INFO:tasks.workunit.client.0.smithi192.stdout: 1 418247 11.44 MB/sec execute 63 sec latency 16.472 ms 2020-11-20T11:52:25.449 INFO:tasks.workunit.client.0.smithi192.stdout: 1 420052 11.43 MB/sec execute 64 sec latency 30.373 ms 2020-11-20T11:52:26.449 INFO:tasks.workunit.client.0.smithi192.stdout: 1 422498 11.47 MB/sec execute 65 sec latency 57.245 ms 2020-11-20T11:52:26.970 INFO:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:52:26.974 INFO:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:52:26.977 INFO:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:52:27.449 INFO:tasks.workunit.client.0.smithi192.stdout: 1 424623 11.41 MB/sec execute 66 sec latency 53.483 ms 2020-11-20T11:52:28.449 INFO:tasks.workunit.client.0.smithi192.stdout: 1 426454 11.42 MB/sec execute 67 sec latency 22.007 ms 2020-11-20T11:52:29.451 INFO:tasks.workunit.client.0.smithi192.stdout: 1 429202 11.50 MB/sec execute 68 sec latency 25.784 ms 2020-11-20T11:52:30.449 INFO:tasks.workunit.client.0.smithi192.stdout: 1 431083 11.44 MB/sec execute 69 sec latency 12.026 ms 2020-11-20T11:52:31.449 INFO:tasks.workunit.client.0.smithi192.stdout: 1 433128 11.47 MB/sec execute 70 sec latency 88.153 ms 2020-11-20T11:52:32.450 INFO:tasks.workunit.client.0.smithi192.stdout: 1 435220 11.41 MB/sec execute 71 sec latency 15.096 ms 2020-11-20T11:52:33.449 INFO:tasks.workunit.client.0.smithi192.stdout: 1 437093 11.42 MB/sec execute 72 sec latency 11.730 ms 2020-11-20T11:52:34.449 INFO:tasks.workunit.client.0.smithi192.stdout: 1 439801 11.50 MB/sec execute 73 sec latency 15.733 ms 2020-11-20T11:52:35.450 INFO:tasks.workunit.client.0.smithi192.stdout: 1 441280 11.43 MB/sec execute 74 sec latency 17.933 ms 2020-11-20T11:52:36.449 INFO:tasks.workunit.client.0.smithi192.stdout: 1 443728 11.47 MB/sec execute 75 sec latency 17.750 ms 2020-11-20T11:52:37.450 INFO:tasks.workunit.client.0.smithi192.stdout: 1 445099 11.39 MB/sec execute 76 sec latency 84.836 ms 2020-11-20T11:52:38.450 INFO:tasks.workunit.client.0.smithi192.stdout: 1 447482 11.42 MB/sec execute 77 sec latency 13.189 ms 2020-11-20T11:52:39.450 INFO:tasks.workunit.client.0.smithi192.stdout: 1 449861 11.43 MB/sec execute 78 sec latency 55.210 ms 2020-11-20T11:52:40.450 INFO:tasks.workunit.client.0.smithi192.stdout: 1 451379 11.38 MB/sec execute 79 sec latency 19.339 ms 2020-11-20T11:52:41.450 INFO:tasks.workunit.client.0.smithi192.stdout: 1 454178 11.45 MB/sec execute 80 sec latency 15.831 ms 2020-11-20T11:52:42.450 INFO:tasks.workunit.client.0.smithi192.stdout: 1 455646 11.39 MB/sec execute 81 sec latency 31.584 ms 2020-11-20T11:52:43.450 INFO:tasks.workunit.client.0.smithi192.stdout: 1 458024 11.42 MB/sec execute 82 sec latency 11.780 ms 2020-11-20T11:52:44.450 INFO:tasks.workunit.client.0.smithi192.stdout: 1 459516 11.57 MB/sec execute 83 sec latency 18.372 ms 2020-11-20T11:52:45.450 INFO:tasks.workunit.client.0.smithi192.stdout: 1 462311 11.63 MB/sec execute 84 sec latency 12.105 ms 2020-11-20T11:52:46.450 INFO:tasks.workunit.client.0.smithi192.stdout: 1 464833 11.64 MB/sec execute 85 sec latency 31.248 ms 2020-11-20T11:52:47.450 INFO:tasks.workunit.client.0.smithi192.stdout: 1 464883 11.51 MB/sec execute 86 sec latency 338.556 ms 2020-11-20T11:52:48.450 INFO:tasks.workunit.client.0.smithi192.stdout: 1 465609 11.44 MB/sec execute 87 sec latency 701.246 ms 2020-11-20T11:52:49.450 INFO:tasks.workunit.client.0.smithi192.stdout: 1 466504 11.34 MB/sec execute 88 sec latency 15.014 ms 2020-11-20T11:52:50.451 INFO:tasks.workunit.client.0.smithi192.stdout: 1 468955 11.39 MB/sec execute 89 sec latency 42.179 ms 2020-11-20T11:52:51.450 INFO:tasks.workunit.client.0.smithi192.stdout: 1 470523 11.34 MB/sec execute 90 sec latency 17.175 ms 2020-11-20T11:52:52.451 INFO:tasks.workunit.client.0.smithi192.stdout: 1 473083 11.37 MB/sec execute 91 sec latency 17.872 ms 2020-11-20T11:52:53.451 INFO:tasks.workunit.client.0.smithi192.stdout: 1 475458 11.38 MB/sec execute 92 sec latency 25.751 ms 2020-11-20T11:52:54.450 INFO:tasks.workunit.client.0.smithi192.stdout: 1 477223 11.35 MB/sec execute 93 sec latency 57.007 ms 2020-11-20T11:52:55.450 INFO:tasks.workunit.client.0.smithi192.stdout: 1 480033 11.41 MB/sec execute 94 sec latency 17.561 ms 2020-11-20T11:52:56.452 INFO:tasks.workunit.client.0.smithi192.stdout: 1 482104 11.37 MB/sec execute 95 sec latency 12.831 ms 2020-11-20T11:52:57.315 INFO:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:52:57.318 INFO:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:52:57.446 INFO:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:52:57.451 INFO:tasks.workunit.client.0.smithi192.stdout: 1 483810 11.37 MB/sec execute 96 sec latency 16.205 ms 2020-11-20T11:52:58.451 INFO:tasks.workunit.client.0.smithi192.stdout: 1 486146 11.38 MB/sec execute 97 sec latency 12.170 ms 2020-11-20T11:52:59.451 INFO:tasks.workunit.client.0.smithi192.stdout: 1 487495 11.34 MB/sec execute 98 sec latency 67.904 ms 2020-11-20T11:53:00.451 INFO:tasks.workunit.client.0.smithi192.stdout: 1 489960 11.36 MB/sec execute 99 sec latency 20.226 ms 2020-11-20T11:53:01.451 INFO:tasks.workunit.client.0.smithi192.stdout: 1 491358 11.32 MB/sec execute 100 sec latency 14.357 ms 2020-11-20T11:53:02.451 INFO:tasks.workunit.client.0.smithi192.stdout: 1 493941 11.36 MB/sec execute 101 sec latency 21.739 ms 2020-11-20T11:53:03.451 INFO:tasks.workunit.client.0.smithi192.stdout: 1 495556 11.32 MB/sec execute 102 sec latency 15.530 ms 2020-11-20T11:53:04.451 INFO:tasks.workunit.client.0.smithi192.stdout: 1 497783 11.34 MB/sec execute 103 sec latency 63.772 ms 2020-11-20T11:53:05.451 INFO:tasks.workunit.client.0.smithi192.stdout: 1 499984 11.31 MB/sec execute 104 sec latency 19.239 ms 2020-11-20T11:53:06.451 INFO:tasks.workunit.client.0.smithi192.stdout: 1 501868 11.32 MB/sec execute 105 sec latency 11.355 ms 2020-11-20T11:53:07.451 INFO:tasks.workunit.client.0.smithi192.stdout: 1 504759 11.38 MB/sec execute 106 sec latency 10.901 ms 2020-11-20T11:53:08.451 INFO:tasks.workunit.client.0.smithi192.stdout: 1 506470 11.33 MB/sec execute 107 sec latency 26.758 ms 2020-11-20T11:53:09.451 INFO:tasks.workunit.client.0.smithi192.stdout: 1 508749 11.35 MB/sec execute 108 sec latency 12.452 ms 2020-11-20T11:53:10.451 INFO:tasks.workunit.client.0.smithi192.stdout: 1 510811 11.35 MB/sec execute 109 sec latency 98.315 ms 2020-11-20T11:53:11.451 INFO:tasks.workunit.client.0.smithi192.stdout: 1 512573 11.32 MB/sec execute 110 sec latency 11.603 ms 2020-11-20T11:53:12.451 INFO:tasks.workunit.client.0.smithi192.stdout: 1 515365 11.38 MB/sec execute 111 sec latency 12.962 ms 2020-11-20T11:53:13.451 INFO:tasks.workunit.client.0.smithi192.stdout: 1 516816 11.33 MB/sec execute 112 sec latency 37.449 ms 2020-11-20T11:53:14.612 INFO:tasks.workunit.client.0.smithi192.stdout: 1 519151 11.35 MB/sec execute 113 sec latency 15.782 ms 2020-11-20T11:53:15.451 INFO:tasks.workunit.client.0.smithi192.stdout: 1 521091 11.32 MB/sec execute 114 sec latency 66.395 ms 2020-11-20T11:53:16.452 INFO:tasks.workunit.client.0.smithi192.stdout: 1 522994 11.33 MB/sec execute 115 sec latency 11.693 ms 2020-11-20T11:53:17.452 INFO:tasks.workunit.client.0.smithi192.stdout: 1 525541 11.35 MB/sec execute 116 sec latency 17.207 ms 2020-11-20T11:53:18.452 INFO:tasks.workunit.client.0.smithi192.stdout: 1 527260 11.34 MB/sec execute 117 sec latency 11.691 ms 2020-11-20T11:53:19.619 INFO:tasks.workunit.client.0.smithi192.stdout: 1 529688 11.36 MB/sec execute 118 sec latency 15.670 ms 2020-11-20T11:53:20.452 INFO:tasks.workunit.client.0.smithi192.stdout: 1 531902 11.33 MB/sec execute 119 sec latency 11.339 ms 2020-11-20T11:53:21.452 INFO:tasks.workunit.client.0.smithi192.stdout: 1 533566 11.33 MB/sec execute 120 sec latency 59.905 ms 2020-11-20T11:53:22.452 INFO:tasks.workunit.client.0.smithi192.stdout: 1 535469 11.30 MB/sec execute 121 sec latency 89.006 ms 2020-11-20T11:53:23.452 INFO:tasks.workunit.client.0.smithi192.stdout: 1 537153 11.30 MB/sec execute 122 sec latency 15.092 ms 2020-11-20T11:53:24.452 INFO:tasks.workunit.client.0.smithi192.stdout: 1 539604 11.32 MB/sec execute 123 sec latency 19.449 ms 2020-11-20T11:53:25.452 INFO:tasks.workunit.client.0.smithi192.stdout: 1 541200 11.29 MB/sec execute 124 sec latency 12.276 ms 2020-11-20T11:53:26.452 INFO:tasks.workunit.client.0.smithi192.stdout: 1 543738 11.33 MB/sec execute 125 sec latency 57.000 ms 2020-11-20T11:53:27.452 INFO:tasks.workunit.client.0.smithi192.stdout: 1 545044 11.29 MB/sec execute 126 sec latency 47.479 ms 2020-11-20T11:53:27.505 INFO:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:53:27.515 INFO:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:53:27.522 INFO:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:53:28.452 INFO:tasks.workunit.client.0.smithi192.stdout: 1 545044 11.20 MB/sec execute 127 sec latency 1013.773 ms 2020-11-20T11:53:29.452 INFO:tasks.workunit.client.0.smithi192.stdout: 1 546453 11.17 MB/sec execute 128 sec latency 1090.111 ms 2020-11-20T11:53:30.452 INFO:tasks.workunit.client.0.smithi192.stdout: 1 547606 11.13 MB/sec execute 129 sec latency 17.538 ms 2020-11-20T11:53:31.452 INFO:tasks.workunit.client.0.smithi192.stdout: 1 548762 11.09 MB/sec execute 130 sec latency 23.723 ms 2020-11-20T11:53:32.452 INFO:tasks.workunit.client.0.smithi192.stdout: 1 550923 11.11 MB/sec execute 131 sec latency 37.683 ms 2020-11-20T11:53:33.454 INFO:tasks.workunit.client.0.smithi192.stdout: 1 552874 11.07 MB/sec execute 132 sec latency 44.424 ms 2020-11-20T11:53:34.903 INFO:tasks.workunit.client.0.smithi192.stdout: 1 554636 11.08 MB/sec execute 133 sec latency 13.519 ms 2020-11-20T11:53:35.452 INFO:tasks.workunit.client.0.smithi192.stdout: 1 556609 11.06 MB/sec execute 134 sec latency 28.189 ms 2020-11-20T11:53:36.452 INFO:tasks.workunit.client.0.smithi192.stdout: 1 558438 11.06 MB/sec execute 135 sec latency 12.906 ms 2020-11-20T11:53:37.453 INFO:tasks.workunit.client.0.smithi192.stdout: 1 560694 11.07 MB/sec execute 136 sec latency 19.630 ms 2020-11-20T11:53:38.452 INFO:tasks.workunit.client.0.smithi192.stdout: 1 562063 11.04 MB/sec execute 137 sec latency 66.259 ms 2020-11-20T11:53:39.453 INFO:tasks.workunit.client.0.smithi192.stdout: 1 564651 11.07 MB/sec execute 138 sec latency 21.355 ms 2020-11-20T11:53:40.453 INFO:tasks.workunit.client.0.smithi192.stdout: 1 566247 11.06 MB/sec execute 139 sec latency 14.342 ms 2020-11-20T11:53:41.453 INFO:tasks.workunit.client.0.smithi192.stdout: 1 568653 11.07 MB/sec execute 140 sec latency 19.432 ms 2020-11-20T11:53:42.453 INFO:tasks.workunit.client.0.smithi192.stdout: 1 570745 11.05 MB/sec execute 141 sec latency 12.473 ms 2020-11-20T11:53:43.453 INFO:tasks.workunit.client.0.smithi192.stdout: 1 572327 11.06 MB/sec execute 142 sec latency 58.206 ms 2020-11-20T11:53:44.453 INFO:tasks.workunit.client.0.smithi192.stdout: 1 574378 11.03 MB/sec execute 143 sec latency 19.796 ms 2020-11-20T11:53:45.453 INFO:tasks.workunit.client.0.smithi192.stdout: 1 576218 11.04 MB/sec execute 144 sec latency 14.504 ms 2020-11-20T11:53:46.454 INFO:tasks.workunit.client.0.smithi192.stdout: 1 578729 11.06 MB/sec execute 145 sec latency 27.575 ms 2020-11-20T11:53:47.453 INFO:tasks.workunit.client.0.smithi192.stdout: 1 580113 11.03 MB/sec execute 146 sec latency 14.415 ms 2020-11-20T11:53:48.453 INFO:tasks.workunit.client.0.smithi192.stdout: 1 582352 11.04 MB/sec execute 147 sec latency 60.648 ms 2020-11-20T11:53:50.040 INFO:tasks.workunit.client.0.smithi192.stdout: 1 583758 11.01 MB/sec execute 148 sec latency 38.232 ms 2020-11-20T11:53:50.453 INFO:tasks.workunit.client.0.smithi192.stdout: 1 586343 11.05 MB/sec execute 149 sec latency 13.050 ms 2020-11-20T11:53:51.453 INFO:tasks.workunit.client.0.smithi192.stdout: 1 587766 11.01 MB/sec execute 150 sec latency 22.440 ms 2020-11-20T11:53:52.453 INFO:tasks.workunit.client.0.smithi192.stdout: 1 590083 11.03 MB/sec execute 151 sec latency 16.763 ms 2020-11-20T11:53:53.453 INFO:tasks.workunit.client.0.smithi192.stdout: 1 592223 11.01 MB/sec execute 152 sec latency 17.459 ms 2020-11-20T11:53:54.453 INFO:tasks.workunit.client.0.smithi192.stdout: 1 593909 11.01 MB/sec execute 153 sec latency 65.375 ms 2020-11-20T11:53:55.453 INFO:tasks.workunit.client.0.smithi192.stdout: 1 596534 11.03 MB/sec execute 154 sec latency 14.562 ms 2020-11-20T11:53:56.453 INFO:tasks.workunit.client.0.smithi192.stdout: 1 598351 11.03 MB/sec execute 155 sec latency 12.639 ms 2020-11-20T11:53:57.453 INFO:tasks.workunit.client.0.smithi192.stdout: 1 600673 11.04 MB/sec execute 156 sec latency 17.275 ms 2020-11-20T11:53:57.974 INFO:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:53:57.978 INFO:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:53:57.982 INFO:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:53:58.453 INFO:tasks.workunit.client.0.smithi192.stdout: 1 602745 11.02 MB/sec execute 157 sec latency 22.350 ms 2020-11-20T11:54:00.685 INFO:tasks.workunit.client.0.smithi192.stdout: 1 604543 11.03 MB/sec execute 158 sec latency 16.751 ms 2020-11-20T11:54:00.686 INFO:tasks.workunit.client.0.smithi192.stdout: 1 606794 11.03 MB/sec execute 159 sec latency 68.879 ms 2020-11-20T11:54:01.453 INFO:tasks.workunit.client.0.smithi192.stdout: 1 608334 11.01 MB/sec execute 160 sec latency 11.641 ms 2020-11-20T11:54:02.453 INFO:tasks.workunit.client.0.smithi192.stdout: 1 611102 11.06 MB/sec execute 161 sec latency 17.884 ms 2020-11-20T11:54:03.453 INFO:tasks.workunit.client.0.smithi192.stdout: 1 611884 10.99 MB/sec execute 162 sec latency 192.043 ms 2020-11-20T11:54:04.455 INFO:tasks.workunit.client.0.smithi192.stdout: 1 611897 10.93 MB/sec execute 163 sec latency 738.193 ms 2020-11-20T11:54:05.453 INFO:tasks.workunit.client.0.smithi192.stdout: 1 613771 10.92 MB/sec execute 164 sec latency 246.111 ms 2020-11-20T11:54:06.453 INFO:tasks.workunit.client.0.smithi192.stdout: 1 614900 10.91 MB/sec execute 165 sec latency 20.177 ms 2020-11-20T11:54:07.453 INFO:tasks.workunit.client.0.smithi192.stdout: 1 616578 10.87 MB/sec execute 166 sec latency 24.068 ms 2020-11-20T11:54:08.453 INFO:tasks.workunit.client.0.smithi192.stdout: 1 618577 10.89 MB/sec execute 167 sec latency 12.068 ms 2020-11-20T11:54:10.339 INFO:tasks.workunit.client.0.smithi192.stdout: 1 620586 10.87 MB/sec execute 168 sec latency 18.781 ms 2020-11-20T11:54:10.454 INFO:tasks.workunit.client.0.smithi192.stdout: 1 622308 10.88 MB/sec execute 169 sec latency 33.925 ms 2020-11-20T11:54:11.454 INFO:tasks.workunit.client.0.smithi192.stdout: 1 624712 10.89 MB/sec execute 170 sec latency 33.725 ms 2020-11-20T11:54:12.454 INFO:tasks.workunit.client.0.smithi192.stdout: 1 626255 10.87 MB/sec execute 171 sec latency 12.260 ms 2020-11-20T11:54:13.454 INFO:tasks.workunit.client.0.smithi192.stdout: 1 628906 10.90 MB/sec execute 172 sec latency 15.821 ms 2020-11-20T11:54:14.454 INFO:tasks.workunit.client.0.smithi192.stdout: 1 630511 10.87 MB/sec execute 173 sec latency 15.673 ms 2020-11-20T11:54:15.454 INFO:tasks.workunit.client.0.smithi192.stdout: 1 632673 10.89 MB/sec execute 174 sec latency 11.712 ms 2020-11-20T11:54:16.454 INFO:tasks.workunit.client.0.smithi192.stdout: 1 634596 10.87 MB/sec execute 175 sec latency 77.939 ms 2020-11-20T11:54:17.454 INFO:tasks.workunit.client.0.smithi192.stdout: 1 636444 10.88 MB/sec execute 176 sec latency 12.193 ms 2020-11-20T11:54:18.454 INFO:tasks.workunit.client.0.smithi192.stdout: 1 638730 10.88 MB/sec execute 177 sec latency 22.586 ms 2020-11-20T11:54:20.174 INFO:tasks.workunit.client.0.smithi192.stdout: 1 640236 10.87 MB/sec execute 178 sec latency 18.504 ms 2020-11-20T11:54:20.454 INFO:tasks.workunit.client.0.smithi192.stdout: 1 642879 10.90 MB/sec execute 179 sec latency 18.248 ms 2020-11-20T11:54:21.454 INFO:tasks.workunit.client.0.smithi192.stdout: 1 644330 10.87 MB/sec execute 180 sec latency 12.175 ms 2020-11-20T11:54:22.454 INFO:tasks.workunit.client.0.smithi192.stdout: 1 646504 10.88 MB/sec execute 181 sec latency 72.233 ms 2020-11-20T11:54:23.455 INFO:tasks.workunit.client.0.smithi192.stdout: 1 647838 10.86 MB/sec execute 182 sec latency 41.262 ms 2020-11-20T11:54:24.454 INFO:tasks.workunit.client.0.smithi192.stdout: 1 650254 10.88 MB/sec execute 183 sec latency 13.043 ms 2020-11-20T11:54:25.454 INFO:tasks.workunit.client.0.smithi192.stdout: 1 652299 10.86 MB/sec execute 184 sec latency 13.870 ms 2020-11-20T11:54:26.454 INFO:tasks.workunit.client.0.smithi192.stdout: 1 654060 10.86 MB/sec execute 185 sec latency 12.956 ms 2020-11-20T11:54:27.454 INFO:tasks.workunit.client.0.smithi192.stdout: 1 655937 10.85 MB/sec execute 186 sec latency 60.224 ms 2020-11-20T11:54:28.049 INFO:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:54:28.051 INFO:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:54:28.053 INFO:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:54:28.454 INFO:tasks.workunit.client.0.smithi192.stdout: 1 657693 10.85 MB/sec execute 187 sec latency 13.186 ms 2020-11-20T11:54:29.455 INFO:tasks.workunit.client.0.smithi192.stdout: 1 659882 10.85 MB/sec execute 188 sec latency 18.300 ms 2020-11-20T11:54:31.353 INFO:tasks.workunit.client.0.smithi192.stdout: 1 661335 10.84 MB/sec execute 189 sec latency 12.240 ms 2020-11-20T11:54:31.454 INFO:tasks.workunit.client.0.smithi192.stdout: 1 663705 10.85 MB/sec execute 190 sec latency 16.627 ms 2020-11-20T11:54:32.455 INFO:tasks.workunit.client.0.smithi192.stdout: 1 664987 10.83 MB/sec execute 191 sec latency 61.503 ms 2020-11-20T11:54:33.454 INFO:tasks.workunit.client.0.smithi192.stdout: 1 667408 10.84 MB/sec execute 192 sec latency 29.028 ms 2020-11-20T11:54:34.455 INFO:tasks.workunit.client.0.smithi192.stdout: 1 668601 10.81 MB/sec execute 193 sec latency 15.056 ms 2020-11-20T11:54:35.690 INFO:tasks.workunit.client.0.smithi192.stdout: 1 671380 10.85 MB/sec execute 194 sec latency 13.755 ms 2020-11-20T11:54:36.455 INFO:tasks.workunit.client.0.smithi192.stdout: 1 672687 10.82 MB/sec execute 195 sec latency 23.710 ms 2020-11-20T11:54:37.455 INFO:tasks.workunit.client.0.smithi192.stdout: 1 675134 10.84 MB/sec execute 196 sec latency 11.815 ms 2020-11-20T11:54:38.455 INFO:tasks.workunit.client.0.smithi192.stdout: 1 676660 10.81 MB/sec execute 197 sec latency 59.957 ms 2020-11-20T11:54:39.455 INFO:tasks.workunit.client.0.smithi192.stdout: 1 678549 10.82 MB/sec execute 198 sec latency 61.475 ms 2020-11-20T11:54:40.456 INFO:tasks.workunit.client.0.smithi192.stdout: 1 679797 10.80 MB/sec execute 199 sec latency 17.394 ms 2020-11-20T11:54:41.457 INFO:tasks.workunit.client.0.smithi192.stdout: 1 682142 10.81 MB/sec execute 200 sec latency 16.577 ms 2020-11-20T11:54:42.455 INFO:tasks.workunit.client.0.smithi192.stdout: 1 683747 10.79 MB/sec execute 201 sec latency 21.056 ms 2020-11-20T11:54:43.455 INFO:tasks.workunit.client.0.smithi192.stdout: 1 685795 10.80 MB/sec execute 202 sec latency 12.820 ms 2020-11-20T11:54:44.455 INFO:tasks.workunit.client.0.smithi192.stdout: 1 686606 10.76 MB/sec execute 203 sec latency 92.037 ms 2020-11-20T11:54:45.455 INFO:tasks.workunit.client.0.smithi192.stdout: 1 686620 10.71 MB/sec execute 204 sec latency 419.490 ms 2020-11-20T11:54:46.455 INFO:tasks.workunit.client.0.smithi192.stdout: 1 688293 10.70 MB/sec execute 205 sec latency 359.342 ms 2020-11-20T11:54:47.456 INFO:tasks.workunit.client.0.smithi192.stdout: 1 689394 10.68 MB/sec execute 206 sec latency 22.246 ms 2020-11-20T11:54:48.455 INFO:tasks.workunit.client.0.smithi192.stdout: 1 690774 10.66 MB/sec execute 207 sec latency 48.028 ms 2020-11-20T11:54:49.455 INFO:tasks.workunit.client.0.smithi192.stdout: 1 692845 10.67 MB/sec execute 208 sec latency 43.075 ms 2020-11-20T11:54:50.455 INFO:tasks.workunit.client.0.smithi192.stdout: 1 694352 10.65 MB/sec execute 209 sec latency 16.773 ms 2020-11-20T11:54:51.455 INFO:tasks.workunit.client.0.smithi192.stdout: 1 696420 10.66 MB/sec execute 210 sec latency 15.354 ms 2020-11-20T11:54:52.455 INFO:tasks.workunit.client.0.smithi192.stdout: 1 698019 10.64 MB/sec execute 211 sec latency 18.670 ms 2020-11-20T11:54:53.455 INFO:tasks.workunit.client.0.smithi192.stdout: 1 700031 10.65 MB/sec execute 212 sec latency 12.891 ms 2020-11-20T11:54:54.455 INFO:tasks.workunit.client.0.smithi192.stdout: 1 701973 10.64 MB/sec execute 213 sec latency 57.607 ms 2020-11-20T11:54:55.455 INFO:tasks.workunit.client.0.smithi192.stdout: 1 703570 10.64 MB/sec execute 214 sec latency 63.263 ms 2020-11-20T11:54:56.455 INFO:tasks.workunit.client.0.smithi192.stdout: 1 705572 10.63 MB/sec execute 215 sec latency 14.309 ms 2020-11-20T11:54:57.456 INFO:tasks.workunit.client.0.smithi192.stdout: 1 707276 10.63 MB/sec execute 216 sec latency 12.741 ms 2020-11-20T11:54:58.121 INFO:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:54:58.129 INFO:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:54:58.137 INFO:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:54:58.456 INFO:tasks.workunit.client.0.smithi192.stdout: 1 709107 10.62 MB/sec execute 217 sec latency 27.191 ms 2020-11-20T11:54:59.455 INFO:tasks.workunit.client.0.smithi192.stdout: 1 710795 10.62 MB/sec execute 218 sec latency 22.425 ms 2020-11-20T11:55:00.456 INFO:tasks.workunit.client.0.smithi192.stdout: 1 712601 10.61 MB/sec execute 219 sec latency 42.649 ms 2020-11-20T11:55:01.456 INFO:tasks.workunit.client.0.smithi192.stdout: 1 714231 10.61 MB/sec execute 220 sec latency 14.856 ms 2020-11-20T11:55:02.456 INFO:tasks.workunit.client.0.smithi192.stdout: 1 716207 10.60 MB/sec execute 221 sec latency 15.707 ms 2020-11-20T11:55:03.456 INFO:tasks.workunit.client.0.smithi192.stdout: 1 717848 10.60 MB/sec execute 222 sec latency 32.540 ms 2020-11-20T11:55:04.456 INFO:tasks.workunit.client.0.smithi192.stdout: 1 719672 10.59 MB/sec execute 223 sec latency 18.940 ms 2020-11-20T11:55:05.456 INFO:tasks.workunit.client.0.smithi192.stdout: 1 721523 10.59 MB/sec execute 224 sec latency 12.611 ms 2020-11-20T11:55:06.456 INFO:tasks.workunit.client.0.smithi192.stdout: 1 723324 10.58 MB/sec execute 225 sec latency 71.807 ms 2020-11-20T11:55:07.456 INFO:tasks.workunit.client.0.smithi192.stdout: 1 725008 10.58 MB/sec execute 226 sec latency 12.793 ms 2020-11-20T11:55:08.456 INFO:tasks.workunit.client.0.smithi192.stdout: 1 727162 10.59 MB/sec execute 227 sec latency 22.107 ms 2020-11-20T11:55:09.457 INFO:tasks.workunit.client.0.smithi192.stdout: 1 728701 10.58 MB/sec execute 228 sec latency 14.890 ms 2020-11-20T11:55:10.456 INFO:tasks.workunit.client.0.smithi192.stdout: 1 731120 10.59 MB/sec execute 229 sec latency 19.840 ms 2020-11-20T11:55:11.456 INFO:tasks.workunit.client.0.smithi192.stdout: 1 732322 10.57 MB/sec execute 230 sec latency 74.921 ms 2020-11-20T11:55:12.456 INFO:tasks.workunit.client.0.smithi192.stdout: 1 734702 10.58 MB/sec execute 231 sec latency 19.395 ms 2020-11-20T11:55:13.456 INFO:tasks.workunit.client.0.smithi192.stdout: 1 736130 10.57 MB/sec execute 232 sec latency 17.231 ms 2020-11-20T11:55:14.457 INFO:tasks.workunit.client.0.smithi192.stdout: 1 738594 10.59 MB/sec execute 233 sec latency 21.041 ms 2020-11-20T11:55:15.456 INFO:tasks.workunit.client.0.smithi192.stdout: 1 739765 10.56 MB/sec execute 234 sec latency 16.234 ms 2020-11-20T11:55:16.457 INFO:tasks.workunit.client.0.smithi192.stdout: 1 742267 10.58 MB/sec execute 235 sec latency 34.188 ms 2020-11-20T11:55:17.456 INFO:tasks.workunit.client.0.smithi192.stdout: 1 743312 10.55 MB/sec execute 236 sec latency 45.483 ms 2020-11-20T11:55:18.456 INFO:tasks.workunit.client.0.smithi192.stdout: 1 745897 10.58 MB/sec execute 237 sec latency 12.544 ms 2020-11-20T11:55:19.456 INFO:tasks.workunit.client.0.smithi192.stdout: 1 747129 10.55 MB/sec execute 238 sec latency 18.364 ms 2020-11-20T11:55:20.457 INFO:tasks.workunit.client.0.smithi192.stdout: 1 748643 10.54 MB/sec execute 239 sec latency 207.276 ms 2020-11-20T11:55:21.456 INFO:tasks.workunit.client.0.smithi192.stdout: 1 748674 10.50 MB/sec execute 240 sec latency 369.229 ms 2020-11-20T11:55:22.457 INFO:tasks.workunit.client.0.smithi192.stdout: 1 749908 10.48 MB/sec execute 241 sec latency 85.640 ms 2020-11-20T11:55:23.457 INFO:tasks.workunit.client.0.smithi192.stdout: 1 751080 10.46 MB/sec execute 242 sec latency 59.458 ms 2020-11-20T11:55:24.457 INFO:tasks.workunit.client.0.smithi192.stdout: 1 752826 10.47 MB/sec execute 243 sec latency 26.483 ms 2020-11-20T11:55:25.457 INFO:tasks.workunit.client.0.smithi192.stdout: 1 753876 10.44 MB/sec execute 244 sec latency 20.541 ms 2020-11-20T11:55:26.460 INFO:tasks.workunit.client.0.smithi192.stdout: 1 756457 10.46 MB/sec execute 245 sec latency 16.049 ms 2020-11-20T11:55:27.457 INFO:tasks.workunit.client.0.smithi192.stdout: 1 757702 10.44 MB/sec execute 246 sec latency 19.957 ms 2020-11-20T11:55:28.204 INFO:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:55:28.207 INFO:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:55:28.210 INFO:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:55:28.289 INFO:tasks.ceph.mds.b.smithi146.stderr:2020-11-20T11:55:28.285+0000 7fe493b15700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 25790) UID: 0 2020-11-20T11:55:28.457 INFO:tasks.workunit.client.0.smithi192.stdout: 1 760087 10.46 MB/sec execute 247 sec latency 50.722 ms 2020-11-20T11:55:29.457 INFO:tasks.workunit.client.0.smithi192.stdout: 1 761292 10.44 MB/sec execute 248 sec latency 21.353 ms 2020-11-20T11:55:30.457 INFO:tasks.workunit.client.0.smithi192.stdout: 1 763653 10.45 MB/sec execute 249 sec latency 15.963 ms 2020-11-20T11:55:31.457 INFO:tasks.workunit.client.0.smithi192.stdout: 1 765018 10.43 MB/sec execute 250 sec latency 19.784 ms 2020-11-20T11:55:32.457 INFO:tasks.workunit.client.0.smithi192.stdout: 1 767296 10.44 MB/sec execute 251 sec latency 14.725 ms 2020-11-20T11:55:33.457 INFO:tasks.workunit.client.0.smithi192.stdout: 1 768595 10.42 MB/sec execute 252 sec latency 63.515 ms 2020-11-20T11:55:34.458 INFO:tasks.workunit.client.0.smithi192.stdout: 1 770787 10.44 MB/sec execute 253 sec latency 16.660 ms 2020-11-20T11:55:35.457 INFO:tasks.workunit.client.0.smithi192.stdout: 1 772191 10.42 MB/sec execute 254 sec latency 20.301 ms 2020-11-20T11:55:36.457 INFO:tasks.workunit.client.0.smithi192.stdout: 1 774348 10.43 MB/sec execute 255 sec latency 15.656 ms 2020-11-20T11:55:37.457 INFO:tasks.workunit.client.0.smithi192.stdout: 1 775697 10.41 MB/sec execute 256 sec latency 29.009 ms 2020-11-20T11:55:38.457 INFO:tasks.workunit.client.0.smithi192.stdout: 1 777871 10.42 MB/sec execute 257 sec latency 21.884 ms 2020-11-20T11:55:39.457 INFO:tasks.workunit.client.0.smithi192.stdout: 1 778822 10.39 MB/sec execute 258 sec latency 53.959 ms 2020-11-20T11:55:40.457 INFO:tasks.workunit.client.0.smithi192.stdout: 1 781276 10.41 MB/sec execute 259 sec latency 14.607 ms 2020-11-20T11:55:41.457 INFO:tasks.workunit.client.0.smithi192.stdout: 1 782246 10.38 MB/sec execute 260 sec latency 15.537 ms 2020-11-20T11:55:42.457 INFO:tasks.workunit.client.0.smithi192.stdout: 1 784474 10.39 MB/sec execute 261 sec latency 19.943 ms 2020-11-20T11:55:43.457 INFO:tasks.workunit.client.0.smithi192.stdout: 1 785663 10.37 MB/sec execute 262 sec latency 21.775 ms 2020-11-20T11:55:44.457 INFO:tasks.workunit.client.0.smithi192.stdout: 1 787813 10.38 MB/sec execute 263 sec latency 54.131 ms 2020-11-20T11:55:45.460 INFO:tasks.workunit.client.0.smithi192.stdout: 1 789113 10.37 MB/sec execute 264 sec latency 13.932 ms 2020-11-20T11:55:46.457 INFO:tasks.workunit.client.0.smithi192.stdout: 1 791496 10.38 MB/sec execute 265 sec latency 20.123 ms 2020-11-20T11:55:47.458 INFO:tasks.workunit.client.0.smithi192.stdout: 1 792656 10.36 MB/sec execute 266 sec latency 21.641 ms 2020-11-20T11:55:48.457 INFO:tasks.workunit.client.0.smithi192.stdout: 1 794966 10.37 MB/sec execute 267 sec latency 23.615 ms 2020-11-20T11:55:49.461 INFO:tasks.workunit.client.0.smithi192.stdout: 1 796233 10.36 MB/sec execute 268 sec latency 14.801 ms 2020-11-20T11:55:50.458 INFO:tasks.workunit.client.0.smithi192.stdout: 1 798220 10.36 MB/sec execute 269 sec latency 69.423 ms 2020-11-20T11:55:51.458 INFO:tasks.workunit.client.0.smithi192.stdout: 1 799668 10.35 MB/sec execute 270 sec latency 13.917 ms 2020-11-20T11:55:52.458 INFO:tasks.workunit.client.0.smithi192.stdout: 1 802204 10.36 MB/sec execute 271 sec latency 14.654 ms 2020-11-20T11:55:53.458 INFO:tasks.workunit.client.0.smithi192.stdout: 1 803221 10.34 MB/sec execute 272 sec latency 81.439 ms 2020-11-20T11:55:54.458 INFO:tasks.workunit.client.0.smithi192.stdout: 1 805758 10.36 MB/sec execute 273 sec latency 16.096 ms 2020-11-20T11:55:55.459 INFO:tasks.workunit.client.0.smithi192.stdout: 1 806745 10.34 MB/sec execute 274 sec latency 68.558 ms 2020-11-20T11:55:56.458 INFO:tasks.workunit.client.0.smithi192.stdout: 1 808882 10.34 MB/sec execute 275 sec latency 52.080 ms 2020-11-20T11:55:57.458 INFO:tasks.workunit.client.0.smithi192.stdout: 1 808933 10.31 MB/sec execute 276 sec latency 375.570 ms 2020-11-20T11:55:58.460 INFO:tasks.workunit.client.0.smithi192.stdout: 1 809713 10.29 MB/sec execute 277 sec latency 311.704 ms 2020-11-20T11:55:59.461 INFO:tasks.workunit.client.0.smithi192.stdout: 1 810236 10.26 MB/sec execute 278 sec latency 37.141 ms 2020-11-20T11:56:00.458 INFO:tasks.workunit.client.0.smithi192.stdout: 1 811206 10.24 MB/sec execute 279 sec latency 31.554 ms 2020-11-20T11:56:01.458 INFO:tasks.workunit.client.0.smithi192.stdout: 1 813039 10.24 MB/sec execute 280 sec latency 32.567 ms 2020-11-20T11:56:02.458 INFO:tasks.workunit.client.0.smithi192.stdout: 1 814025 10.22 MB/sec execute 281 sec latency 33.648 ms 2020-11-20T11:56:03.458 INFO:tasks.workunit.client.0.smithi192.stdout: 1 816042 10.22 MB/sec execute 282 sec latency 48.846 ms 2020-11-20T11:56:04.458 INFO:tasks.workunit.client.0.smithi192.stdout: 1 817335 10.21 MB/sec execute 283 sec latency 17.181 ms 2020-11-20T11:56:05.458 INFO:tasks.workunit.client.0.smithi192.stdout: 1 819061 10.20 MB/sec execute 284 sec latency 24.843 ms 2020-11-20T11:56:06.459 INFO:tasks.workunit.client.0.smithi192.stdout: 1 820585 10.20 MB/sec execute 285 sec latency 14.250 ms 2020-11-20T11:56:07.458 INFO:tasks.workunit.client.0.smithi192.stdout: 1 822029 10.19 MB/sec execute 286 sec latency 50.922 ms 2020-11-20T11:56:08.459 INFO:tasks.workunit.client.0.smithi192.stdout: 1 824250 10.20 MB/sec execute 287 sec latency 11.901 ms 2020-11-20T11:56:09.459 INFO:tasks.workunit.client.0.smithi192.stdout: 1 826162 10.19 MB/sec execute 288 sec latency 21.589 ms 2020-11-20T11:56:10.459 INFO:tasks.workunit.client.0.smithi192.stdout: 1 828018 10.20 MB/sec execute 289 sec latency 13.148 ms 2020-11-20T11:56:11.459 INFO:tasks.workunit.client.0.smithi192.stdout: 1 830401 10.21 MB/sec execute 290 sec latency 24.359 ms 2020-11-20T11:56:12.459 INFO:tasks.workunit.client.0.smithi192.stdout: 1 831754 10.19 MB/sec execute 291 sec latency 58.765 ms 2020-11-20T11:56:13.459 INFO:tasks.workunit.client.0.smithi192.stdout: 1 834398 10.22 MB/sec execute 292 sec latency 20.013 ms 2020-11-20T11:56:14.459 INFO:tasks.workunit.client.0.smithi192.stdout: 1 835771 10.20 MB/sec execute 293 sec latency 25.861 ms 2020-11-20T11:56:15.459 INFO:tasks.workunit.client.0.smithi192.stdout: 1 838174 10.22 MB/sec execute 294 sec latency 15.355 ms 2020-11-20T11:56:16.462 INFO:tasks.workunit.client.0.smithi192.stdout: 1 839566 10.20 MB/sec execute 295 sec latency 15.312 ms 2020-11-20T11:56:17.460 INFO:tasks.workunit.client.0.smithi192.stdout: 1 841424 10.21 MB/sec execute 296 sec latency 43.330 ms 2020-11-20T11:56:18.459 INFO:tasks.workunit.client.0.smithi192.stdout: 1 842417 10.18 MB/sec execute 297 sec latency 15.767 ms 2020-11-20T11:56:19.459 INFO:tasks.workunit.client.0.smithi192.stdout: 1 844667 10.19 MB/sec execute 298 sec latency 37.565 ms 2020-11-20T11:56:20.459 INFO:tasks.workunit.client.0.smithi192.stdout: 1 845821 10.18 MB/sec execute 299 sec latency 14.944 ms 2020-11-20T11:56:21.459 INFO:tasks.workunit.client.0.smithi192.stdout: 1 847797 10.18 MB/sec execute 300 sec latency 24.158 ms 2020-11-20T11:56:22.459 INFO:tasks.workunit.client.0.smithi192.stdout: 1 849286 10.17 MB/sec execute 301 sec latency 16.956 ms 2020-11-20T11:56:23.459 INFO:tasks.workunit.client.0.smithi192.stdout: 1 851018 10.16 MB/sec execute 302 sec latency 63.574 ms 2020-11-20T11:56:24.462 INFO:tasks.workunit.client.0.smithi192.stdout: 1 852550 10.17 MB/sec execute 303 sec latency 15.485 ms 2020-11-20T11:56:25.459 INFO:tasks.workunit.client.0.smithi192.stdout: 1 854005 10.15 MB/sec execute 304 sec latency 18.546 ms 2020-11-20T11:56:26.459 INFO:tasks.workunit.client.0.smithi192.stdout: 1 855957 10.16 MB/sec execute 305 sec latency 16.018 ms 2020-11-20T11:56:27.459 INFO:tasks.workunit.client.0.smithi192.stdout: 1 856580 10.13 MB/sec execute 306 sec latency 349.048 ms 2020-11-20T11:56:28.460 INFO:tasks.workunit.client.0.smithi192.stdout: 1 856726 10.10 MB/sec execute 307 sec latency 983.030 ms 2020-11-20T11:56:29.459 INFO:tasks.workunit.client.0.smithi192.stdout: 1 858531 10.10 MB/sec execute 308 sec latency 49.903 ms 2020-11-20T11:56:30.459 INFO:tasks.workunit.client.0.smithi192.stdout: 1 859562 10.09 MB/sec execute 309 sec latency 23.119 ms 2020-11-20T11:56:31.460 INFO:tasks.workunit.client.0.smithi192.stdout: 1 860192 10.06 MB/sec execute 310 sec latency 25.465 ms 2020-11-20T11:56:32.461 INFO:tasks.workunit.client.0.smithi192.stdout: 1 862840 10.09 MB/sec execute 311 sec latency 22.531 ms 2020-11-20T11:56:33.460 INFO:tasks.workunit.client.0.smithi192.stdout: 1 863928 10.06 MB/sec execute 312 sec latency 32.389 ms 2020-11-20T11:56:34.459 INFO:tasks.workunit.client.0.smithi192.stdout: 1 866435 10.08 MB/sec execute 313 sec latency 43.729 ms 2020-11-20T11:56:35.460 INFO:tasks.workunit.client.0.smithi192.stdout: 1 867746 10.07 MB/sec execute 314 sec latency 20.913 ms 2020-11-20T11:56:36.461 INFO:tasks.workunit.client.0.smithi192.stdout: 1 870156 10.08 MB/sec execute 315 sec latency 14.247 ms 2020-11-20T11:56:37.460 INFO:tasks.workunit.client.0.smithi192.stdout: 1 871539 10.07 MB/sec execute 316 sec latency 21.473 ms 2020-11-20T11:56:38.461 INFO:tasks.workunit.client.0.smithi192.stdout: 1 873808 10.08 MB/sec execute 317 sec latency 13.822 ms 2020-11-20T11:56:39.460 INFO:tasks.workunit.client.0.smithi192.stdout: 1 875245 10.06 MB/sec execute 318 sec latency 72.145 ms 2020-11-20T11:56:40.460 INFO:tasks.workunit.client.0.smithi192.stdout: 1 877172 10.08 MB/sec execute 319 sec latency 15.507 ms 2020-11-20T11:56:41.460 INFO:tasks.workunit.client.0.smithi192.stdout: 1 878160 10.05 MB/sec execute 320 sec latency 36.434 ms 2020-11-20T11:56:42.460 INFO:tasks.workunit.client.0.smithi192.stdout: 1 880492 10.07 MB/sec execute 321 sec latency 14.821 ms 2020-11-20T11:56:43.462 INFO:tasks.workunit.client.0.smithi192.stdout: 1 881362 10.04 MB/sec execute 322 sec latency 30.116 ms 2020-11-20T11:56:44.462 INFO:tasks.workunit.client.0.smithi192.stdout: 1 883455 10.05 MB/sec execute 323 sec latency 25.185 ms 2020-11-20T11:56:45.460 INFO:tasks.workunit.client.0.smithi192.stdout: 1 884703 10.04 MB/sec execute 324 sec latency 52.653 ms 2020-11-20T11:56:46.461 INFO:tasks.workunit.client.0.smithi192.stdout: 1 886467 10.03 MB/sec execute 325 sec latency 19.738 ms 2020-11-20T11:56:47.460 INFO:tasks.workunit.client.0.smithi192.stdout: 1 888033 10.04 MB/sec execute 326 sec latency 14.014 ms 2020-11-20T11:56:48.461 INFO:tasks.workunit.client.0.smithi192.stdout: 1 888288 10.01 MB/sec execute 327 sec latency 290.636 ms 2020-11-20T11:56:49.460 INFO:tasks.workunit.client.0.smithi192.stdout: 1 889657 9.99 MB/sec execute 328 sec latency 129.279 ms 2020-11-20T11:56:50.460 INFO:tasks.workunit.client.0.smithi192.stdout: 1 891242 10.00 MB/sec execute 329 sec latency 24.218 ms 2020-11-20T11:56:51.460 INFO:tasks.workunit.client.0.smithi192.stdout: 1 892217 9.98 MB/sec execute 330 sec latency 30.167 ms 2020-11-20T11:56:52.461 INFO:tasks.workunit.client.0.smithi192.stdout: 1 894799 10.00 MB/sec execute 331 sec latency 14.785 ms 2020-11-20T11:56:53.461 INFO:tasks.workunit.client.0.smithi192.stdout: 1 896212 9.99 MB/sec execute 332 sec latency 14.984 ms 2020-11-20T11:56:54.461 INFO:tasks.workunit.client.0.smithi192.stdout: 1 898563 10.00 MB/sec execute 333 sec latency 14.792 ms 2020-11-20T11:56:55.461 INFO:tasks.workunit.client.0.smithi192.stdout: 1 899891 9.98 MB/sec execute 334 sec latency 21.773 ms 2020-11-20T11:56:56.460 INFO:tasks.workunit.client.0.smithi192.stdout: 1 902000 9.99 MB/sec execute 335 sec latency 69.000 ms 2020-11-20T11:56:57.462 INFO:tasks.workunit.client.0.smithi192.stdout: 1 903011 9.97 MB/sec execute 336 sec latency 22.457 ms 2020-11-20T11:56:58.461 INFO:tasks.workunit.client.0.smithi192.stdout: 1 905370 9.99 MB/sec execute 337 sec latency 18.552 ms 2020-11-20T11:56:59.461 INFO:tasks.workunit.client.0.smithi192.stdout: 1 906363 9.97 MB/sec execute 338 sec latency 31.551 ms 2020-11-20T11:57:00.461 INFO:tasks.workunit.client.0.smithi192.stdout: 1 908478 9.97 MB/sec execute 339 sec latency 34.828 ms 2020-11-20T11:57:01.461 INFO:tasks.workunit.client.0.smithi192.stdout: 1 909571 9.96 MB/sec execute 340 sec latency 56.892 ms 2020-11-20T11:57:02.461 INFO:tasks.workunit.client.0.smithi192.stdout: 1 911256 9.95 MB/sec execute 341 sec latency 36.708 ms 2020-11-20T11:57:03.461 INFO:tasks.workunit.client.0.smithi192.stdout: 1 912806 9.96 MB/sec execute 342 sec latency 14.347 ms 2020-11-20T11:57:04.461 INFO:tasks.workunit.client.0.smithi192.stdout: 1 914243 9.94 MB/sec execute 343 sec latency 18.529 ms 2020-11-20T11:57:05.461 INFO:tasks.workunit.client.0.smithi192.stdout: 1 916206 9.95 MB/sec execute 344 sec latency 16.265 ms 2020-11-20T11:57:06.461 INFO:tasks.workunit.client.0.smithi192.stdout: 1 917117 9.97 MB/sec execute 345 sec latency 41.979 ms 2020-11-20T11:57:07.462 INFO:tasks.workunit.client.0.smithi192.stdout: 1 918386 9.97 MB/sec execute 346 sec latency 66.934 ms 2020-11-20T11:57:08.461 INFO:tasks.workunit.client.0.smithi192.stdout: 1 920516 9.98 MB/sec execute 347 sec latency 17.085 ms 2020-11-20T11:57:09.462 INFO:tasks.workunit.client.0.smithi192.stdout: 1 921700 9.97 MB/sec execute 348 sec latency 21.525 ms 2020-11-20T11:57:10.461 INFO:tasks.workunit.client.0.smithi192.stdout: 1 923868 9.98 MB/sec execute 349 sec latency 47.742 ms 2020-11-20T11:57:11.461 INFO:tasks.workunit.client.0.smithi192.stdout: 1 924858 9.96 MB/sec execute 350 sec latency 19.132 ms 2020-11-20T11:57:12.462 INFO:tasks.workunit.client.0.smithi192.stdout: 1 927151 9.97 MB/sec execute 351 sec latency 17.453 ms 2020-11-20T11:57:14.395 INFO:tasks.workunit.client.0.smithi192.stdout: 1 927677 9.95 MB/sec execute 352 sec latency 288.875 ms 2020-11-20T11:57:14.462 INFO:tasks.workunit.client.0.smithi192.stdout: 1 927769 9.92 MB/sec execute 353 sec latency 300.226 ms 2020-11-20T11:57:15.461 INFO:tasks.workunit.client.0.smithi192.stdout: 1 928825 9.91 MB/sec execute 354 sec latency 23.199 ms 2020-11-20T11:57:16.463 INFO:tasks.workunit.client.0.smithi192.stdout: 1 930715 9.91 MB/sec execute 355 sec latency 33.593 ms 2020-11-20T11:57:17.462 INFO:tasks.workunit.client.0.smithi192.stdout: 1 931852 9.90 MB/sec execute 356 sec latency 22.145 ms 2020-11-20T11:57:18.462 INFO:tasks.workunit.client.0.smithi192.stdout: 1 934438 9.92 MB/sec execute 357 sec latency 49.134 ms 2020-11-20T11:57:19.461 INFO:tasks.workunit.client.0.smithi192.stdout: 1 935610 9.90 MB/sec execute 358 sec latency 25.753 ms 2020-11-20T11:57:20.462 INFO:tasks.workunit.client.0.smithi192.stdout: 1 938309 9.92 MB/sec execute 359 sec latency 13.646 ms 2020-11-20T11:57:21.462 INFO:tasks.workunit.client.0.smithi192.stdout: 1 939788 9.91 MB/sec execute 360 sec latency 25.296 ms 2020-11-20T11:57:22.465 INFO:tasks.workunit.client.0.smithi192.stdout: 1 942009 9.92 MB/sec execute 361 sec latency 12.627 ms 2020-11-20T11:57:23.462 INFO:tasks.workunit.client.0.smithi192.stdout: 1 943542 9.90 MB/sec execute 362 sec latency 66.754 ms 2020-11-20T11:57:24.462 INFO:tasks.workunit.client.0.smithi192.stdout: 1 945546 9.91 MB/sec execute 363 sec latency 70.943 ms 2020-11-20T11:57:25.469 INFO:tasks.workunit.client.0.smithi192.stdout: 1 947560 9.91 MB/sec execute 364 sec latency 22.528 ms 2020-11-20T11:57:26.462 INFO:tasks.workunit.client.0.smithi192.stdout: 1 949374 9.91 MB/sec execute 365 sec latency 14.525 ms 2020-11-20T11:57:27.463 INFO:tasks.workunit.client.0.smithi192.stdout: 1 951567 9.92 MB/sec execute 366 sec latency 25.512 ms 2020-11-20T11:57:28.463 INFO:tasks.workunit.client.0.smithi192.stdout: 1 953109 9.91 MB/sec execute 367 sec latency 12.906 ms 2020-11-20T11:57:29.465 INFO:tasks.workunit.client.0.smithi192.stdout: 1 955192 9.92 MB/sec execute 368 sec latency 66.859 ms 2020-11-20T11:57:30.462 INFO:tasks.workunit.client.0.smithi192.stdout: 1 956549 9.91 MB/sec execute 369 sec latency 14.567 ms 2020-11-20T11:57:31.462 INFO:tasks.workunit.client.0.smithi192.stdout: 1 958724 9.92 MB/sec execute 370 sec latency 17.361 ms 2020-11-20T11:57:32.462 INFO:tasks.workunit.client.0.smithi192.stdout: 1 960095 9.91 MB/sec execute 371 sec latency 14.430 ms 2020-11-20T11:57:33.466 INFO:tasks.workunit.client.0.smithi192.stdout: 1 962283 9.91 MB/sec execute 372 sec latency 21.758 ms 2020-11-20T11:57:34.469 INFO:tasks.workunit.client.0.smithi192.stdout: 1 963641 9.91 MB/sec execute 373 sec latency 15.726 ms 2020-11-20T11:57:35.634 INFO:tasks.workunit.client.0.smithi192.stdout: 1 965584 9.91 MB/sec execute 374 sec latency 55.320 ms 2020-11-20T11:57:36.462 INFO:tasks.workunit.client.0.smithi192.stdout: 1 967098 9.90 MB/sec execute 375 sec latency 14.077 ms 2020-11-20T11:57:37.464 INFO:tasks.workunit.client.0.smithi192.stdout: 1 969292 9.91 MB/sec execute 376 sec latency 15.853 ms 2020-11-20T11:57:38.465 INFO:tasks.workunit.client.0.smithi192.stdout: 1 970669 9.90 MB/sec execute 377 sec latency 15.023 ms 2020-11-20T11:57:39.462 INFO:tasks.workunit.client.0.smithi192.stdout: 1 971101 9.88 MB/sec execute 378 sec latency 689.369 ms 2020-11-20T11:57:40.464 INFO:tasks.workunit.client.0.smithi192.stdout: 1 972101 9.86 MB/sec execute 379 sec latency 947.149 ms 2020-11-20T11:57:41.462 INFO:tasks.workunit.client.0.smithi192.stdout: 1 973615 9.87 MB/sec execute 380 sec latency 28.104 ms 2020-11-20T11:57:42.462 INFO:tasks.workunit.client.0.smithi192.stdout: 1 974447 9.85 MB/sec execute 381 sec latency 20.718 ms 2020-11-20T11:57:43.462 INFO:tasks.workunit.client.0.smithi192.stdout: 1 976793 9.86 MB/sec execute 382 sec latency 17.298 ms 2020-11-20T11:57:44.462 INFO:tasks.workunit.client.0.smithi192.stdout: 1 978006 9.85 MB/sec execute 383 sec latency 15.235 ms 2020-11-20T11:57:45.463 INFO:tasks.workunit.client.0.smithi192.stdout: 1 980512 9.87 MB/sec execute 384 sec latency 47.411 ms 2020-11-20T11:57:46.464 INFO:tasks.workunit.client.0.smithi192.stdout: 1 981547 9.85 MB/sec execute 385 sec latency 23.848 ms 2020-11-20T11:57:47.463 INFO:tasks.workunit.client.0.smithi192.stdout: 1 984245 9.86 MB/sec execute 386 sec latency 13.650 ms 2020-11-20T11:57:48.463 INFO:tasks.workunit.client.0.smithi192.stdout: 1 985329 9.85 MB/sec execute 387 sec latency 23.893 ms 2020-11-20T11:57:49.463 INFO:tasks.workunit.client.0.smithi192.stdout: 1 987904 9.87 MB/sec execute 388 sec latency 17.601 ms 2020-11-20T11:57:50.469 INFO:tasks.workunit.client.0.smithi192.stdout: 1 989319 9.85 MB/sec execute 389 sec latency 19.124 ms 2020-11-20T11:57:51.464 INFO:tasks.workunit.client.0.smithi192.stdout: 1 991532 9.86 MB/sec execute 390 sec latency 57.659 ms 2020-11-20T11:57:52.463 INFO:tasks.workunit.client.0.smithi192.stdout: 1 992869 9.85 MB/sec execute 391 sec latency 69.230 ms 2020-11-20T11:57:53.465 INFO:tasks.workunit.client.0.smithi192.stdout: 1 995145 9.86 MB/sec execute 392 sec latency 14.943 ms 2020-11-20T11:57:54.463 INFO:tasks.workunit.client.0.smithi192.stdout: 1 996601 9.85 MB/sec execute 393 sec latency 16.338 ms 2020-11-20T11:57:55.465 INFO:tasks.workunit.client.0.smithi192.stdout: 1 998626 9.86 MB/sec execute 394 sec latency 49.921 ms 2020-11-20T11:57:56.464 INFO:tasks.workunit.client.0.smithi192.stdout: 1 999811 9.85 MB/sec execute 395 sec latency 28.790 ms 2020-11-20T11:57:57.463 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1001938 9.86 MB/sec execute 396 sec latency 60.193 ms 2020-11-20T11:57:58.463 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1002914 9.84 MB/sec execute 397 sec latency 24.482 ms 2020-11-20T11:57:59.463 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1004845 9.84 MB/sec execute 398 sec latency 141.395 ms 2020-11-20T11:58:00.463 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1005385 9.83 MB/sec execute 399 sec latency 541.476 ms 2020-11-20T11:58:00.658 INFO:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:58:00.669 INFO:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:58:00.697 INFO:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:58:01.463 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1006151 9.81 MB/sec execute 400 sec latency 21.357 ms 2020-11-20T11:58:02.465 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1007844 9.80 MB/sec execute 401 sec latency 26.708 ms 2020-11-20T11:58:03.463 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1009526 9.81 MB/sec execute 402 sec latency 16.679 ms 2020-11-20T11:58:04.464 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1011354 9.80 MB/sec execute 403 sec latency 18.624 ms 2020-11-20T11:58:05.464 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1013007 9.81 MB/sec execute 404 sec latency 13.773 ms 2020-11-20T11:58:06.465 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1014894 9.80 MB/sec execute 405 sec latency 17.794 ms 2020-11-20T11:58:07.464 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1016485 9.81 MB/sec execute 406 sec latency 29.899 ms 2020-11-20T11:58:08.465 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1017875 9.80 MB/sec execute 407 sec latency 39.688 ms 2020-11-20T11:58:09.463 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1019904 9.80 MB/sec execute 408 sec latency 31.518 ms 2020-11-20T11:58:10.463 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1021266 9.79 MB/sec execute 409 sec latency 16.156 ms 2020-11-20T11:58:11.467 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1023280 9.80 MB/sec execute 410 sec latency 23.095 ms 2020-11-20T11:58:12.464 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1024128 9.78 MB/sec execute 411 sec latency 20.805 ms 2020-11-20T11:58:13.464 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1026150 9.79 MB/sec execute 412 sec latency 53.342 ms 2020-11-20T11:58:14.464 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1027430 9.78 MB/sec execute 413 sec latency 15.484 ms 2020-11-20T11:58:15.465 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1029283 9.77 MB/sec execute 414 sec latency 19.912 ms 2020-11-20T11:58:16.465 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1030826 9.78 MB/sec execute 415 sec latency 15.698 ms 2020-11-20T11:58:17.467 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1032632 9.77 MB/sec execute 416 sec latency 17.115 ms 2020-11-20T11:58:18.466 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1034087 9.78 MB/sec execute 417 sec latency 17.360 ms 2020-11-20T11:58:19.467 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1035162 9.77 MB/sec execute 418 sec latency 50.740 ms 2020-11-20T11:58:20.465 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1037461 9.77 MB/sec execute 419 sec latency 15.843 ms 2020-11-20T11:58:21.464 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1038542 9.76 MB/sec execute 420 sec latency 15.364 ms 2020-11-20T11:58:22.464 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1040955 9.77 MB/sec execute 421 sec latency 16.577 ms 2020-11-20T11:58:23.464 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1041814 9.75 MB/sec execute 422 sec latency 25.258 ms 2020-11-20T11:58:24.464 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1043871 9.76 MB/sec execute 423 sec latency 68.354 ms 2020-11-20T11:58:25.464 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1044671 9.75 MB/sec execute 424 sec latency 210.679 ms 2020-11-20T11:58:26.465 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1045137 9.73 MB/sec execute 425 sec latency 253.414 ms 2020-11-20T11:58:27.464 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1046241 9.72 MB/sec execute 426 sec latency 31.938 ms 2020-11-20T11:58:28.465 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1047953 9.72 MB/sec execute 427 sec latency 32.126 ms 2020-11-20T11:58:29.465 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1048877 9.71 MB/sec execute 428 sec latency 27.278 ms 2020-11-20T11:58:30.465 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1050864 9.71 MB/sec execute 429 sec latency 28.738 ms 2020-11-20T11:58:31.107 INFO:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:58:31.109 INFO:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:58:31.112 INFO:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:58:31.464 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1052175 9.70 MB/sec execute 430 sec latency 31.920 ms 2020-11-20T11:58:32.464 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1053886 9.70 MB/sec execute 431 sec latency 21.365 ms 2020-11-20T11:58:33.465 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1055394 9.70 MB/sec execute 432 sec latency 17.292 ms 2020-11-20T11:58:34.464 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1056490 9.69 MB/sec execute 433 sec latency 24.585 ms 2020-11-20T11:58:35.465 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1058430 9.69 MB/sec execute 434 sec latency 34.694 ms 2020-11-20T11:58:37.674 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1059473 9.68 MB/sec execute 435 sec latency 47.742 ms 2020-11-20T11:58:37.674 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1061618 9.69 MB/sec execute 436 sec latency 21.627 ms 2020-11-20T11:58:38.465 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1063021 9.68 MB/sec execute 437 sec latency 16.646 ms 2020-11-20T11:58:39.465 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1065160 9.69 MB/sec execute 438 sec latency 19.017 ms 2020-11-20T11:58:40.465 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1066511 9.68 MB/sec execute 439 sec latency 14.705 ms 2020-11-20T11:58:41.465 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1068284 9.68 MB/sec execute 440 sec latency 59.043 ms 2020-11-20T11:58:42.535 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1069949 9.68 MB/sec execute 441 sec latency 16.233 ms 2020-11-20T11:58:43.465 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1071739 9.67 MB/sec execute 442 sec latency 46.418 ms 2020-11-20T11:58:44.465 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1073385 9.68 MB/sec execute 443 sec latency 14.526 ms 2020-11-20T11:58:45.466 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1075053 9.67 MB/sec execute 444 sec latency 108.655 ms 2020-11-20T11:58:46.466 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1075377 9.65 MB/sec execute 445 sec latency 114.578 ms 2020-11-20T11:58:48.086 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1076629 9.65 MB/sec execute 446 sec latency 24.240 ms 2020-11-20T11:58:48.466 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1077506 9.64 MB/sec execute 447 sec latency 24.957 ms 2020-11-20T11:58:49.466 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1079837 9.65 MB/sec execute 448 sec latency 24.493 ms 2020-11-20T11:58:50.466 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1080755 9.64 MB/sec execute 449 sec latency 21.765 ms 2020-11-20T11:58:51.466 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1083056 9.64 MB/sec execute 450 sec latency 17.001 ms 2020-11-20T11:58:52.468 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1084165 9.63 MB/sec execute 451 sec latency 34.075 ms 2020-11-20T11:58:53.467 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1086002 9.63 MB/sec execute 452 sec latency 21.883 ms 2020-11-20T11:58:54.467 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1087513 9.63 MB/sec execute 453 sec latency 15.596 ms 2020-11-20T11:58:55.466 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1089102 9.62 MB/sec execute 454 sec latency 21.328 ms 2020-11-20T11:58:56.466 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1090811 9.63 MB/sec execute 455 sec latency 15.897 ms 2020-11-20T11:58:57.466 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1091768 9.62 MB/sec execute 456 sec latency 26.239 ms 2020-11-20T11:58:58.466 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1093835 9.62 MB/sec execute 457 sec latency 65.463 ms 2020-11-20T11:58:59.597 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1094843 9.61 MB/sec execute 458 sec latency 32.219 ms 2020-11-20T11:59:00.468 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1096635 9.61 MB/sec execute 459 sec latency 24.493 ms 2020-11-20T11:59:01.466 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1098082 9.61 MB/sec execute 460 sec latency 15.155 ms 2020-11-20T11:59:01.488 INFO:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:59:01.491 INFO:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:59:01.493 INFO:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:59:02.466 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1099461 9.60 MB/sec execute 461 sec latency 22.084 ms 2020-11-20T11:59:03.466 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1101354 9.61 MB/sec execute 462 sec latency 55.614 ms 2020-11-20T11:59:04.467 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1102070 9.59 MB/sec execute 463 sec latency 27.551 ms 2020-11-20T11:59:05.467 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1104125 9.60 MB/sec execute 464 sec latency 19.178 ms 2020-11-20T11:59:06.466 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1104789 9.59 MB/sec execute 465 sec latency 272.610 ms 2020-11-20T11:59:07.467 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1105415 9.57 MB/sec execute 466 sec latency 140.909 ms 2020-11-20T11:59:08.467 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1106520 9.56 MB/sec execute 467 sec latency 34.509 ms 2020-11-20T11:59:09.467 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1108244 9.57 MB/sec execute 468 sec latency 55.108 ms 2020-11-20T11:59:10.467 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1109148 9.55 MB/sec execute 469 sec latency 19.826 ms 2020-11-20T11:59:11.467 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1111113 9.55 MB/sec execute 470 sec latency 23.257 ms 2020-11-20T11:59:12.467 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1112259 9.55 MB/sec execute 471 sec latency 45.522 ms 2020-11-20T11:59:13.467 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1113674 9.54 MB/sec execute 472 sec latency 22.851 ms 2020-11-20T11:59:14.467 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1115554 9.55 MB/sec execute 473 sec latency 52.173 ms 2020-11-20T11:59:15.467 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1116511 9.53 MB/sec execute 474 sec latency 15.315 ms 2020-11-20T11:59:16.467 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1118690 9.54 MB/sec execute 475 sec latency 18.100 ms 2020-11-20T11:59:17.467 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1119757 9.53 MB/sec execute 476 sec latency 15.894 ms 2020-11-20T11:59:18.467 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1121642 9.53 MB/sec execute 477 sec latency 28.979 ms 2020-11-20T11:59:19.467 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1122900 9.53 MB/sec execute 478 sec latency 31.433 ms 2020-11-20T11:59:20.467 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1124103 9.52 MB/sec execute 479 sec latency 64.000 ms 2020-11-20T11:59:21.467 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1126182 9.53 MB/sec execute 480 sec latency 17.495 ms 2020-11-20T11:59:22.467 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1126893 9.51 MB/sec execute 481 sec latency 34.791 ms 2020-11-20T11:59:23.467 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1128936 9.52 MB/sec execute 482 sec latency 18.259 ms 2020-11-20T11:59:24.467 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1130188 9.51 MB/sec execute 483 sec latency 21.493 ms 2020-11-20T11:59:25.468 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1131909 9.50 MB/sec execute 484 sec latency 38.646 ms 2020-11-20T11:59:26.467 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1133343 9.51 MB/sec execute 485 sec latency 27.496 ms 2020-11-20T11:59:27.467 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1134179 9.49 MB/sec execute 486 sec latency 33.190 ms 2020-11-20T11:59:28.467 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1136123 9.50 MB/sec execute 487 sec latency 20.028 ms 2020-11-20T11:59:29.467 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1137332 9.49 MB/sec execute 488 sec latency 29.679 ms 2020-11-20T11:59:30.467 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1138569 9.48 MB/sec execute 489 sec latency 33.536 ms 2020-11-20T11:59:31.467 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1140344 9.49 MB/sec execute 490 sec latency 30.949 ms 2020-11-20T11:59:31.568 INFO:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:59:31.572 INFO:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:59:31.593 INFO:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:59:32.468 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1140443 9.47 MB/sec execute 491 sec latency 561.838 ms 2020-11-20T11:59:33.474 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1141135 9.45 MB/sec execute 492 sec latency 35.915 ms 2020-11-20T11:59:34.468 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1142692 9.45 MB/sec execute 493 sec latency 37.265 ms 2020-11-20T11:59:35.468 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1144155 9.45 MB/sec execute 494 sec latency 27.978 ms 2020-11-20T11:59:36.469 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1145430 9.44 MB/sec execute 495 sec latency 17.608 ms 2020-11-20T11:59:37.468 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1147544 9.45 MB/sec execute 496 sec latency 17.641 ms 2020-11-20T11:59:38.468 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1148480 9.44 MB/sec execute 497 sec latency 24.887 ms 2020-11-20T11:59:39.468 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1150655 9.44 MB/sec execute 498 sec latency 37.194 ms 2020-11-20T11:59:40.468 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1151749 9.44 MB/sec execute 499 sec latency 18.147 ms 2020-11-20T11:59:41.468 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1153833 9.44 MB/sec execute 500 sec latency 18.316 ms 2020-11-20T11:59:42.468 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1154859 9.44 MB/sec execute 501 sec latency 65.792 ms 2020-11-20T11:59:43.468 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1156584 9.43 MB/sec execute 502 sec latency 16.992 ms 2020-11-20T11:59:44.468 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1158212 9.44 MB/sec execute 503 sec latency 18.308 ms 2020-11-20T11:59:45.468 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1159133 9.42 MB/sec execute 504 sec latency 25.309 ms 2020-11-20T11:59:46.468 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1161265 9.43 MB/sec execute 505 sec latency 18.782 ms 2020-11-20T11:59:47.468 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1162214 9.42 MB/sec execute 506 sec latency 77.846 ms 2020-11-20T11:59:48.468 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1163929 9.41 MB/sec execute 507 sec latency 26.115 ms 2020-11-20T11:59:49.468 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1165432 9.42 MB/sec execute 508 sec latency 21.763 ms 2020-11-20T11:59:50.469 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1166685 9.41 MB/sec execute 509 sec latency 21.148 ms 2020-11-20T11:59:51.468 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1168807 9.42 MB/sec execute 510 sec latency 18.488 ms 2020-11-20T11:59:52.469 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1169640 9.40 MB/sec execute 511 sec latency 36.890 ms 2020-11-20T11:59:53.468 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1171915 9.41 MB/sec execute 512 sec latency 17.087 ms 2020-11-20T11:59:54.857 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1172982 9.40 MB/sec execute 513 sec latency 17.179 ms 2020-11-20T11:59:55.469 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1174887 9.40 MB/sec execute 514 sec latency 33.667 ms 2020-11-20T11:59:56.469 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1176336 9.40 MB/sec execute 515 sec latency 17.508 ms 2020-11-20T11:59:57.469 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1177992 9.40 MB/sec execute 516 sec latency 55.711 ms 2020-11-20T11:59:58.469 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1179479 9.40 MB/sec execute 517 sec latency 59.593 ms 2020-11-20T11:59:59.481 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1180384 9.39 MB/sec execute 518 sec latency 24.155 ms 2020-11-20T12:00:00.470 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1182556 9.39 MB/sec execute 519 sec latency 18.599 ms 2020-11-20T12:00:01.469 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1183632 9.39 MB/sec execute 520 sec latency 16.656 ms 2020-11-20T12:00:02.035 INFO:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:00:02.038 INFO:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:00:02.040 INFO:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:00:02.471 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1185515 9.39 MB/sec execute 521 sec latency 23.682 ms 2020-11-20T12:00:03.469 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1186835 9.39 MB/sec execute 522 sec latency 17.635 ms 2020-11-20T12:00:04.470 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1187985 9.38 MB/sec execute 523 sec latency 47.144 ms 2020-11-20T12:00:05.469 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1190047 9.39 MB/sec execute 524 sec latency 17.965 ms 2020-11-20T12:00:06.469 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1190819 9.37 MB/sec execute 525 sec latency 25.757 ms 2020-11-20T12:00:07.469 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1192598 9.37 MB/sec execute 526 sec latency 77.805 ms 2020-11-20T12:00:08.469 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1193824 9.37 MB/sec execute 527 sec latency 21.464 ms 2020-11-20T12:00:09.469 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1194834 9.36 MB/sec execute 528 sec latency 51.450 ms 2020-11-20T12:00:10.469 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1196757 9.36 MB/sec execute 529 sec latency 20.711 ms 2020-11-20T12:00:11.469 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1197750 9.35 MB/sec execute 530 sec latency 17.963 ms 2020-11-20T12:00:12.469 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1199408 9.35 MB/sec execute 531 sec latency 58.059 ms 2020-11-20T12:00:13.469 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1200735 9.35 MB/sec execute 532 sec latency 127.757 ms 2020-11-20T12:00:14.469 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1201451 9.34 MB/sec execute 533 sec latency 75.327 ms 2020-11-20T12:00:15.469 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1203401 9.34 MB/sec execute 534 sec latency 79.250 ms 2020-11-20T12:00:16.470 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1204704 9.34 MB/sec execute 535 sec latency 17.968 ms 2020-11-20T12:00:17.471 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1206367 9.33 MB/sec execute 536 sec latency 22.979 ms 2020-11-20T12:00:18.469 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1207637 9.33 MB/sec execute 537 sec latency 64.115 ms 2020-11-20T12:00:19.470 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1208471 9.32 MB/sec execute 538 sec latency 33.605 ms 2020-11-20T12:00:20.470 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1210494 9.33 MB/sec execute 539 sec latency 37.850 ms 2020-11-20T12:00:21.471 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1211849 9.32 MB/sec execute 540 sec latency 16.533 ms 2020-11-20T12:00:22.470 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1213679 9.32 MB/sec execute 541 sec latency 40.291 ms 2020-11-20T12:00:23.470 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1214042 9.31 MB/sec execute 542 sec latency 867.113 ms 2020-11-20T12:00:24.470 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1214656 9.30 MB/sec execute 543 sec latency 233.900 ms 2020-11-20T12:00:25.470 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1215328 9.29 MB/sec execute 544 sec latency 30.761 ms 2020-11-20T12:00:26.470 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1216365 9.28 MB/sec execute 545 sec latency 24.622 ms 2020-11-20T12:00:27.470 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1218189 9.28 MB/sec execute 546 sec latency 24.861 ms 2020-11-20T12:00:28.470 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1219094 9.27 MB/sec execute 547 sec latency 24.614 ms 2020-11-20T12:00:29.470 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1221385 9.28 MB/sec execute 548 sec latency 21.650 ms 2020-11-20T12:00:30.474 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1222580 9.27 MB/sec execute 549 sec latency 15.629 ms 2020-11-20T12:00:31.471 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1224519 9.28 MB/sec execute 550 sec latency 67.039 ms 2020-11-20T12:00:32.108 INFO:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:00:32.114 INFO:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:00:32.121 INFO:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:00:32.170 INFO:tasks.ceph.osd.3.smithi192.stderr:2020-11-20T12:00:32.167+0000 7fc0bf346700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 29712) UID: 0 2020-11-20T12:00:32.171 INFO:tasks.ceph.osd.6.smithi192.stderr:2020-11-20T12:00:32.167+0000 7fe02eff7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 29712) UID: 0 2020-11-20T12:00:32.171 INFO:tasks.ceph.osd.0.smithi192.stderr:2020-11-20T12:00:32.167+0000 7f79b0d25700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 29712) UID: 0 2020-11-20T12:00:32.171 INFO:tasks.ceph.osd.9.smithi192.stderr:2020-11-20T12:00:32.167+0000 7f7cbf4a3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 29712) UID: 0 2020-11-20T12:00:32.471 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1225899 9.27 MB/sec execute 551 sec latency 34.561 ms 2020-11-20T12:00:33.470 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1227648 9.27 MB/sec execute 552 sec latency 22.257 ms 2020-11-20T12:00:34.470 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1229231 9.27 MB/sec execute 553 sec latency 16.626 ms 2020-11-20T12:00:35.470 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1230331 9.27 MB/sec execute 554 sec latency 78.162 ms 2020-11-20T12:00:36.470 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1232547 9.27 MB/sec execute 555 sec latency 38.655 ms 2020-11-20T12:00:37.470 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1233430 9.26 MB/sec execute 556 sec latency 32.509 ms 2020-11-20T12:00:38.912 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1235893 9.27 MB/sec execute 557 sec latency 17.772 ms 2020-11-20T12:00:39.470 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1236821 9.26 MB/sec execute 558 sec latency 30.720 ms 2020-11-20T12:00:40.470 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1239129 9.27 MB/sec execute 559 sec latency 17.600 ms 2020-11-20T12:00:41.470 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1240292 9.26 MB/sec execute 560 sec latency 17.444 ms 2020-11-20T12:00:42.470 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1242249 9.26 MB/sec execute 561 sec latency 56.554 ms 2020-11-20T12:00:43.470 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1243714 9.26 MB/sec execute 562 sec latency 16.730 ms 2020-11-20T12:00:44.471 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1245468 9.26 MB/sec execute 563 sec latency 25.717 ms 2020-11-20T12:00:45.471 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1246953 9.26 MB/sec execute 564 sec latency 16.585 ms 2020-11-20T12:00:46.470 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1248026 9.26 MB/sec execute 565 sec latency 27.140 ms 2020-11-20T12:00:47.471 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1249913 9.26 MB/sec execute 566 sec latency 21.151 ms 2020-11-20T12:00:48.470 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1250805 9.25 MB/sec execute 567 sec latency 49.560 ms 2020-11-20T12:00:49.471 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1252462 9.24 MB/sec execute 568 sec latency 36.067 ms 2020-11-20T12:00:50.470 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1253905 9.25 MB/sec execute 569 sec latency 20.892 ms 2020-11-20T12:00:51.471 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1254664 9.23 MB/sec execute 570 sec latency 27.994 ms 2020-11-20T12:00:52.471 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1256662 9.24 MB/sec execute 571 sec latency 18.501 ms 2020-11-20T12:00:53.471 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1257711 9.23 MB/sec execute 572 sec latency 38.903 ms 2020-11-20T12:00:54.471 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1259096 9.23 MB/sec execute 573 sec latency 30.057 ms 2020-11-20T12:00:55.471 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1260963 9.23 MB/sec execute 574 sec latency 21.743 ms 2020-11-20T12:00:56.471 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1261679 9.22 MB/sec execute 575 sec latency 29.587 ms 2020-11-20T12:00:57.471 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1263632 9.22 MB/sec execute 576 sec latency 23.381 ms 2020-11-20T12:00:58.471 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1264769 9.22 MB/sec execute 577 sec latency 36.431 ms 2020-11-20T12:00:59.471 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1264775 9.20 MB/sec execute 578 sec latency 411.277 ms 2020-11-20T12:01:00.471 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1265099 9.19 MB/sec execute 579 sec latency 570.249 ms 2020-11-20T12:01:01.471 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1266106 9.18 MB/sec execute 580 sec latency 74.904 ms 2020-11-20T12:01:02.471 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1267471 9.18 MB/sec execute 581 sec latency 40.541 ms 2020-11-20T12:01:03.472 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1268322 9.17 MB/sec execute 582 sec latency 25.169 ms 2020-11-20T12:01:04.471 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1269405 9.17 MB/sec execute 583 sec latency 30.177 ms 2020-11-20T12:01:05.472 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1271382 9.17 MB/sec execute 584 sec latency 18.417 ms 2020-11-20T12:01:06.471 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1272145 9.16 MB/sec execute 585 sec latency 21.197 ms 2020-11-20T12:01:07.471 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1273886 9.16 MB/sec execute 586 sec latency 20.078 ms 2020-11-20T12:01:08.471 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1275225 9.16 MB/sec execute 587 sec latency 36.054 ms 2020-11-20T12:01:09.471 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1276107 9.15 MB/sec execute 588 sec latency 35.787 ms 2020-11-20T12:01:10.471 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1277856 9.15 MB/sec execute 589 sec latency 58.701 ms 2020-11-20T12:01:11.473 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1278957 9.15 MB/sec execute 590 sec latency 19.565 ms 2020-11-20T12:01:12.471 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1280119 9.14 MB/sec execute 591 sec latency 22.785 ms 2020-11-20T12:01:13.471 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1282132 9.15 MB/sec execute 592 sec latency 21.580 ms 2020-11-20T12:01:14.471 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1282787 9.13 MB/sec execute 593 sec latency 162.643 ms 2020-11-20T12:01:15.471 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1283453 9.13 MB/sec execute 594 sec latency 448.457 ms 2020-11-20T12:01:16.473 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1284956 9.12 MB/sec execute 595 sec latency 37.970 ms 2020-11-20T12:01:17.472 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1286248 9.12 MB/sec execute 596 sec latency 24.693 ms 2020-11-20T12:01:18.471 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1287347 9.11 MB/sec execute 597 sec latency 55.831 ms 2020-11-20T12:01:19.471 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1289189 9.12 MB/sec execute 598 sec latency 31.985 ms 2020-11-20T12:01:20.472 INFO:tasks.workunit.client.0.smithi192.stdout: 1 1289929 9.11 MB/sec execute 599 sec latency 26.519 ms 2020-11-20T12:01:21.471 INFO:tasks.workunit.client.0.smithi192.stdout: 1 cleanup 600 sec 2020-11-20T12:01:21.611 INFO:tasks.workunit.client.0.smithi192.stdout: 0 cleanup 600 sec 2020-11-20T12:01:22.527 INFO:tasks.workunit.client.0.smithi192.stdout: 2020-11-20T12:01:22.528 INFO:tasks.workunit.client.0.smithi192.stdout: Operation Count AvgLat MaxLat 2020-11-20T12:01:22.528 INFO:tasks.workunit.client.0.smithi192.stdout: ---------------------------------------- 2020-11-20T12:01:22.528 INFO:tasks.workunit.client.0.smithi192.stdout: NTCreateX 174118 1.121 743.304 2020-11-20T12:01:22.528 INFO:tasks.workunit.client.0.smithi192.stdout: Close 127935 0.002 0.069 2020-11-20T12:01:22.529 INFO:tasks.workunit.client.0.smithi192.stdout: Rename 7375 5.734 195.387 2020-11-20T12:01:22.529 INFO:tasks.workunit.client.0.smithi192.stdout: Unlink 35136 1.513 419.484 2020-11-20T12:01:22.529 INFO:tasks.workunit.client.0.smithi192.stdout: Deltree 4 56.803 96.716 2020-11-20T12:01:22.529 INFO:tasks.workunit.client.0.smithi192.stdout: Mkdir 2 0.009 0.013 2020-11-20T12:01:22.530 INFO:tasks.workunit.client.0.smithi192.stdout: Qpathinfo 157862 0.990 701.232 2020-11-20T12:01:22.530 INFO:tasks.workunit.client.0.smithi192.stdout: Qfileinfo 27657 0.001 0.022 2020-11-20T12:01:22.530 INFO:tasks.workunit.client.0.smithi192.stdout: Qfsinfo 28920 0.131 47.740 2020-11-20T12:01:22.530 INFO:tasks.workunit.client.0.smithi192.stdout: Sfileinfo 14203 0.014 6.724 2020-11-20T12:01:22.530 INFO:tasks.workunit.client.0.smithi192.stdout: Find 61013 0.091 23.882 2020-11-20T12:01:22.531 INFO:tasks.workunit.client.0.smithi192.stdout: WriteX 86768 0.039 1090.105 2020-11-20T12:01:22.531 INFO:tasks.workunit.client.0.smithi192.stdout: ReadX 272851 0.017 448.450 2020-11-20T12:01:22.531 INFO:tasks.workunit.client.0.smithi192.stdout: LockX 566 0.669 5.726 2020-11-20T12:01:22.531 INFO:tasks.workunit.client.0.smithi192.stdout: UnlockX 566 0.617 48.839 2020-11-20T12:01:22.531 INFO:tasks.workunit.client.0.smithi192.stdout: Flush 12209 10.838 983.024 2020-11-20T12:01:22.532 INFO:tasks.workunit.client.0.smithi192.stdout: 2020-11-20T12:01:22.532 INFO:tasks.workunit.client.0.smithi192.stdout:Throughput 9.10548 MB/sec 1 clients 1 procs max_latency=1090.111 ms 2020-11-20T12:01:22.533 INFO:tasks.workunit.client.0.smithi192.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2020-11-20T12:01:22.533 INFO:tasks.workunit.client.0.smithi192.stdout: 2020-11-20T12:01:22.533 INFO:tasks.workunit.client.0.smithi192.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2020-11-20T12:01:22.533 INFO:tasks.workunit.client.0.smithi192.stdout:8 of 10 processes prepared for launch 0 sec 2020-11-20T12:01:22.534 INFO:tasks.workunit.client.0.smithi192.stdout:10 of 10 processes prepared for launch 0 sec 2020-11-20T12:01:22.535 INFO:tasks.workunit.client.0.smithi192.stdout:releasing clients 2020-11-20T12:01:22.713 INFO:tasks.workunit.client.0.smithi192.stdout: 10 383 136.43 MB/sec warmup 1 sec latency 44.077 ms 2020-11-20T12:01:23.713 INFO:tasks.workunit.client.0.smithi192.stdout: 10 725 106.32 MB/sec warmup 2 sec latency 130.767 ms 2020-11-20T12:01:24.963 INFO:tasks.workunit.client.0.smithi192.stdout: 10 927 72.62 MB/sec warmup 3 sec latency 104.612 ms 2020-11-20T12:01:25.713 INFO:tasks.workunit.client.0.smithi192.stdout: 10 1105 57.15 MB/sec warmup 4 sec latency 638.495 ms 2020-11-20T12:01:26.713 INFO:tasks.workunit.client.0.smithi192.stdout: 10 1135 45.97 MB/sec warmup 5 sec latency 723.610 ms 2020-11-20T12:01:27.714 INFO:tasks.workunit.client.0.smithi192.stdout: 10 1530 43.49 MB/sec warmup 6 sec latency 440.588 ms 2020-11-20T12:01:28.713 INFO:tasks.workunit.client.0.smithi192.stdout: 10 2162 38.57 MB/sec warmup 7 sec latency 135.276 ms 2020-11-20T12:01:29.713 INFO:tasks.workunit.client.0.smithi192.stdout: 10 2573 36.17 MB/sec warmup 8 sec latency 136.861 ms 2020-11-20T12:01:30.717 INFO:tasks.workunit.client.0.smithi192.stdout: 10 3126 37.75 MB/sec warmup 9 sec latency 54.661 ms 2020-11-20T12:01:31.714 INFO:tasks.workunit.client.0.smithi192.stdout: 10 3620 38.59 MB/sec warmup 10 sec latency 92.172 ms 2020-11-20T12:01:32.713 INFO:tasks.workunit.client.0.smithi192.stdout: 10 3821 36.15 MB/sec warmup 11 sec latency 111.451 ms 2020-11-20T12:01:33.713 INFO:tasks.workunit.client.0.smithi192.stdout: 10 3997 33.39 MB/sec warmup 12 sec latency 73.125 ms 2020-11-20T12:01:34.714 INFO:tasks.workunit.client.0.smithi192.stdout: 10 4193 30.89 MB/sec warmup 13 sec latency 93.882 ms 2020-11-20T12:01:35.713 INFO:tasks.workunit.client.0.smithi192.stdout: 10 4439 29.11 MB/sec warmup 14 sec latency 56.762 ms 2020-11-20T12:01:36.713 INFO:tasks.workunit.client.0.smithi192.stdout: 10 4863 28.91 MB/sec warmup 15 sec latency 70.793 ms 2020-11-20T12:01:37.713 INFO:tasks.workunit.client.0.smithi192.stdout: 10 5341 28.39 MB/sec warmup 16 sec latency 203.804 ms 2020-11-20T12:01:38.713 INFO:tasks.workunit.client.0.smithi192.stdout: 10 5982 27.79 MB/sec warmup 17 sec latency 102.742 ms 2020-11-20T12:01:39.714 INFO:tasks.workunit.client.0.smithi192.stdout: 10 6494 29.16 MB/sec warmup 18 sec latency 91.688 ms 2020-11-20T12:01:40.714 INFO:tasks.workunit.client.0.smithi192.stdout: 10 7065 30.12 MB/sec warmup 19 sec latency 60.071 ms 2020-11-20T12:01:41.714 INFO:tasks.workunit.client.0.smithi192.stdout: 10 7359 29.44 MB/sec warmup 20 sec latency 52.887 ms 2020-11-20T12:01:42.714 INFO:tasks.workunit.client.0.smithi192.stdout: 10 7526 28.18 MB/sec warmup 21 sec latency 121.594 ms 2020-11-20T12:01:43.714 INFO:tasks.workunit.client.0.smithi192.stdout: 10 7730 26.95 MB/sec warmup 22 sec latency 58.719 ms 2020-11-20T12:01:44.714 INFO:tasks.workunit.client.0.smithi192.stdout: 10 7877 25.91 MB/sec warmup 23 sec latency 174.752 ms 2020-11-20T12:01:45.714 INFO:tasks.workunit.client.0.smithi192.stdout: 10 8097 25.16 MB/sec warmup 24 sec latency 139.383 ms 2020-11-20T12:01:46.714 INFO:tasks.workunit.client.0.smithi192.stdout: 10 8669 25.74 MB/sec warmup 25 sec latency 55.489 ms 2020-11-20T12:01:47.714 INFO:tasks.workunit.client.0.smithi192.stdout: 10 9410 25.31 MB/sec warmup 26 sec latency 81.470 ms 2020-11-20T12:01:48.714 INFO:tasks.workunit.client.0.smithi192.stdout: 10 9749 25.33 MB/sec warmup 27 sec latency 164.129 ms 2020-11-20T12:01:49.714 INFO:tasks.workunit.client.0.smithi192.stdout: 10 10090 25.65 MB/sec warmup 28 sec latency 364.754 ms 2020-11-20T12:01:50.714 INFO:tasks.workunit.client.0.smithi192.stdout: 10 10566 26.02 MB/sec warmup 29 sec latency 62.353 ms 2020-11-20T12:01:51.714 INFO:tasks.workunit.client.0.smithi192.stdout: 10 10838 25.86 MB/sec warmup 30 sec latency 79.456 ms 2020-11-20T12:01:52.714 INFO:tasks.workunit.client.0.smithi192.stdout: 10 10999 25.22 MB/sec warmup 31 sec latency 76.250 ms 2020-11-20T12:01:53.714 INFO:tasks.workunit.client.0.smithi192.stdout: 10 11154 24.48 MB/sec warmup 32 sec latency 67.763 ms 2020-11-20T12:01:54.714 INFO:tasks.workunit.client.0.smithi192.stdout: 10 11315 23.78 MB/sec warmup 33 sec latency 157.906 ms 2020-11-20T12:01:55.714 INFO:tasks.workunit.client.0.smithi192.stdout: 10 11464 23.18 MB/sec warmup 34 sec latency 155.612 ms 2020-11-20T12:01:56.714 INFO:tasks.workunit.client.0.smithi192.stdout: 10 11828 23.12 MB/sec warmup 35 sec latency 81.685 ms 2020-11-20T12:01:57.714 INFO:tasks.workunit.client.0.smithi192.stdout: 10 12455 23.31 MB/sec warmup 36 sec latency 76.097 ms 2020-11-20T12:01:58.714 INFO:tasks.workunit.client.0.smithi192.stdout: 10 13102 23.13 MB/sec warmup 37 sec latency 100.177 ms 2020-11-20T12:01:59.714 INFO:tasks.workunit.client.0.smithi192.stdout: 10 13533 23.73 MB/sec warmup 38 sec latency 174.923 ms 2020-11-20T12:02:00.714 INFO:tasks.workunit.client.0.smithi192.stdout: 10 14050 24.02 MB/sec warmup 39 sec latency 61.810 ms 2020-11-20T12:02:01.714 INFO:tasks.workunit.client.0.smithi192.stdout: 10 14347 24.07 MB/sec warmup 40 sec latency 277.218 ms 2020-11-20T12:02:02.714 INFO:tasks.workunit.client.0.smithi192.stdout: 10 14351 23.48 MB/sec warmup 41 sec latency 1277.252 ms 2020-11-20T12:02:03.714 INFO:tasks.workunit.client.0.smithi192.stdout: 10 14356 22.92 MB/sec warmup 42 sec latency 2277.288 ms 2020-11-20T12:02:04.714 INFO:tasks.workunit.client.0.smithi192.stdout: 10 14358 22.39 MB/sec warmup 43 sec latency 2899.783 ms 2020-11-20T12:02:05.715 INFO:tasks.workunit.client.0.smithi192.stdout: 10 14369 21.93 MB/sec warmup 44 sec latency 3557.414 ms 2020-11-20T12:02:06.714 INFO:tasks.workunit.client.0.smithi192.stdout: 10 14476 21.60 MB/sec warmup 45 sec latency 1423.376 ms 2020-11-20T12:02:07.714 INFO:tasks.workunit.client.0.smithi192.stdout: 10 14624 21.18 MB/sec warmup 46 sec latency 84.788 ms 2020-11-20T12:02:08.714 INFO:tasks.workunit.client.0.smithi192.stdout: 10 14738 20.75 MB/sec warmup 47 sec latency 137.548 ms 2020-11-20T12:02:09.714 INFO:tasks.workunit.client.0.smithi192.stdout: 10 14907 20.36 MB/sec warmup 48 sec latency 268.539 ms 2020-11-20T12:02:10.714 INFO:tasks.workunit.client.0.smithi192.stdout: 10 15070 20.05 MB/sec warmup 49 sec latency 194.156 ms 2020-11-20T12:02:11.715 INFO:tasks.workunit.client.0.smithi192.stdout: 10 15280 19.89 MB/sec warmup 50 sec latency 152.221 ms 2020-11-20T12:02:12.715 INFO:tasks.workunit.client.0.smithi192.stdout: 10 15777 19.98 MB/sec warmup 51 sec latency 82.758 ms 2020-11-20T12:02:13.715 INFO:tasks.workunit.client.0.smithi192.stdout: 10 16288 19.95 MB/sec warmup 52 sec latency 103.101 ms 2020-11-20T12:02:14.715 INFO:tasks.workunit.client.0.smithi192.stdout: 10 16773 19.99 MB/sec warmup 53 sec latency 68.492 ms 2020-11-20T12:02:15.715 INFO:tasks.workunit.client.0.smithi192.stdout: 10 17200 20.40 MB/sec warmup 54 sec latency 68.875 ms 2020-11-20T12:02:16.715 INFO:tasks.workunit.client.0.smithi192.stdout: 10 17617 20.58 MB/sec warmup 55 sec latency 88.862 ms 2020-11-20T12:02:17.715 INFO:tasks.workunit.client.0.smithi192.stdout: 10 17912 20.66 MB/sec warmup 56 sec latency 81.517 ms 2020-11-20T12:02:18.715 INFO:tasks.workunit.client.0.smithi192.stdout: 10 18053 20.41 MB/sec warmup 57 sec latency 116.056 ms 2020-11-20T12:02:19.715 INFO:tasks.workunit.client.0.smithi192.stdout: 10 18194 20.10 MB/sec warmup 58 sec latency 175.465 ms 2020-11-20T12:02:20.715 INFO:tasks.workunit.client.0.smithi192.stdout: 10 18363 19.78 MB/sec warmup 59 sec latency 87.835 ms 2020-11-20T12:02:21.715 INFO:tasks.workunit.client.0.smithi192.stdout: 10 18564 19.53 MB/sec warmup 60 sec latency 184.957 ms 2020-11-20T12:02:22.717 INFO:tasks.workunit.client.0.smithi192.stdout: 10 18593 19.23 MB/sec warmup 61 sec latency 765.394 ms 2020-11-20T12:02:23.715 INFO:tasks.workunit.client.0.smithi192.stdout: 10 18612 18.92 MB/sec warmup 62 sec latency 1550.794 ms 2020-11-20T12:02:24.715 INFO:tasks.workunit.client.0.smithi192.stdout: 10 18785 18.77 MB/sec warmup 63 sec latency 457.298 ms 2020-11-20T12:02:25.715 INFO:tasks.workunit.client.0.smithi192.stdout: 10 19094 18.67 MB/sec warmup 64 sec latency 123.045 ms 2020-11-20T12:02:26.715 INFO:tasks.workunit.client.0.smithi192.stdout: 10 19489 18.79 MB/sec warmup 65 sec latency 135.377 ms 2020-11-20T12:02:27.715 INFO:tasks.workunit.client.0.smithi192.stdout: 10 20109 18.76 MB/sec warmup 66 sec latency 136.164 ms 2020-11-20T12:02:28.715 INFO:tasks.workunit.client.0.smithi192.stdout: 10 20569 18.94 MB/sec warmup 67 sec latency 114.148 ms 2020-11-20T12:02:29.715 INFO:tasks.workunit.client.0.smithi192.stdout: 10 21066 19.29 MB/sec warmup 68 sec latency 111.066 ms 2020-11-20T12:02:30.715 INFO:tasks.workunit.client.0.smithi192.stdout: 10 21428 19.46 MB/sec warmup 69 sec latency 91.918 ms 2020-11-20T12:02:31.715 INFO:tasks.workunit.client.0.smithi192.stdout: 10 21647 19.36 MB/sec warmup 70 sec latency 91.958 ms 2020-11-20T12:02:32.715 INFO:tasks.workunit.client.0.smithi192.stdout: 10 21840 19.13 MB/sec warmup 71 sec latency 74.979 ms 2020-11-20T12:02:33.715 INFO:tasks.workunit.client.0.smithi192.stdout: 10 22024 18.91 MB/sec warmup 72 sec latency 109.241 ms 2020-11-20T12:02:34.715 INFO:tasks.workunit.client.0.smithi192.stdout: 10 22222 18.74 MB/sec warmup 73 sec latency 116.817 ms 2020-11-20T12:02:35.715 INFO:tasks.workunit.client.0.smithi192.stdout: 10 22433 18.60 MB/sec warmup 74 sec latency 151.545 ms 2020-11-20T12:02:36.715 INFO:tasks.workunit.client.0.smithi192.stdout: 10 22909 18.67 MB/sec warmup 75 sec latency 90.575 ms 2020-11-20T12:02:37.715 INFO:tasks.workunit.client.0.smithi192.stdout: 10 23537 18.77 MB/sec warmup 76 sec latency 63.338 ms 2020-11-20T12:02:38.718 INFO:tasks.workunit.client.0.smithi192.stdout: 10 23881 18.71 MB/sec warmup 77 sec latency 218.122 ms 2020-11-20T12:02:39.719 INFO:tasks.workunit.client.0.smithi192.stdout: 10 24291 18.97 MB/sec warmup 78 sec latency 161.264 ms 2020-11-20T12:02:40.719 INFO:tasks.workunit.client.0.smithi192.stdout: 10 24765 19.16 MB/sec warmup 79 sec latency 92.032 ms 2020-11-20T12:02:41.719 INFO:tasks.workunit.client.0.smithi192.stdout: 10 25090 19.26 MB/sec warmup 80 sec latency 82.913 ms 2020-11-20T12:02:42.721 INFO:tasks.workunit.client.0.smithi192.stdout: 10 25204 19.09 MB/sec warmup 81 sec latency 192.311 ms 2020-11-20T12:02:43.721 INFO:tasks.workunit.client.0.smithi192.stdout: 10 25220 18.86 MB/sec warmup 82 sec latency 742.522 ms 2020-11-20T12:02:44.721 INFO:tasks.workunit.client.0.smithi192.stdout: 10 25223 18.63 MB/sec warmup 83 sec latency 1106.962 ms 2020-11-20T12:02:45.721 INFO:tasks.workunit.client.0.smithi192.stdout: 10 25335 18.44 MB/sec warmup 84 sec latency 638.971 ms 2020-11-20T12:02:46.721 INFO:tasks.workunit.client.0.smithi192.stdout: 10 25479 18.25 MB/sec warmup 85 sec latency 111.421 ms 2020-11-20T12:02:47.721 INFO:tasks.workunit.client.0.smithi192.stdout: 10 25702 18.11 MB/sec warmup 86 sec latency 91.000 ms 2020-11-20T12:02:48.721 INFO:tasks.workunit.client.0.smithi192.stdout: 10 25875 17.97 MB/sec warmup 87 sec latency 150.676 ms 2020-11-20T12:02:49.722 INFO:tasks.workunit.client.0.smithi192.stdout: 10 26067 17.82 MB/sec warmup 88 sec latency 206.546 ms 2020-11-20T12:02:50.722 INFO:tasks.workunit.client.0.smithi192.stdout: 10 26451 17.88 MB/sec warmup 89 sec latency 90.214 ms 2020-11-20T12:02:51.722 INFO:tasks.workunit.client.0.smithi192.stdout: 10 26927 17.96 MB/sec warmup 90 sec latency 111.958 ms 2020-11-20T12:02:52.722 INFO:tasks.workunit.client.0.smithi192.stdout: 10 27598 18.10 MB/sec warmup 91 sec latency 55.444 ms 2020-11-20T12:02:53.722 INFO:tasks.workunit.client.0.smithi192.stdout: 10 28144 18.45 MB/sec warmup 92 sec latency 66.507 ms 2020-11-20T12:02:54.722 INFO:tasks.workunit.client.0.smithi192.stdout: 10 28522 18.53 MB/sec warmup 93 sec latency 69.479 ms 2020-11-20T12:02:55.722 INFO:tasks.workunit.client.0.smithi192.stdout: 10 28755 18.49 MB/sec warmup 94 sec latency 72.612 ms 2020-11-20T12:02:56.722 INFO:tasks.workunit.client.0.smithi192.stdout: 10 28959 18.33 MB/sec warmup 95 sec latency 68.347 ms 2020-11-20T12:02:57.722 INFO:tasks.workunit.client.0.smithi192.stdout: 10 29175 18.18 MB/sec warmup 96 sec latency 77.125 ms 2020-11-20T12:02:58.722 INFO:tasks.workunit.client.0.smithi192.stdout: 10 29193 17.99 MB/sec warmup 97 sec latency 987.524 ms 2020-11-20T12:02:59.722 INFO:tasks.workunit.client.0.smithi192.stdout: 10 29282 17.88 MB/sec warmup 98 sec latency 1505.054 ms 2020-11-20T12:03:00.722 INFO:tasks.workunit.client.0.smithi192.stdout: 10 29469 17.75 MB/sec warmup 99 sec latency 129.403 ms 2020-11-20T12:03:01.722 INFO:tasks.workunit.client.0.smithi192.stdout: 10 29804 17.71 MB/sec warmup 100 sec latency 92.554 ms 2020-11-20T12:03:02.722 INFO:tasks.workunit.client.0.smithi192.stdout: 10 30186 17.79 MB/sec warmup 101 sec latency 77.992 ms 2020-11-20T12:03:03.723 INFO:tasks.workunit.client.0.smithi192.stdout: 10 30680 17.78 MB/sec warmup 102 sec latency 123.096 ms 2020-11-20T12:03:04.722 INFO:tasks.workunit.client.0.smithi192.stdout: 10 31247 17.93 MB/sec warmup 103 sec latency 60.646 ms 2020-11-20T12:03:05.722 INFO:tasks.workunit.client.0.smithi192.stdout: 10 31684 18.13 MB/sec warmup 104 sec latency 137.236 ms 2020-11-20T12:03:06.722 INFO:tasks.workunit.client.0.smithi192.stdout: 10 32091 18.26 MB/sec warmup 105 sec latency 56.621 ms 2020-11-20T12:03:07.722 INFO:tasks.workunit.client.0.smithi192.stdout: 10 32319 18.20 MB/sec warmup 106 sec latency 61.539 ms 2020-11-20T12:03:08.722 INFO:tasks.workunit.client.0.smithi192.stdout: 10 32495 18.06 MB/sec warmup 107 sec latency 89.928 ms 2020-11-20T12:03:09.722 INFO:tasks.workunit.client.0.smithi192.stdout: 10 32710 17.93 MB/sec warmup 108 sec latency 75.809 ms 2020-11-20T12:03:10.722 INFO:tasks.workunit.client.0.smithi192.stdout: 10 32941 17.85 MB/sec warmup 109 sec latency 195.502 ms 2020-11-20T12:03:11.722 INFO:tasks.workunit.client.0.smithi192.stdout: 10 33357 17.84 MB/sec warmup 110 sec latency 195.725 ms 2020-11-20T12:03:12.722 INFO:tasks.workunit.client.0.smithi192.stdout: 10 34020 18.02 MB/sec warmup 111 sec latency 45.382 ms 2020-11-20T12:03:13.723 INFO:tasks.workunit.client.0.smithi192.stdout: 10 34733 18.16 MB/sec warmup 112 sec latency 56.633 ms 2020-11-20T12:03:14.722 INFO:tasks.workunit.client.0.smithi192.stdout: 10 35206 18.36 MB/sec warmup 113 sec latency 51.489 ms 2020-11-20T12:03:15.722 INFO:tasks.workunit.client.0.smithi192.stdout: 10 35588 18.45 MB/sec warmup 114 sec latency 78.864 ms 2020-11-20T12:03:16.722 INFO:tasks.workunit.client.0.smithi192.stdout: 10 35811 18.42 MB/sec warmup 115 sec latency 88.136 ms 2020-11-20T12:03:17.722 INFO:tasks.workunit.client.0.smithi192.stdout: 10 35979 18.29 MB/sec warmup 116 sec latency 122.140 ms 2020-11-20T12:03:18.722 INFO:tasks.workunit.client.0.smithi192.stdout: 10 36106 18.16 MB/sec warmup 117 sec latency 445.032 ms 2020-11-20T12:03:19.724 INFO:tasks.workunit.client.0.smithi192.stdout: 10 36113 18.00 MB/sec warmup 118 sec latency 1446.368 ms 2020-11-20T12:03:20.724 INFO:tasks.workunit.client.0.smithi192.stdout: 10 36126 17.86 MB/sec warmup 119 sec latency 2286.794 ms 2020-11-20T12:03:22.724 INFO:tasks.workunit.client.0.smithi192.stdout: 10 36583 12.74 MB/sec execute 1 sec latency 203.689 ms 2020-11-20T12:03:23.724 INFO:tasks.workunit.client.0.smithi192.stdout: 10 36953 12.18 MB/sec execute 2 sec latency 140.364 ms 2020-11-20T12:03:24.724 INFO:tasks.workunit.client.0.smithi192.stdout: 10 37390 16.92 MB/sec execute 3 sec latency 67.879 ms 2020-11-20T12:03:25.724 INFO:tasks.workunit.client.0.smithi192.stdout: 10 37901 18.50 MB/sec execute 4 sec latency 60.690 ms 2020-11-20T12:03:26.724 INFO:tasks.workunit.client.0.smithi192.stdout: 10 38373 21.05 MB/sec execute 5 sec latency 83.476 ms 2020-11-20T12:03:27.724 INFO:tasks.workunit.client.0.smithi192.stdout: 10 38659 21.54 MB/sec execute 6 sec latency 150.505 ms 2020-11-20T12:03:28.724 INFO:tasks.workunit.client.0.smithi192.stdout: 10 39032 22.41 MB/sec execute 7 sec latency 88.801 ms 2020-11-20T12:03:29.724 INFO:tasks.workunit.client.0.smithi192.stdout: 10 39317 22.16 MB/sec execute 8 sec latency 101.576 ms 2020-11-20T12:03:30.725 INFO:tasks.workunit.client.0.smithi192.stdout: 10 39503 20.25 MB/sec execute 9 sec latency 78.047 ms 2020-11-20T12:03:31.724 INFO:tasks.workunit.client.0.smithi192.stdout: 10 39680 18.62 MB/sec execute 10 sec latency 93.857 ms 2020-11-20T12:03:32.724 INFO:tasks.workunit.client.0.smithi192.stdout: 10 39900 17.45 MB/sec execute 11 sec latency 112.861 ms 2020-11-20T12:03:33.724 INFO:tasks.workunit.client.0.smithi192.stdout: 10 40144 17.19 MB/sec execute 12 sec latency 146.274 ms 2020-11-20T12:03:34.724 INFO:tasks.workunit.client.0.smithi192.stdout: 10 40169 15.89 MB/sec execute 13 sec latency 1146.233 ms 2020-11-20T12:03:35.724 INFO:tasks.workunit.client.0.smithi192.stdout: 10 40317 15.09 MB/sec execute 14 sec latency 1525.521 ms 2020-11-20T12:03:36.725 INFO:tasks.workunit.client.0.smithi192.stdout: 10 40731 15.16 MB/sec execute 15 sec latency 118.144 ms 2020-11-20T12:03:37.724 INFO:tasks.workunit.client.0.smithi192.stdout: 10 41145 15.55 MB/sec execute 16 sec latency 102.473 ms 2020-11-20T12:03:38.724 INFO:tasks.workunit.client.0.smithi192.stdout: 10 41562 15.97 MB/sec execute 17 sec latency 118.679 ms 2020-11-20T12:03:39.725 INFO:tasks.workunit.client.0.smithi192.stdout: 10 42039 16.87 MB/sec execute 18 sec latency 126.291 ms 2020-11-20T12:03:40.725 INFO:tasks.workunit.client.0.smithi192.stdout: 10 42490 18.07 MB/sec execute 19 sec latency 73.084 ms 2020-11-20T12:03:41.725 INFO:tasks.workunit.client.0.smithi192.stdout: 10 42831 18.39 MB/sec execute 20 sec latency 91.548 ms 2020-11-20T12:03:42.725 INFO:tasks.workunit.client.0.smithi192.stdout: 10 43044 17.82 MB/sec execute 21 sec latency 53.455 ms 2020-11-20T12:03:43.725 INFO:tasks.workunit.client.0.smithi192.stdout: 10 43223 17.13 MB/sec execute 22 sec latency 145.649 ms 2020-11-20T12:03:44.725 INFO:tasks.workunit.client.0.smithi192.stdout: 10 43369 16.57 MB/sec execute 23 sec latency 185.344 ms 2020-11-20T12:03:45.725 INFO:tasks.workunit.client.0.smithi192.stdout: 10 43619 16.43 MB/sec execute 24 sec latency 136.390 ms 2020-11-20T12:03:46.725 INFO:tasks.workunit.client.0.smithi192.stdout: 10 43987 16.50 MB/sec execute 25 sec latency 90.112 ms 2020-11-20T12:03:47.725 INFO:tasks.workunit.client.0.smithi192.stdout: 10 44492 16.55 MB/sec execute 26 sec latency 108.003 ms 2020-11-20T12:03:48.725 INFO:tasks.workunit.client.0.smithi192.stdout: 10 45063 16.94 MB/sec execute 27 sec latency 103.004 ms 2020-11-20T12:03:49.725 INFO:tasks.workunit.client.0.smithi192.stdout: 10 45464 17.30 MB/sec execute 28 sec latency 130.005 ms 2020-11-20T12:03:50.725 INFO:tasks.workunit.client.0.smithi192.stdout: 10 45901 17.96 MB/sec execute 29 sec latency 66.557 ms 2020-11-20T12:03:51.725 INFO:tasks.workunit.client.0.smithi192.stdout: 10 46251 18.41 MB/sec execute 30 sec latency 85.694 ms 2020-11-20T12:03:52.130 INFO:teuthology.orchestra.run.smithi087:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:03:52.154 INFO:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:03:52.157 INFO:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:03:52.380 INFO:tasks.ceph.osd.5.smithi087.stderr:2020-11-20T12:03:52.376+0000 7fd934129700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 26460) UID: 0 2020-11-20T12:03:52.381 INFO:tasks.ceph.osd.11.smithi087.stderr:2020-11-20T12:03:52.376+0000 7efe06540700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 26460) UID: 0 2020-11-20T12:03:52.381 INFO:tasks.ceph.osd.2.smithi087.stderr:2020-11-20T12:03:52.376+0000 7fd53edf2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 26460) UID: 0 2020-11-20T12:03:52.381 INFO:tasks.ceph.osd.8.smithi087.stderr:2020-11-20T12:03:52.376+0000 7ff5d3ba8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 26460) UID: 0 2020-11-20T12:03:52.382 INFO:tasks.ceph.osd.0.smithi192.stderr:2020-11-20T12:03:52.377+0000 7f79b0d25700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 29792) UID: 0 2020-11-20T12:03:52.383 INFO:tasks.ceph.osd.3.smithi192.stderr:2020-11-20T12:03:52.377+0000 7fc0bf346700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 29792) UID: 0 2020-11-20T12:03:52.383 INFO:tasks.ceph.osd.9.smithi192.stderr:2020-11-20T12:03:52.377+0000 7f7cbf4a3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 29792) UID: 0 2020-11-20T12:03:52.383 INFO:tasks.ceph.osd.6.smithi192.stderr:2020-11-20T12:03:52.377+0000 7fe02eff7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 29792) UID: 0 2020-11-20T12:03:52.725 INFO:tasks.workunit.client.0.smithi192.stdout: 10 46471 18.17 MB/sec execute 31 sec latency 73.384 ms 2020-11-20T12:03:52.891 INFO:tasks.ceph.mds.b.smithi146.stderr:2020-11-20T12:03:52.887+0000 7fe493b15700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 26053) UID: 0 2020-11-20T12:03:53.725 INFO:tasks.workunit.client.0.smithi192.stdout: 10 46642 17.69 MB/sec execute 32 sec latency 77.555 ms 2020-11-20T12:03:54.728 INFO:tasks.workunit.client.0.smithi192.stdout: 10 46808 17.23 MB/sec execute 33 sec latency 137.104 ms 2020-11-20T12:03:55.725 INFO:tasks.workunit.client.0.smithi192.stdout: 10 47039 16.92 MB/sec execute 34 sec latency 88.925 ms 2020-11-20T12:03:56.726 INFO:tasks.workunit.client.0.smithi192.stdout: 10 47365 16.97 MB/sec execute 35 sec latency 115.623 ms 2020-11-20T12:03:57.725 INFO:tasks.workunit.client.0.smithi192.stdout: 10 47931 17.20 MB/sec execute 36 sec latency 69.482 ms 2020-11-20T12:03:58.725 INFO:tasks.workunit.client.0.smithi192.stdout: 10 48422 17.12 MB/sec execute 37 sec latency 103.368 ms 2020-11-20T12:03:59.726 INFO:tasks.workunit.client.0.smithi192.stdout: 10 48897 17.63 MB/sec execute 38 sec latency 140.585 ms 2020-11-20T12:04:00.725 INFO:tasks.workunit.client.0.smithi192.stdout: 10 49371 18.19 MB/sec execute 39 sec latency 62.261 ms 2020-11-20T12:04:01.725 INFO:tasks.workunit.client.0.smithi192.stdout: 10 49690 18.30 MB/sec execute 40 sec latency 184.200 ms 2020-11-20T12:04:02.726 INFO:tasks.workunit.client.0.smithi192.stdout: 10 49911 18.30 MB/sec execute 41 sec latency 82.724 ms 2020-11-20T12:04:03.726 INFO:tasks.workunit.client.0.smithi192.stdout: 10 50084 18.00 MB/sec execute 42 sec latency 98.583 ms 2020-11-20T12:04:04.726 INFO:tasks.workunit.client.0.smithi192.stdout: 10 50271 17.64 MB/sec execute 43 sec latency 65.626 ms 2020-11-20T12:04:05.726 INFO:tasks.workunit.client.0.smithi192.stdout: 10 50480 17.36 MB/sec execute 44 sec latency 90.564 ms 2020-11-20T12:04:06.731 INFO:tasks.workunit.client.0.smithi192.stdout: 10 50814 17.35 MB/sec execute 45 sec latency 106.099 ms 2020-11-20T12:04:07.726 INFO:tasks.workunit.client.0.smithi192.stdout: 10 51299 17.36 MB/sec execute 46 sec latency 78.610 ms 2020-11-20T12:04:08.726 INFO:tasks.workunit.client.0.smithi192.stdout: 10 51858 17.57 MB/sec execute 47 sec latency 95.778 ms 2020-11-20T12:04:09.726 INFO:tasks.workunit.client.0.smithi192.stdout: 10 52259 17.67 MB/sec execute 48 sec latency 297.409 ms 2020-11-20T12:04:10.726 INFO:tasks.workunit.client.0.smithi192.stdout: 10 52262 17.31 MB/sec execute 49 sec latency 1279.831 ms 2020-11-20T12:04:11.726 INFO:tasks.workunit.client.0.smithi192.stdout: 10 52264 16.96 MB/sec execute 50 sec latency 2279.863 ms 2020-11-20T12:04:12.726 INFO:tasks.workunit.client.0.smithi192.stdout: 10 52265 16.63 MB/sec execute 51 sec latency 3268.597 ms 2020-11-20T12:04:13.726 INFO:tasks.workunit.client.0.smithi192.stdout: 10 52284 16.31 MB/sec execute 52 sec latency 4083.984 ms 2020-11-20T12:04:14.726 INFO:tasks.workunit.client.0.smithi192.stdout: 10 52625 16.47 MB/sec execute 53 sec latency 243.464 ms 2020-11-20T12:04:15.726 INFO:tasks.workunit.client.0.smithi192.stdout: 10 52983 16.77 MB/sec execute 54 sec latency 83.555 ms 2020-11-20T12:04:16.726 INFO:tasks.workunit.client.0.smithi192.stdout: 10 53292 16.87 MB/sec execute 55 sec latency 86.462 ms 2020-11-20T12:04:17.726 INFO:tasks.workunit.client.0.smithi192.stdout: 10 53506 16.86 MB/sec execute 56 sec latency 80.680 ms 2020-11-20T12:04:18.726 INFO:tasks.workunit.client.0.smithi192.stdout: 10 53657 16.62 MB/sec execute 57 sec latency 72.703 ms 2020-11-20T12:04:19.726 INFO:tasks.workunit.client.0.smithi192.stdout: 10 53798 16.37 MB/sec execute 58 sec latency 148.948 ms 2020-11-20T12:04:20.726 INFO:tasks.workunit.client.0.smithi192.stdout: 10 53969 16.15 MB/sec execute 59 sec latency 107.947 ms 2020-11-20T12:04:21.726 INFO:tasks.workunit.client.0.smithi192.stdout: 10 54182 16.03 MB/sec execute 60 sec latency 112.905 ms 2020-11-20T12:04:22.726 INFO:tasks.workunit.client.0.smithi192.stdout: 10 54427 15.95 MB/sec execute 61 sec latency 174.137 ms 2020-11-20T12:04:23.726 INFO:tasks.workunit.client.0.smithi192.stdout: 10 54758 15.95 MB/sec execute 62 sec latency 187.521 ms 2020-11-20T12:04:24.726 INFO:tasks.workunit.client.0.smithi192.stdout: 10 55296 16.09 MB/sec execute 63 sec latency 81.596 ms 2020-11-20T12:04:25.726 INFO:tasks.workunit.client.0.smithi192.stdout: 10 55778 16.15 MB/sec execute 64 sec latency 81.714 ms 2020-11-20T12:04:26.726 INFO:tasks.workunit.client.0.smithi192.stdout: 10 56139 16.31 MB/sec execute 65 sec latency 78.882 ms 2020-11-20T12:04:27.726 INFO:tasks.workunit.client.0.smithi192.stdout: 10 56557 16.66 MB/sec execute 66 sec latency 76.635 ms 2020-11-20T12:04:28.726 INFO:tasks.workunit.client.0.smithi192.stdout: 10 56855 16.79 MB/sec execute 67 sec latency 91.624 ms 2020-11-20T12:04:29.726 INFO:tasks.workunit.client.0.smithi192.stdout: 10 57056 16.70 MB/sec execute 68 sec latency 167.439 ms 2020-11-20T12:04:30.727 INFO:tasks.workunit.client.0.smithi192.stdout: 10 57101 16.48 MB/sec execute 69 sec latency 829.254 ms 2020-11-20T12:04:31.727 INFO:tasks.workunit.client.0.smithi192.stdout: 10 57106 16.24 MB/sec execute 70 sec latency 1583.086 ms 2020-11-20T12:04:32.727 INFO:tasks.workunit.client.0.smithi192.stdout: 10 57256 16.05 MB/sec execute 71 sec latency 195.009 ms 2020-11-20T12:04:33.727 INFO:tasks.workunit.client.0.smithi192.stdout: 10 57403 15.85 MB/sec execute 72 sec latency 95.766 ms 2020-11-20T12:04:34.727 INFO:tasks.workunit.client.0.smithi192.stdout: 10 57586 15.69 MB/sec execute 73 sec latency 99.382 ms 2020-11-20T12:04:35.727 INFO:tasks.workunit.client.0.smithi192.stdout: 10 57798 15.62 MB/sec execute 74 sec latency 130.798 ms 2020-11-20T12:04:36.727 INFO:tasks.workunit.client.0.smithi192.stdout: 10 58047 15.62 MB/sec execute 75 sec latency 151.574 ms 2020-11-20T12:04:37.727 INFO:tasks.workunit.client.0.smithi192.stdout: 10 58528 15.68 MB/sec execute 76 sec latency 70.396 ms 2020-11-20T12:04:38.727 INFO:tasks.workunit.client.0.smithi192.stdout: 10 59073 15.72 MB/sec execute 77 sec latency 87.965 ms 2020-11-20T12:04:39.727 INFO:tasks.workunit.client.0.smithi192.stdout: 10 59504 15.90 MB/sec execute 78 sec latency 122.015 ms 2020-11-20T12:04:40.727 INFO:tasks.workunit.client.0.smithi192.stdout: 10 59956 16.16 MB/sec execute 79 sec latency 159.010 ms 2020-11-20T12:04:41.727 INFO:tasks.workunit.client.0.smithi192.stdout: 10 60337 16.33 MB/sec execute 80 sec latency 77.526 ms 2020-11-20T12:04:42.727 INFO:tasks.workunit.client.0.smithi192.stdout: 10 60598 16.38 MB/sec execute 81 sec latency 74.743 ms 2020-11-20T12:04:43.727 INFO:tasks.workunit.client.0.smithi192.stdout: 10 60775 16.23 MB/sec execute 82 sec latency 61.525 ms 2020-11-20T12:04:44.728 INFO:tasks.workunit.client.0.smithi192.stdout: 10 60967 16.07 MB/sec execute 83 sec latency 69.458 ms 2020-11-20T12:04:45.727 INFO:tasks.workunit.client.0.smithi192.stdout: 10 61163 15.92 MB/sec execute 84 sec latency 161.718 ms 2020-11-20T12:04:46.727 INFO:tasks.workunit.client.0.smithi192.stdout: 10 61381 15.85 MB/sec execute 85 sec latency 126.549 ms 2020-11-20T12:04:47.727 INFO:tasks.workunit.client.0.smithi192.stdout: 10 61827 15.94 MB/sec execute 86 sec latency 77.169 ms 2020-11-20T12:04:48.727 INFO:tasks.workunit.client.0.smithi192.stdout: 10 62432 16.04 MB/sec execute 87 sec latency 87.006 ms 2020-11-20T12:04:49.727 INFO:tasks.workunit.client.0.smithi192.stdout: 10 62861 16.03 MB/sec execute 88 sec latency 180.031 ms 2020-11-20T12:04:50.727 INFO:tasks.workunit.client.0.smithi192.stdout: 10 63262 16.31 MB/sec execute 89 sec latency 164.782 ms 2020-11-20T12:04:51.727 INFO:tasks.workunit.client.0.smithi192.stdout: 10 63619 16.39 MB/sec execute 90 sec latency 95.306 ms 2020-11-20T12:04:52.727 INFO:tasks.workunit.client.0.smithi192.stdout: 10 64026 16.63 MB/sec execute 91 sec latency 71.510 ms 2020-11-20T12:04:53.727 INFO:tasks.workunit.client.0.smithi192.stdout: 10 64199 16.52 MB/sec execute 92 sec latency 70.329 ms 2020-11-20T12:04:54.727 INFO:tasks.workunit.client.0.smithi192.stdout: 10 64349 16.37 MB/sec execute 93 sec latency 69.911 ms 2020-11-20T12:04:55.728 INFO:tasks.workunit.client.0.smithi192.stdout: 10 64512 16.22 MB/sec execute 94 sec latency 233.584 ms 2020-11-20T12:04:56.727 INFO:tasks.workunit.client.0.smithi192.stdout: 10 64518 16.05 MB/sec execute 95 sec latency 1040.015 ms 2020-11-20T12:04:57.727 INFO:tasks.workunit.client.0.smithi192.stdout: 10 64532 15.89 MB/sec execute 96 sec latency 1719.570 ms 2020-11-20T12:04:58.727 INFO:tasks.workunit.client.0.smithi192.stdout: 10 64639 15.76 MB/sec execute 97 sec latency 937.366 ms 2020-11-20T12:04:59.728 INFO:tasks.workunit.client.0.smithi192.stdout: 10 64790 15.64 MB/sec execute 98 sec latency 190.324 ms 2020-11-20T12:05:00.728 INFO:tasks.workunit.client.0.smithi192.stdout: 10 65046 15.60 MB/sec execute 99 sec latency 113.788 ms 2020-11-20T12:05:01.728 INFO:tasks.workunit.client.0.smithi192.stdout: 10 65329 15.61 MB/sec execute 100 sec latency 134.570 ms 2020-11-20T12:05:02.728 INFO:tasks.workunit.client.0.smithi192.stdout: 10 65695 15.66 MB/sec execute 101 sec latency 187.809 ms 2020-11-20T12:05:03.728 INFO:tasks.workunit.client.0.smithi192.stdout: 10 66200 15.61 MB/sec execute 102 sec latency 129.085 ms 2020-11-20T12:05:04.728 INFO:tasks.workunit.client.0.smithi192.stdout: 10 66505 15.65 MB/sec execute 103 sec latency 87.983 ms 2020-11-20T12:05:05.728 INFO:tasks.workunit.client.0.smithi192.stdout: 10 66819 15.82 MB/sec execute 104 sec latency 76.268 ms 2020-11-20T12:05:06.728 INFO:tasks.workunit.client.0.smithi192.stdout: 10 67259 15.95 MB/sec execute 105 sec latency 68.088 ms 2020-11-20T12:05:07.728 INFO:tasks.workunit.client.0.smithi192.stdout: 10 67568 16.07 MB/sec execute 106 sec latency 104.178 ms 2020-11-20T12:05:08.728 INFO:tasks.workunit.client.0.smithi192.stdout: 10 67767 16.00 MB/sec execute 107 sec latency 98.691 ms 2020-11-20T12:05:09.728 INFO:tasks.workunit.client.0.smithi192.stdout: 10 67945 15.88 MB/sec execute 108 sec latency 107.592 ms 2020-11-20T12:05:10.728 INFO:tasks.workunit.client.0.smithi192.stdout: 10 68135 15.78 MB/sec execute 109 sec latency 90.587 ms 2020-11-20T12:05:11.731 INFO:tasks.workunit.client.0.smithi192.stdout: 10 68190 15.64 MB/sec execute 110 sec latency 842.939 ms 2020-11-20T12:05:12.731 INFO:tasks.workunit.client.0.smithi192.stdout: 10 68262 15.52 MB/sec execute 111 sec latency 1484.320 ms 2020-11-20T12:05:13.733 INFO:tasks.workunit.client.0.smithi192.stdout: 10 68474 15.45 MB/sec execute 112 sec latency 135.227 ms 2020-11-20T12:05:14.732 INFO:tasks.workunit.client.0.smithi192.stdout: 10 68761 15.42 MB/sec execute 113 sec latency 103.417 ms 2020-11-20T12:05:15.732 INFO:tasks.workunit.client.0.smithi192.stdout: 10 69234 15.55 MB/sec execute 114 sec latency 85.089 ms 2020-11-20T12:05:16.732 INFO:tasks.workunit.client.0.smithi192.stdout: 10 69877 15.59 MB/sec execute 115 sec latency 73.652 ms 2020-11-20T12:05:17.732 INFO:tasks.workunit.client.0.smithi192.stdout: 10 70341 15.75 MB/sec execute 116 sec latency 52.145 ms 2020-11-20T12:05:18.736 INFO:tasks.workunit.client.0.smithi192.stdout: 10 70708 15.90 MB/sec execute 117 sec latency 116.998 ms 2020-11-20T12:05:19.736 INFO:tasks.workunit.client.0.smithi192.stdout: 10 70893 15.87 MB/sec execute 118 sec latency 450.924 ms 2020-11-20T12:05:20.736 INFO:tasks.workunit.client.0.smithi192.stdout: 10 71202 15.95 MB/sec execute 119 sec latency 89.953 ms 2020-11-20T12:05:21.736 INFO:tasks.workunit.client.0.smithi192.stdout: 10 71366 15.86 MB/sec execute 120 sec latency 75.783 ms 2020-11-20T12:05:22.736 INFO:tasks.workunit.client.0.smithi192.stdout: 10 71566 15.76 MB/sec execute 121 sec latency 75.522 ms 2020-11-20T12:05:23.736 INFO:tasks.workunit.client.0.smithi192.stdout: 10 71754 15.68 MB/sec execute 122 sec latency 183.513 ms 2020-11-20T12:05:24.736 INFO:tasks.workunit.client.0.smithi192.stdout: 10 71855 15.57 MB/sec execute 123 sec latency 528.212 ms 2020-11-20T12:05:25.736 INFO:tasks.workunit.client.0.smithi192.stdout: 10 72097 15.52 MB/sec execute 124 sec latency 139.326 ms 2020-11-20T12:05:26.736 INFO:tasks.workunit.client.0.smithi192.stdout: 10 72651 15.64 MB/sec execute 125 sec latency 81.301 ms 2020-11-20T12:05:27.736 INFO:tasks.workunit.client.0.smithi192.stdout: 10 73307 15.68 MB/sec execute 126 sec latency 64.751 ms 2020-11-20T12:05:28.736 INFO:tasks.workunit.client.0.smithi192.stdout: 10 73799 15.83 MB/sec execute 127 sec latency 76.133 ms 2020-11-20T12:05:29.736 INFO:tasks.workunit.client.0.smithi192.stdout: 10 74102 15.93 MB/sec execute 128 sec latency 212.826 ms 2020-11-20T12:05:30.736 INFO:tasks.workunit.client.0.smithi192.stdout: 10 74525 16.04 MB/sec execute 129 sec latency 61.973 ms 2020-11-20T12:05:31.737 INFO:tasks.workunit.client.0.smithi192.stdout: 10 74744 16.06 MB/sec execute 130 sec latency 383.903 ms 2020-11-20T12:05:32.736 INFO:tasks.workunit.client.0.smithi192.stdout: 10 74748 15.93 MB/sec execute 131 sec latency 1383.935 ms 2020-11-20T12:05:33.737 INFO:tasks.workunit.client.0.smithi192.stdout: 10 74750 15.81 MB/sec execute 132 sec latency 2177.046 ms 2020-11-20T12:05:34.737 INFO:tasks.workunit.client.0.smithi192.stdout: 10 74865 15.75 MB/sec execute 133 sec latency 2187.088 ms 2020-11-20T12:05:35.737 INFO:tasks.workunit.client.0.smithi192.stdout: 10 74990 15.64 MB/sec execute 134 sec latency 121.513 ms 2020-11-20T12:05:36.737 INFO:tasks.workunit.client.0.smithi192.stdout: 10 75145 15.55 MB/sec execute 135 sec latency 74.649 ms 2020-11-20T12:05:37.737 INFO:tasks.workunit.client.0.smithi192.stdout: 10 75335 15.48 MB/sec execute 136 sec latency 146.327 ms 2020-11-20T12:05:38.737 INFO:tasks.workunit.client.0.smithi192.stdout: 10 75507 15.40 MB/sec execute 137 sec latency 139.988 ms 2020-11-20T12:05:39.737 INFO:tasks.workunit.client.0.smithi192.stdout: 10 75675 15.33 MB/sec execute 138 sec latency 202.853 ms 2020-11-20T12:05:40.737 INFO:tasks.workunit.client.0.smithi192.stdout: 10 76017 15.34 MB/sec execute 139 sec latency 91.703 ms 2020-11-20T12:05:41.737 INFO:tasks.workunit.client.0.smithi192.stdout: 10 76394 15.39 MB/sec execute 140 sec latency 93.505 ms 2020-11-20T12:05:42.737 INFO:tasks.workunit.client.0.smithi192.stdout: 10 77063 15.45 MB/sec execute 141 sec latency 92.321 ms 2020-11-20T12:05:43.737 INFO:tasks.workunit.client.0.smithi192.stdout: 10 77516 15.59 MB/sec execute 142 sec latency 130.031 ms 2020-11-20T12:05:44.737 INFO:tasks.workunit.client.0.smithi192.stdout: 10 77979 15.74 MB/sec execute 143 sec latency 63.827 ms 2020-11-20T12:05:45.737 INFO:tasks.workunit.client.0.smithi192.stdout: 10 78263 15.82 MB/sec execute 144 sec latency 82.402 ms 2020-11-20T12:05:46.737 INFO:tasks.workunit.client.0.smithi192.stdout: 10 78465 15.76 MB/sec execute 145 sec latency 112.889 ms 2020-11-20T12:05:47.738 INFO:tasks.workunit.client.0.smithi192.stdout: 10 78477 15.66 MB/sec execute 146 sec latency 1028.465 ms 2020-11-20T12:05:48.737 INFO:tasks.workunit.client.0.smithi192.stdout: 10 78556 15.56 MB/sec execute 147 sec latency 1380.845 ms 2020-11-20T12:05:49.737 INFO:tasks.workunit.client.0.smithi192.stdout: 10 78689 15.47 MB/sec execute 148 sec latency 180.873 ms 2020-11-20T12:05:50.737 INFO:tasks.workunit.client.0.smithi192.stdout: 10 78892 15.40 MB/sec execute 149 sec latency 64.597 ms 2020-11-20T12:05:51.737 INFO:tasks.workunit.client.0.smithi192.stdout: 10 79114 15.36 MB/sec execute 150 sec latency 106.411 ms 2020-11-20T12:05:52.738 INFO:tasks.workunit.client.0.smithi192.stdout: 10 79398 15.34 MB/sec execute 151 sec latency 109.413 ms 2020-11-20T12:05:53.737 INFO:tasks.workunit.client.0.smithi192.stdout: 10 79991 15.45 MB/sec execute 152 sec latency 68.718 ms 2020-11-20T12:05:54.737 INFO:tasks.workunit.client.0.smithi192.stdout: 10 80707 15.55 MB/sec execute 153 sec latency 56.733 ms 2020-11-20T12:05:55.737 INFO:tasks.workunit.client.0.smithi192.stdout: 10 81052 15.60 MB/sec execute 154 sec latency 77.006 ms 2020-11-20T12:05:56.737 INFO:tasks.workunit.client.0.smithi192.stdout: 10 81400 15.72 MB/sec execute 155 sec latency 161.660 ms 2020-11-20T12:05:57.737 INFO:tasks.workunit.client.0.smithi192.stdout: 10 81797 15.82 MB/sec execute 156 sec latency 65.592 ms 2020-11-20T12:05:58.737 INFO:tasks.workunit.client.0.smithi192.stdout: 10 81995 15.78 MB/sec execute 157 sec latency 92.503 ms 2020-11-20T12:05:59.737 INFO:tasks.workunit.client.0.smithi192.stdout: 10 82131 15.69 MB/sec execute 158 sec latency 143.983 ms 2020-11-20T12:06:00.737 INFO:tasks.workunit.client.0.smithi192.stdout: 10 82304 15.62 MB/sec execute 159 sec latency 106.815 ms 2020-11-20T12:06:01.737 INFO:tasks.workunit.client.0.smithi192.stdout: 10 82528 15.58 MB/sec execute 160 sec latency 228.545 ms 2020-11-20T12:06:02.739 INFO:tasks.workunit.client.0.smithi192.stdout: 10 82637 15.50 MB/sec execute 161 sec latency 610.872 ms 2020-11-20T12:06:03.742 INFO:tasks.workunit.client.0.smithi192.stdout: 10 82654 15.40 MB/sec execute 162 sec latency 1423.001 ms 2020-11-20T12:06:04.739 INFO:tasks.workunit.client.0.smithi192.stdout: 10 82965 15.38 MB/sec execute 163 sec latency 696.579 ms 2020-11-20T12:06:05.739 INFO:tasks.workunit.client.0.smithi192.stdout: 10 83429 15.43 MB/sec execute 164 sec latency 71.240 ms 2020-11-20T12:06:06.739 INFO:tasks.workunit.client.0.smithi192.stdout: 10 83860 15.47 MB/sec execute 165 sec latency 64.721 ms 2020-11-20T12:06:07.739 INFO:tasks.workunit.client.0.smithi192.stdout: 10 84400 15.54 MB/sec execute 166 sec latency 65.681 ms 2020-11-20T12:06:08.739 INFO:tasks.workunit.client.0.smithi192.stdout: 10 84824 15.68 MB/sec execute 167 sec latency 70.899 ms 2020-11-20T12:06:09.739 INFO:tasks.workunit.client.0.smithi192.stdout: 10 85128 15.71 MB/sec execute 168 sec latency 113.634 ms 2020-11-20T12:06:10.739 INFO:tasks.workunit.client.0.smithi192.stdout: 10 85428 15.75 MB/sec execute 169 sec latency 78.261 ms 2020-11-20T12:06:11.739 INFO:tasks.workunit.client.0.smithi192.stdout: 10 85621 15.70 MB/sec execute 170 sec latency 60.822 ms 2020-11-20T12:06:12.739 INFO:tasks.workunit.client.0.smithi192.stdout: 10 85832 15.64 MB/sec execute 171 sec latency 66.297 ms 2020-11-20T12:06:13.739 INFO:tasks.workunit.client.0.smithi192.stdout: 10 86066 15.59 MB/sec execute 172 sec latency 122.953 ms 2020-11-20T12:06:14.739 INFO:tasks.workunit.client.0.smithi192.stdout: 10 86442 15.59 MB/sec execute 173 sec latency 99.246 ms 2020-11-20T12:06:15.739 INFO:tasks.workunit.client.0.smithi192.stdout: 10 86926 15.62 MB/sec execute 174 sec latency 65.409 ms 2020-11-20T12:06:16.739 INFO:tasks.workunit.client.0.smithi192.stdout: 10 87471 15.72 MB/sec execute 175 sec latency 63.492 ms 2020-11-20T12:06:17.739 INFO:tasks.workunit.client.0.smithi192.stdout: 10 87986 15.75 MB/sec execute 176 sec latency 78.921 ms 2020-11-20T12:06:18.740 INFO:tasks.workunit.client.0.smithi192.stdout: 10 88264 15.82 MB/sec execute 177 sec latency 251.808 ms 2020-11-20T12:06:19.740 INFO:tasks.workunit.client.0.smithi192.stdout: 10 88488 15.83 MB/sec execute 178 sec latency 204.100 ms 2020-11-20T12:06:20.740 INFO:tasks.workunit.client.0.smithi192.stdout: 10 88874 15.90 MB/sec execute 179 sec latency 56.236 ms 2020-11-20T12:06:21.740 INFO:tasks.workunit.client.0.smithi192.stdout: 10 89116 15.89 MB/sec execute 180 sec latency 101.277 ms 2020-11-20T12:06:22.740 INFO:tasks.workunit.client.0.smithi192.stdout: 10 89272 15.82 MB/sec execute 181 sec latency 205.982 ms 2020-11-20T12:06:23.740 INFO:tasks.workunit.client.0.smithi192.stdout: 10 89282 15.73 MB/sec execute 182 sec latency 1186.499 ms 2020-11-20T12:06:24.740 INFO:tasks.workunit.client.0.smithi192.stdout: 10 89288 15.65 MB/sec execute 183 sec latency 2006.973 ms 2020-11-20T12:06:25.740 INFO:tasks.workunit.client.0.smithi192.stdout: 10 89365 15.57 MB/sec execute 184 sec latency 1408.835 ms 2020-11-20T12:06:26.740 INFO:tasks.workunit.client.0.smithi192.stdout: 10 89588 15.52 MB/sec execute 185 sec latency 102.702 ms 2020-11-20T12:06:27.740 INFO:tasks.workunit.client.0.smithi192.stdout: 10 89832 15.49 MB/sec execute 186 sec latency 130.851 ms 2020-11-20T12:06:28.740 INFO:tasks.workunit.client.0.smithi192.stdout: 10 90083 15.45 MB/sec execute 187 sec latency 131.531 ms 2020-11-20T12:06:29.740 INFO:tasks.workunit.client.0.smithi192.stdout: 10 90355 15.44 MB/sec execute 188 sec latency 196.827 ms 2020-11-20T12:06:30.740 INFO:tasks.workunit.client.0.smithi192.stdout: 10 90644 15.47 MB/sec execute 189 sec latency 157.319 ms 2020-11-20T12:06:31.741 INFO:tasks.workunit.client.0.smithi192.stdout: 10 91011 15.46 MB/sec execute 190 sec latency 112.205 ms 2020-11-20T12:06:32.740 INFO:tasks.workunit.client.0.smithi192.stdout: 10 91502 15.51 MB/sec execute 191 sec latency 90.571 ms 2020-11-20T12:06:33.740 INFO:tasks.workunit.client.0.smithi192.stdout: 10 91949 15.64 MB/sec execute 192 sec latency 55.711 ms 2020-11-20T12:06:34.740 INFO:tasks.workunit.client.0.smithi192.stdout: 10 92288 15.69 MB/sec execute 193 sec latency 112.786 ms 2020-11-20T12:06:35.740 INFO:tasks.workunit.client.0.smithi192.stdout: 10 92555 15.71 MB/sec execute 194 sec latency 146.963 ms 2020-11-20T12:06:36.740 INFO:tasks.workunit.client.0.smithi192.stdout: 10 92754 15.66 MB/sec execute 195 sec latency 63.187 ms 2020-11-20T12:06:37.740 INFO:tasks.workunit.client.0.smithi192.stdout: 10 93004 15.62 MB/sec execute 196 sec latency 75.204 ms 2020-11-20T12:06:38.740 INFO:tasks.workunit.client.0.smithi192.stdout: 10 93290 15.58 MB/sec execute 197 sec latency 89.576 ms 2020-11-20T12:06:39.740 INFO:tasks.workunit.client.0.smithi192.stdout: 10 93540 15.56 MB/sec execute 198 sec latency 219.895 ms 2020-11-20T12:06:40.741 INFO:tasks.workunit.client.0.smithi192.stdout: 10 93949 15.58 MB/sec execute 199 sec latency 208.618 ms 2020-11-20T12:06:41.741 INFO:tasks.workunit.client.0.smithi192.stdout: 10 94437 15.61 MB/sec execute 200 sec latency 126.588 ms 2020-11-20T12:06:42.741 INFO:tasks.workunit.client.0.smithi192.stdout: 10 94994 15.68 MB/sec execute 201 sec latency 75.956 ms 2020-11-20T12:06:43.741 INFO:tasks.workunit.client.0.smithi192.stdout: 10 95113 15.64 MB/sec execute 202 sec latency 679.762 ms 2020-11-20T12:06:44.741 INFO:tasks.workunit.client.0.smithi192.stdout: 10 95118 15.57 MB/sec execute 203 sec latency 1641.521 ms 2020-11-20T12:06:45.741 INFO:tasks.workunit.client.0.smithi192.stdout: 10 95198 15.51 MB/sec execute 204 sec latency 2229.014 ms 2020-11-20T12:06:46.741 INFO:tasks.workunit.client.0.smithi192.stdout: 10 95534 15.60 MB/sec execute 205 sec latency 82.289 ms 2020-11-20T12:06:47.741 INFO:tasks.workunit.client.0.smithi192.stdout: 10 95832 15.61 MB/sec execute 206 sec latency 87.059 ms 2020-11-20T12:06:48.741 INFO:tasks.workunit.client.0.smithi192.stdout: 10 96085 15.64 MB/sec execute 207 sec latency 84.393 ms 2020-11-20T12:06:49.741 INFO:tasks.workunit.client.0.smithi192.stdout: 10 96213 15.59 MB/sec execute 208 sec latency 173.361 ms 2020-11-20T12:06:50.741 INFO:tasks.workunit.client.0.smithi192.stdout: 10 96392 15.54 MB/sec execute 209 sec latency 74.970 ms 2020-11-20T12:06:51.741 INFO:tasks.workunit.client.0.smithi192.stdout: 10 96608 15.48 MB/sec execute 210 sec latency 99.866 ms 2020-11-20T12:06:52.741 INFO:tasks.workunit.client.0.smithi192.stdout: 10 96826 15.44 MB/sec execute 211 sec latency 165.597 ms 2020-11-20T12:06:53.741 INFO:tasks.workunit.client.0.smithi192.stdout: 10 97134 15.44 MB/sec execute 212 sec latency 76.779 ms 2020-11-20T12:06:54.741 INFO:tasks.workunit.client.0.smithi192.stdout: 10 97664 15.50 MB/sec execute 213 sec latency 94.830 ms 2020-11-20T12:06:55.741 INFO:tasks.workunit.client.0.smithi192.stdout: 10 98281 15.56 MB/sec execute 214 sec latency 72.528 ms 2020-11-20T12:06:56.741 INFO:tasks.workunit.client.0.smithi192.stdout: 10 98757 15.62 MB/sec execute 215 sec latency 53.456 ms 2020-11-20T12:06:57.741 INFO:tasks.workunit.client.0.smithi192.stdout: 10 99065 15.68 MB/sec execute 216 sec latency 145.807 ms 2020-11-20T12:06:58.741 INFO:tasks.workunit.client.0.smithi192.stdout: 10 99343 15.69 MB/sec execute 217 sec latency 369.144 ms 2020-11-20T12:06:59.741 INFO:tasks.workunit.client.0.smithi192.stdout: 10 99354 15.62 MB/sec execute 218 sec latency 1356.387 ms 2020-11-20T12:07:00.742 INFO:tasks.workunit.client.0.smithi192.stdout: 10 99568 15.62 MB/sec execute 219 sec latency 1693.279 ms 2020-11-20T12:07:01.742 INFO:tasks.workunit.client.0.smithi192.stdout: 10 99758 15.61 MB/sec execute 220 sec latency 107.682 ms 2020-11-20T12:07:02.741 INFO:tasks.workunit.client.0.smithi192.stdout: 10 99909 15.55 MB/sec execute 221 sec latency 89.697 ms 2020-11-20T12:07:03.741 INFO:tasks.workunit.client.0.smithi192.stdout: 10 100106 15.51 MB/sec execute 222 sec latency 79.524 ms 2020-11-20T12:07:04.741 INFO:tasks.workunit.client.0.smithi192.stdout: 10 100406 15.47 MB/sec execute 223 sec latency 109.855 ms 2020-11-20T12:07:05.741 INFO:tasks.workunit.client.0.smithi192.stdout: 10 100675 15.46 MB/sec execute 224 sec latency 84.962 ms 2020-11-20T12:07:06.742 INFO:tasks.workunit.client.0.smithi192.stdout: 10 101203 15.52 MB/sec execute 225 sec latency 97.386 ms 2020-11-20T12:07:07.742 INFO:tasks.workunit.client.0.smithi192.stdout: 10 101865 15.59 MB/sec execute 226 sec latency 63.824 ms 2020-11-20T12:07:08.742 INFO:tasks.workunit.client.0.smithi192.stdout: 10 102340 15.65 MB/sec execute 227 sec latency 50.564 ms 2020-11-20T12:07:09.742 INFO:tasks.workunit.client.0.smithi192.stdout: 10 102743 15.74 MB/sec execute 228 sec latency 127.652 ms 2020-11-20T12:07:10.742 INFO:tasks.workunit.client.0.smithi192.stdout: 10 103113 15.80 MB/sec execute 229 sec latency 65.634 ms 2020-11-20T12:07:11.742 INFO:tasks.workunit.client.0.smithi192.stdout: 10 103330 15.77 MB/sec execute 230 sec latency 72.571 ms 2020-11-20T12:07:12.742 INFO:tasks.workunit.client.0.smithi192.stdout: 10 103553 15.72 MB/sec execute 231 sec latency 73.905 ms 2020-11-20T12:07:13.742 INFO:tasks.workunit.client.0.smithi192.stdout: 10 103841 15.68 MB/sec execute 232 sec latency 80.500 ms 2020-11-20T12:07:14.742 INFO:tasks.workunit.client.0.smithi192.stdout: 10 104016 15.65 MB/sec execute 233 sec latency 277.350 ms 2020-11-20T12:07:15.742 INFO:tasks.workunit.client.0.smithi192.stdout: 10 104276 15.65 MB/sec execute 234 sec latency 114.008 ms 2020-11-20T12:07:16.742 INFO:tasks.workunit.client.0.smithi192.stdout: 10 104728 15.65 MB/sec execute 235 sec latency 80.603 ms 2020-11-20T12:07:17.742 INFO:tasks.workunit.client.0.smithi192.stdout: 10 105254 15.72 MB/sec execute 236 sec latency 67.564 ms 2020-11-20T12:07:18.742 INFO:tasks.workunit.client.0.smithi192.stdout: 10 105764 15.76 MB/sec execute 237 sec latency 69.899 ms 2020-11-20T12:07:19.742 INFO:tasks.workunit.client.0.smithi192.stdout: 10 105974 15.76 MB/sec execute 238 sec latency 257.472 ms 2020-11-20T12:07:20.742 INFO:tasks.workunit.client.0.smithi192.stdout: 10 106442 15.85 MB/sec execute 239 sec latency 83.064 ms 2020-11-20T12:07:21.742 INFO:tasks.workunit.client.0.smithi192.stdout: 10 106763 15.88 MB/sec execute 240 sec latency 64.620 ms 2020-11-20T12:07:22.742 INFO:tasks.workunit.client.0.smithi192.stdout: 10 106973 15.86 MB/sec execute 241 sec latency 58.749 ms 2020-11-20T12:07:23.742 INFO:tasks.workunit.client.0.smithi192.stdout: 10 107234 15.81 MB/sec execute 242 sec latency 59.852 ms 2020-11-20T12:07:24.742 INFO:tasks.workunit.client.0.smithi192.stdout: 10 107341 15.76 MB/sec execute 243 sec latency 728.230 ms 2020-11-20T12:07:25.742 INFO:tasks.workunit.client.0.smithi192.stdout: 10 107341 15.69 MB/sec execute 244 sec latency 1490.086 ms 2020-11-20T12:07:26.742 INFO:tasks.workunit.client.0.smithi192.stdout: 10 107346 15.63 MB/sec execute 245 sec latency 2460.044 ms 2020-11-20T12:07:27.743 INFO:tasks.workunit.client.0.smithi192.stdout: 10 107454 15.57 MB/sec execute 246 sec latency 2172.214 ms 2020-11-20T12:07:28.742 INFO:tasks.workunit.client.0.smithi192.stdout: 10 107605 15.55 MB/sec execute 247 sec latency 213.521 ms 2020-11-20T12:07:29.743 INFO:tasks.workunit.client.0.smithi192.stdout: 10 107735 15.50 MB/sec execute 248 sec latency 245.198 ms 2020-11-20T12:07:30.742 INFO:tasks.workunit.client.0.smithi192.stdout: 10 108063 15.52 MB/sec execute 249 sec latency 165.865 ms 2020-11-20T12:07:31.742 INFO:tasks.workunit.client.0.smithi192.stdout: 10 108328 15.51 MB/sec execute 250 sec latency 119.634 ms 2020-11-20T12:07:32.742 INFO:tasks.workunit.client.0.smithi192.stdout: 10 108636 15.50 MB/sec execute 251 sec latency 175.854 ms 2020-11-20T12:07:33.742 INFO:tasks.workunit.client.0.smithi192.stdout: 10 109004 15.50 MB/sec execute 252 sec latency 209.194 ms 2020-11-20T12:07:34.742 INFO:tasks.workunit.client.0.smithi192.stdout: 10 109348 15.53 MB/sec execute 253 sec latency 92.220 ms 2020-11-20T12:07:35.742 INFO:tasks.workunit.client.0.smithi192.stdout: 10 109763 15.61 MB/sec execute 254 sec latency 74.362 ms 2020-11-20T12:07:36.742 INFO:tasks.workunit.client.0.smithi192.stdout: 10 110101 15.63 MB/sec execute 255 sec latency 71.213 ms 2020-11-20T12:07:37.742 INFO:tasks.workunit.client.0.smithi192.stdout: 10 110343 15.64 MB/sec execute 256 sec latency 78.282 ms 2020-11-20T12:07:38.743 INFO:tasks.workunit.client.0.smithi192.stdout: 10 110573 15.62 MB/sec execute 257 sec latency 89.270 ms 2020-11-20T12:07:39.743 INFO:tasks.workunit.client.0.smithi192.stdout: 10 110762 15.57 MB/sec execute 258 sec latency 107.953 ms 2020-11-20T12:07:40.743 INFO:tasks.workunit.client.0.smithi192.stdout: 10 111051 15.55 MB/sec execute 259 sec latency 83.364 ms 2020-11-20T12:07:41.743 INFO:tasks.workunit.client.0.smithi192.stdout: 10 111316 15.53 MB/sec execute 260 sec latency 230.813 ms 2020-11-20T12:07:42.743 INFO:tasks.workunit.client.0.smithi192.stdout: 10 111784 15.55 MB/sec execute 261 sec latency 80.823 ms 2020-11-20T12:07:43.744 INFO:tasks.workunit.client.0.smithi192.stdout: 10 112379 15.63 MB/sec execute 262 sec latency 60.386 ms 2020-11-20T12:07:44.743 INFO:tasks.workunit.client.0.smithi192.stdout: 10 112761 15.62 MB/sec execute 263 sec latency 193.646 ms 2020-11-20T12:07:45.743 INFO:tasks.workunit.client.0.smithi192.stdout: 10 112797 15.58 MB/sec execute 264 sec latency 1163.795 ms 2020-11-20T12:07:46.743 INFO:tasks.workunit.client.0.smithi192.stdout: 10 112844 15.54 MB/sec execute 265 sec latency 1805.562 ms 2020-11-20T12:07:47.743 INFO:tasks.workunit.client.0.smithi192.stdout: 10 113168 15.58 MB/sec execute 266 sec latency 76.303 ms 2020-11-20T12:07:48.743 INFO:tasks.workunit.client.0.smithi192.stdout: 10 113485 15.62 MB/sec execute 267 sec latency 78.513 ms 2020-11-20T12:07:49.743 INFO:tasks.workunit.client.0.smithi192.stdout: 10 113723 15.62 MB/sec execute 268 sec latency 142.340 ms 2020-11-20T12:07:50.744 INFO:tasks.workunit.client.0.smithi192.stdout: 10 113937 15.60 MB/sec execute 269 sec latency 65.516 ms 2020-11-20T12:07:51.743 INFO:tasks.workunit.client.0.smithi192.stdout: 10 114113 15.57 MB/sec execute 270 sec latency 81.163 ms 2020-11-20T12:07:52.743 INFO:tasks.workunit.client.0.smithi192.stdout: 10 114303 15.53 MB/sec execute 271 sec latency 96.799 ms 2020-11-20T12:07:53.744 INFO:tasks.workunit.client.0.smithi192.stdout: 10 114575 15.51 MB/sec execute 272 sec latency 163.642 ms 2020-11-20T12:07:54.743 INFO:tasks.workunit.client.0.smithi192.stdout: 10 114879 15.49 MB/sec execute 273 sec latency 92.504 ms 2020-11-20T12:07:55.743 INFO:tasks.workunit.client.0.smithi192.stdout: 10 115397 15.54 MB/sec execute 274 sec latency 67.178 ms 2020-11-20T12:07:56.743 INFO:tasks.workunit.client.0.smithi192.stdout: 10 115989 15.59 MB/sec execute 275 sec latency 63.433 ms 2020-11-20T12:07:57.743 INFO:tasks.workunit.client.0.smithi192.stdout: 10 116451 15.61 MB/sec execute 276 sec latency 68.709 ms 2020-11-20T12:07:58.743 INFO:tasks.workunit.client.0.smithi192.stdout: 10 116762 15.66 MB/sec execute 277 sec latency 228.080 ms 2020-11-20T12:07:59.743 INFO:tasks.workunit.client.0.smithi192.stdout: 10 117158 15.72 MB/sec execute 278 sec latency 102.054 ms 2020-11-20T12:08:00.743 INFO:tasks.workunit.client.0.smithi192.stdout: 10 117420 15.73 MB/sec execute 279 sec latency 142.773 ms 2020-11-20T12:08:01.743 INFO:tasks.workunit.client.0.smithi192.stdout: 10 117611 15.69 MB/sec execute 280 sec latency 69.147 ms 2020-11-20T12:08:02.744 INFO:tasks.workunit.client.0.smithi192.stdout: 10 117802 15.65 MB/sec execute 281 sec latency 87.802 ms 2020-11-20T12:08:03.743 INFO:tasks.workunit.client.0.smithi192.stdout: 10 118019 15.62 MB/sec execute 282 sec latency 174.541 ms 2020-11-20T12:08:04.743 INFO:tasks.workunit.client.0.smithi192.stdout: 10 118290 15.61 MB/sec execute 283 sec latency 99.871 ms 2020-11-20T12:08:05.743 INFO:tasks.workunit.client.0.smithi192.stdout: 10 118362 15.56 MB/sec execute 284 sec latency 790.397 ms 2020-11-20T12:08:06.743 INFO:tasks.workunit.client.0.smithi192.stdout: 10 118372 15.51 MB/sec execute 285 sec latency 1790.433 ms 2020-11-20T12:08:07.744 INFO:tasks.workunit.client.0.smithi192.stdout: 10 118667 15.50 MB/sec execute 286 sec latency 2047.808 ms 2020-11-20T12:08:08.744 INFO:tasks.workunit.client.0.smithi192.stdout: 10 119084 15.52 MB/sec execute 287 sec latency 110.113 ms 2020-11-20T12:08:09.744 INFO:tasks.workunit.client.0.smithi192.stdout: 10 119429 15.53 MB/sec execute 288 sec latency 160.227 ms 2020-11-20T12:08:10.744 INFO:tasks.workunit.client.0.smithi192.stdout: 10 119898 15.56 MB/sec execute 289 sec latency 67.630 ms 2020-11-20T12:08:11.744 INFO:tasks.workunit.client.0.smithi192.stdout: 10 120206 15.59 MB/sec execute 290 sec latency 75.161 ms 2020-11-20T12:08:12.744 INFO:tasks.workunit.client.0.smithi192.stdout: 10 120562 15.64 MB/sec execute 291 sec latency 84.543 ms 2020-11-20T12:08:13.744 INFO:tasks.workunit.client.0.smithi192.stdout: 10 120835 15.66 MB/sec execute 292 sec latency 104.025 ms 2020-11-20T12:08:14.744 INFO:tasks.workunit.client.0.smithi192.stdout: 10 121025 15.63 MB/sec execute 293 sec latency 146.180 ms 2020-11-20T12:08:15.744 INFO:tasks.workunit.client.0.smithi192.stdout: 10 121188 15.59 MB/sec execute 294 sec latency 173.984 ms 2020-11-20T12:08:16.744 INFO:tasks.workunit.client.0.smithi192.stdout: 10 121446 15.57 MB/sec execute 295 sec latency 81.424 ms 2020-11-20T12:08:17.744 INFO:tasks.workunit.client.0.smithi192.stdout: 10 121811 15.56 MB/sec execute 296 sec latency 58.129 ms 2020-11-20T12:08:18.747 INFO:tasks.workunit.client.0.smithi192.stdout: 10 122220 15.57 MB/sec execute 297 sec latency 96.473 ms 2020-11-20T12:08:19.744 INFO:tasks.workunit.client.0.smithi192.stdout: 10 122686 15.59 MB/sec execute 298 sec latency 134.934 ms 2020-11-20T12:08:20.744 INFO:tasks.workunit.client.0.smithi192.stdout: 10 123146 15.63 MB/sec execute 299 sec latency 80.707 ms 2020-11-20T12:08:21.744 INFO:tasks.workunit.client.0.smithi192.stdout: 10 123683 15.69 MB/sec execute 300 sec latency 68.859 ms 2020-11-20T12:08:22.744 INFO:tasks.workunit.client.0.smithi192.stdout: 10 124108 15.76 MB/sec execute 301 sec latency 63.168 ms 2020-11-20T12:08:23.744 INFO:tasks.workunit.client.0.smithi192.stdout: 10 124433 15.78 MB/sec execute 302 sec latency 65.681 ms 2020-11-20T12:08:24.744 INFO:tasks.workunit.client.0.smithi192.stdout: 10 124660 15.76 MB/sec execute 303 sec latency 68.051 ms 2020-11-20T12:08:25.744 INFO:tasks.workunit.client.0.smithi192.stdout: 10 124819 15.72 MB/sec execute 304 sec latency 334.673 ms 2020-11-20T12:08:26.744 INFO:tasks.workunit.client.0.smithi192.stdout: 10 124830 15.67 MB/sec execute 305 sec latency 950.992 ms 2020-11-20T12:08:27.745 INFO:tasks.workunit.client.0.smithi192.stdout: 10 124838 15.62 MB/sec execute 306 sec latency 1913.285 ms 2020-11-20T12:08:28.745 INFO:tasks.workunit.client.0.smithi192.stdout: 10 124954 15.58 MB/sec execute 307 sec latency 751.181 ms 2020-11-20T12:08:29.744 INFO:tasks.workunit.client.0.smithi192.stdout: 10 125079 15.54 MB/sec execute 308 sec latency 230.973 ms 2020-11-20T12:08:30.744 INFO:tasks.workunit.client.0.smithi192.stdout: 10 125296 15.52 MB/sec execute 309 sec latency 134.027 ms 2020-11-20T12:08:31.745 INFO:tasks.workunit.client.0.smithi192.stdout: 10 125487 15.49 MB/sec execute 310 sec latency 131.830 ms 2020-11-20T12:08:32.745 INFO:tasks.workunit.client.0.smithi192.stdout: 10 125775 15.49 MB/sec execute 311 sec latency 150.792 ms 2020-11-20T12:08:33.745 INFO:tasks.workunit.client.0.smithi192.stdout: 10 126103 15.48 MB/sec execute 312 sec latency 154.251 ms 2020-11-20T12:08:34.745 INFO:tasks.workunit.client.0.smithi192.stdout: 10 126519 15.52 MB/sec execute 313 sec latency 80.975 ms 2020-11-20T12:08:35.745 INFO:tasks.workunit.client.0.smithi192.stdout: 10 127081 15.56 MB/sec execute 314 sec latency 76.960 ms 2020-11-20T12:08:36.745 INFO:tasks.workunit.client.0.smithi192.stdout: 10 127496 15.63 MB/sec execute 315 sec latency 69.570 ms 2020-11-20T12:08:37.745 INFO:tasks.workunit.client.0.smithi192.stdout: 10 127797 15.63 MB/sec execute 316 sec latency 136.965 ms 2020-11-20T12:08:38.745 INFO:tasks.workunit.client.0.smithi192.stdout: 10 128068 15.64 MB/sec execute 317 sec latency 66.224 ms 2020-11-20T12:08:39.745 INFO:tasks.workunit.client.0.smithi192.stdout: 10 128252 15.62 MB/sec execute 318 sec latency 124.696 ms 2020-11-20T12:08:40.745 INFO:tasks.workunit.client.0.smithi192.stdout: 10 128519 15.59 MB/sec execute 319 sec latency 85.863 ms 2020-11-20T12:08:41.745 INFO:tasks.workunit.client.0.smithi192.stdout: 10 128888 15.59 MB/sec execute 320 sec latency 77.989 ms 2020-11-20T12:08:42.745 INFO:tasks.workunit.client.0.smithi192.stdout: 10 129132 15.56 MB/sec execute 321 sec latency 223.957 ms 2020-11-20T12:08:43.745 INFO:tasks.workunit.client.0.smithi192.stdout: 10 129603 15.59 MB/sec execute 322 sec latency 97.692 ms 2020-11-20T12:08:44.754 INFO:tasks.workunit.client.0.smithi192.stdout: 10 130128 15.64 MB/sec execute 323 sec latency 95.055 ms 2020-11-20T12:08:45.745 INFO:tasks.workunit.client.0.smithi192.stdout: 10 130693 15.69 MB/sec execute 324 sec latency 61.216 ms 2020-11-20T12:08:46.745 INFO:tasks.workunit.client.0.smithi192.stdout: 10 130757 15.66 MB/sec execute 325 sec latency 786.022 ms 2020-11-20T12:08:47.745 INFO:tasks.workunit.client.0.smithi192.stdout: 10 130776 15.61 MB/sec execute 326 sec latency 1782.291 ms 2020-11-20T12:08:48.745 INFO:tasks.workunit.client.0.smithi192.stdout: 10 130927 15.59 MB/sec execute 327 sec latency 2025.209 ms 2020-11-20T12:08:49.745 INFO:tasks.workunit.client.0.smithi192.stdout: 10 131172 15.62 MB/sec execute 328 sec latency 183.673 ms 2020-11-20T12:08:50.745 INFO:tasks.workunit.client.0.smithi192.stdout: 10 131446 15.61 MB/sec execute 329 sec latency 70.006 ms 2020-11-20T12:08:51.747 INFO:tasks.workunit.client.0.smithi192.stdout: 10 131668 15.61 MB/sec execute 330 sec latency 68.400 ms 2020-11-20T12:08:52.747 INFO:tasks.workunit.client.0.smithi192.stdout: 10 131853 15.59 MB/sec execute 331 sec latency 85.339 ms 2020-11-20T12:08:53.747 INFO:tasks.workunit.client.0.smithi192.stdout: 10 132075 15.56 MB/sec execute 332 sec latency 79.291 ms 2020-11-20T12:08:54.747 INFO:tasks.workunit.client.0.smithi192.stdout: 10 132348 15.55 MB/sec execute 333 sec latency 78.136 ms 2020-11-20T12:08:55.749 INFO:tasks.workunit.client.0.smithi192.stdout: 10 132700 15.54 MB/sec execute 334 sec latency 95.221 ms 2020-11-20T12:08:56.747 INFO:tasks.workunit.client.0.smithi192.stdout: 10 133101 15.55 MB/sec execute 335 sec latency 70.981 ms 2020-11-20T12:08:57.748 INFO:tasks.workunit.client.0.smithi192.stdout: 10 133772 15.62 MB/sec execute 336 sec latency 46.175 ms 2020-11-20T12:08:58.747 INFO:tasks.workunit.client.0.smithi192.stdout: 10 134297 15.66 MB/sec execute 337 sec latency 86.922 ms 2020-11-20T12:08:59.748 INFO:tasks.workunit.client.0.smithi192.stdout: 10 134528 15.67 MB/sec execute 338 sec latency 203.569 ms 2020-11-20T12:09:00.748 INFO:tasks.workunit.client.0.smithi192.stdout: 10 134865 15.70 MB/sec execute 339 sec latency 58.021 ms 2020-11-20T12:09:01.748 INFO:tasks.workunit.client.0.smithi192.stdout: 10 135038 15.68 MB/sec execute 340 sec latency 451.272 ms 2020-11-20T12:09:02.748 INFO:tasks.workunit.client.0.smithi192.stdout: 10 135044 15.63 MB/sec execute 341 sec latency 1451.304 ms 2020-11-20T12:09:03.748 INFO:tasks.workunit.client.0.smithi192.stdout: 10 135204 15.62 MB/sec execute 342 sec latency 1480.203 ms 2020-11-20T12:09:04.748 INFO:tasks.workunit.client.0.smithi192.stdout: 10 135380 15.60 MB/sec execute 343 sec latency 156.142 ms 2020-11-20T12:09:05.748 INFO:tasks.workunit.client.0.smithi192.stdout: 10 135586 15.57 MB/sec execute 344 sec latency 137.886 ms 2020-11-20T12:09:06.748 INFO:tasks.workunit.client.0.smithi192.stdout: 10 135880 15.56 MB/sec execute 345 sec latency 102.152 ms 2020-11-20T12:09:07.748 INFO:tasks.workunit.client.0.smithi192.stdout: 10 136194 15.54 MB/sec execute 346 sec latency 81.652 ms 2020-11-20T12:09:08.748 INFO:tasks.workunit.client.0.smithi192.stdout: 10 136653 15.56 MB/sec execute 347 sec latency 64.216 ms 2020-11-20T12:09:09.748 INFO:tasks.workunit.client.0.smithi192.stdout: 10 137034 15.59 MB/sec execute 348 sec latency 130.636 ms 2020-11-20T12:09:10.748 INFO:tasks.workunit.client.0.smithi192.stdout: 10 137632 15.64 MB/sec execute 349 sec latency 53.839 ms 2020-11-20T12:09:11.748 INFO:tasks.workunit.client.0.smithi192.stdout: 10 138115 15.69 MB/sec execute 350 sec latency 67.724 ms 2020-11-20T12:09:12.748 INFO:tasks.workunit.client.0.smithi192.stdout: 10 138413 15.71 MB/sec execute 351 sec latency 97.079 ms 2020-11-20T12:09:13.748 INFO:tasks.workunit.client.0.smithi192.stdout: 10 138714 15.71 MB/sec execute 352 sec latency 100.547 ms 2020-11-20T12:09:14.748 INFO:tasks.workunit.client.0.smithi192.stdout: 10 138958 15.70 MB/sec execute 353 sec latency 139.227 ms 2020-11-20T12:09:15.748 INFO:tasks.workunit.client.0.smithi192.stdout: 10 139255 15.69 MB/sec execute 354 sec latency 64.354 ms 2020-11-20T12:09:16.748 INFO:tasks.workunit.client.0.smithi192.stdout: 10 139675 15.68 MB/sec execute 355 sec latency 49.114 ms 2020-11-20T12:09:17.748 INFO:tasks.workunit.client.0.smithi192.stdout: 10 140036 15.68 MB/sec execute 356 sec latency 79.022 ms 2020-11-20T12:09:18.748 INFO:tasks.workunit.client.0.smithi192.stdout: 10 140507 15.73 MB/sec execute 357 sec latency 74.545 ms 2020-11-20T12:09:19.748 INFO:tasks.workunit.client.0.smithi192.stdout: 10 140906 15.75 MB/sec execute 358 sec latency 151.561 ms 2020-11-20T12:09:20.748 INFO:tasks.workunit.client.0.smithi192.stdout: 10 141390 15.77 MB/sec execute 359 sec latency 71.806 ms 2020-11-20T12:09:21.748 INFO:tasks.workunit.client.0.smithi192.stdout: 10 141649 15.78 MB/sec execute 360 sec latency 96.822 ms 2020-11-20T12:09:22.748 INFO:tasks.workunit.client.0.smithi192.stdout: 10 141670 15.74 MB/sec execute 361 sec latency 1006.560 ms 2020-11-20T12:09:23.748 INFO:tasks.workunit.client.0.smithi192.stdout: 10 141675 15.70 MB/sec execute 362 sec latency 1713.241 ms 2020-11-20T12:09:24.748 INFO:tasks.workunit.client.0.smithi192.stdout: 10 141796 15.68 MB/sec execute 363 sec latency 1749.343 ms 2020-11-20T12:09:25.748 INFO:tasks.workunit.client.0.smithi192.stdout: 10 142038 15.68 MB/sec execute 364 sec latency 111.855 ms 2020-11-20T12:09:26.749 INFO:tasks.workunit.client.0.smithi192.stdout: 10 142262 15.67 MB/sec execute 365 sec latency 113.361 ms 2020-11-20T12:09:27.749 INFO:tasks.workunit.client.0.smithi192.stdout: 10 142469 15.67 MB/sec execute 366 sec latency 92.396 ms 2020-11-20T12:09:28.748 INFO:tasks.workunit.client.0.smithi192.stdout: 10 142654 15.64 MB/sec execute 367 sec latency 146.262 ms 2020-11-20T12:09:29.749 INFO:tasks.workunit.client.0.smithi192.stdout: 10 142869 15.62 MB/sec execute 368 sec latency 168.296 ms 2020-11-20T12:09:30.749 INFO:tasks.workunit.client.0.smithi192.stdout: 10 143116 15.60 MB/sec execute 369 sec latency 88.779 ms 2020-11-20T12:09:31.749 INFO:tasks.workunit.client.0.smithi192.stdout: 10 143389 15.59 MB/sec execute 370 sec latency 165.163 ms 2020-11-20T12:09:32.749 INFO:tasks.workunit.client.0.smithi192.stdout: 10 143686 15.58 MB/sec execute 371 sec latency 133.177 ms 2020-11-20T12:09:33.749 INFO:tasks.workunit.client.0.smithi192.stdout: 10 144223 15.63 MB/sec execute 372 sec latency 61.246 ms 2020-11-20T12:09:34.749 INFO:tasks.workunit.client.0.smithi192.stdout: 10 144735 15.67 MB/sec execute 373 sec latency 59.092 ms 2020-11-20T12:09:35.749 INFO:tasks.workunit.client.0.smithi192.stdout: 10 145195 15.69 MB/sec execute 374 sec latency 51.335 ms 2020-11-20T12:09:36.749 INFO:tasks.workunit.client.0.smithi192.stdout: 10 145545 15.72 MB/sec execute 375 sec latency 102.289 ms 2020-11-20T12:09:37.749 INFO:tasks.workunit.client.0.smithi192.stdout: 10 145702 15.70 MB/sec execute 376 sec latency 458.940 ms 2020-11-20T12:09:38.749 INFO:tasks.workunit.client.0.smithi192.stdout: 10 145732 15.67 MB/sec execute 377 sec latency 1413.447 ms 2020-11-20T12:09:39.752 INFO:tasks.workunit.client.0.smithi192.stdout: 10 145904 15.66 MB/sec execute 378 sec latency 265.633 ms 2020-11-20T12:09:40.753 INFO:tasks.workunit.client.0.smithi192.stdout: 10 146111 15.64 MB/sec execute 379 sec latency 111.650 ms 2020-11-20T12:09:41.752 INFO:tasks.workunit.client.0.smithi192.stdout: 10 146279 15.61 MB/sec execute 380 sec latency 130.629 ms 2020-11-20T12:09:42.752 INFO:tasks.workunit.client.0.smithi192.stdout: 10 146513 15.59 MB/sec execute 381 sec latency 98.274 ms 2020-11-20T12:09:43.752 INFO:tasks.workunit.client.0.smithi192.stdout: 10 146840 15.59 MB/sec execute 382 sec latency 124.271 ms 2020-11-20T12:09:44.752 INFO:tasks.workunit.client.0.smithi192.stdout: 10 147114 15.58 MB/sec execute 383 sec latency 101.295 ms 2020-11-20T12:09:45.752 INFO:tasks.workunit.client.0.smithi192.stdout: 10 147568 15.60 MB/sec execute 384 sec latency 80.100 ms 2020-11-20T12:09:46.752 INFO:tasks.workunit.client.0.smithi192.stdout: 10 148091 15.65 MB/sec execute 385 sec latency 58.953 ms 2020-11-20T12:09:47.752 INFO:tasks.workunit.client.0.smithi192.stdout: 10 148569 15.67 MB/sec execute 386 sec latency 80.008 ms 2020-11-20T12:09:48.752 INFO:tasks.workunit.client.0.smithi192.stdout: 10 148871 15.69 MB/sec execute 387 sec latency 73.103 ms 2020-11-20T12:09:49.752 INFO:tasks.workunit.client.0.smithi192.stdout: 10 149151 15.69 MB/sec execute 388 sec latency 153.997 ms 2020-11-20T12:09:50.752 INFO:tasks.workunit.client.0.smithi192.stdout: 10 149492 15.71 MB/sec execute 389 sec latency 71.612 ms 2020-11-20T12:09:51.752 INFO:tasks.workunit.client.0.smithi192.stdout: 10 149755 15.70 MB/sec execute 390 sec latency 88.939 ms 2020-11-20T12:09:52.752 INFO:tasks.workunit.client.0.smithi192.stdout: 10 150061 15.69 MB/sec execute 391 sec latency 67.495 ms 2020-11-20T12:09:53.933 INFO:tasks.workunit.client.0.smithi192.stdout: 10 150338 15.68 MB/sec execute 392 sec latency 172.887 ms 2020-11-20T12:09:54.752 INFO:tasks.workunit.client.0.smithi192.stdout: 10 150736 15.68 MB/sec execute 393 sec latency 82.582 ms 2020-11-20T12:09:55.754 INFO:tasks.workunit.client.0.smithi192.stdout: 10 151214 15.71 MB/sec execute 394 sec latency 67.160 ms 2020-11-20T12:09:56.753 INFO:tasks.workunit.client.0.smithi192.stdout: 10 151662 15.76 MB/sec execute 395 sec latency 70.830 ms 2020-11-20T12:09:57.753 INFO:tasks.workunit.client.0.smithi192.stdout: 10 152218 15.78 MB/sec execute 396 sec latency 58.043 ms 2020-11-20T12:09:58.753 INFO:tasks.workunit.client.0.smithi192.stdout: 10 152539 15.79 MB/sec execute 397 sec latency 64.699 ms 2020-11-20T12:09:59.753 INFO:tasks.workunit.client.0.smithi192.stdout: 10 152805 15.79 MB/sec execute 398 sec latency 128.376 ms 2020-11-20T12:10:00.753 INFO:tasks.workunit.client.0.smithi192.stdout: 10 153177 15.81 MB/sec execute 399 sec latency 71.960 ms 2020-11-20T12:10:01.753 INFO:tasks.workunit.client.0.smithi192.stdout: 10 153530 15.81 MB/sec execute 400 sec latency 74.480 ms 2020-11-20T12:10:02.753 INFO:tasks.workunit.client.0.smithi192.stdout: 10 153876 15.81 MB/sec execute 401 sec latency 65.512 ms 2020-11-20T12:10:03.786 INFO:tasks.workunit.client.0.smithi192.stdout: 10 153919 15.78 MB/sec execute 402 sec latency 804.957 ms 2020-11-20T12:10:04.753 INFO:tasks.workunit.client.0.smithi192.stdout: 10 153924 15.74 MB/sec execute 403 sec latency 1805.010 ms 2020-11-20T12:10:05.753 INFO:tasks.workunit.client.0.smithi192.stdout: 10 153968 15.70 MB/sec execute 404 sec latency 2123.245 ms 2020-11-20T12:10:06.755 INFO:tasks.workunit.client.0.smithi192.stdout: 10 154231 15.69 MB/sec execute 405 sec latency 142.136 ms 2020-11-20T12:10:07.753 INFO:tasks.workunit.client.0.smithi192.stdout: 10 154594 15.69 MB/sec execute 406 sec latency 86.255 ms 2020-11-20T12:10:08.753 INFO:tasks.workunit.client.0.smithi192.stdout: 10 154884 15.70 MB/sec execute 407 sec latency 76.182 ms 2020-11-20T12:10:09.753 INFO:tasks.workunit.client.0.smithi192.stdout: 10 155199 15.72 MB/sec execute 408 sec latency 179.906 ms 2020-11-20T12:10:10.753 INFO:tasks.workunit.client.0.smithi192.stdout: 10 155579 15.71 MB/sec execute 409 sec latency 138.781 ms 2020-11-20T12:10:11.754 INFO:tasks.workunit.client.0.smithi192.stdout: 10 155862 15.72 MB/sec execute 410 sec latency 82.579 ms 2020-11-20T12:10:12.754 INFO:tasks.workunit.client.0.smithi192.stdout: 10 156152 15.74 MB/sec execute 411 sec latency 101.708 ms 2020-11-20T12:10:13.754 INFO:tasks.workunit.client.0.smithi192.stdout: 10 156431 15.73 MB/sec execute 412 sec latency 83.906 ms 2020-11-20T12:10:14.754 INFO:tasks.workunit.client.0.smithi192.stdout: 10 156793 15.74 MB/sec execute 413 sec latency 86.562 ms 2020-11-20T12:10:15.754 INFO:tasks.workunit.client.0.smithi192.stdout: 10 157076 15.74 MB/sec execute 414 sec latency 267.367 ms 2020-11-20T12:10:16.754 INFO:tasks.workunit.client.0.smithi192.stdout: 10 157330 15.73 MB/sec execute 415 sec latency 137.100 ms 2020-11-20T12:10:17.755 INFO:tasks.workunit.client.0.smithi192.stdout: 10 157727 15.73 MB/sec execute 416 sec latency 74.219 ms 2020-11-20T12:10:18.754 INFO:tasks.workunit.client.0.smithi192.stdout: 10 158067 15.74 MB/sec execute 417 sec latency 104.603 ms 2020-11-20T12:10:19.754 INFO:tasks.workunit.client.0.smithi192.stdout: 10 158345 15.73 MB/sec execute 418 sec latency 223.959 ms 2020-11-20T12:10:20.754 INFO:tasks.workunit.client.0.smithi192.stdout: 10 158812 15.78 MB/sec execute 419 sec latency 60.201 ms 2020-11-20T12:10:21.754 INFO:tasks.workunit.client.0.smithi192.stdout: 10 159279 15.77 MB/sec execute 420 sec latency 125.466 ms 2020-11-20T12:10:22.754 INFO:tasks.workunit.client.0.smithi192.stdout: 10 159492 15.77 MB/sec execute 421 sec latency 221.412 ms 2020-11-20T12:10:23.761 INFO:tasks.workunit.client.0.smithi192.stdout: 10 159690 15.77 MB/sec execute 422 sec latency 579.925 ms 2020-11-20T12:10:24.759 INFO:tasks.workunit.client.0.smithi192.stdout: 10 159706 15.74 MB/sec execute 423 sec latency 1438.928 ms 2020-11-20T12:10:25.758 INFO:tasks.workunit.client.0.smithi192.stdout: 10 159810 15.72 MB/sec execute 424 sec latency 1924.812 ms 2020-11-20T12:10:26.758 INFO:tasks.workunit.client.0.smithi192.stdout: 10 160124 15.72 MB/sec execute 425 sec latency 76.384 ms 2020-11-20T12:10:27.758 INFO:tasks.workunit.client.0.smithi192.stdout: 10 160441 15.72 MB/sec execute 426 sec latency 96.044 ms 2020-11-20T12:10:28.758 INFO:tasks.workunit.client.0.smithi192.stdout: 10 160655 15.71 MB/sec execute 427 sec latency 84.443 ms 2020-11-20T12:10:29.764 INFO:tasks.workunit.client.0.smithi192.stdout: 10 160830 15.69 MB/sec execute 428 sec latency 235.865 ms 2020-11-20T12:10:30.758 INFO:tasks.workunit.client.0.smithi192.stdout: 10 161138 15.69 MB/sec execute 429 sec latency 78.270 ms 2020-11-20T12:10:31.758 INFO:tasks.workunit.client.0.smithi192.stdout: 10 161496 15.70 MB/sec execute 430 sec latency 86.640 ms 2020-11-20T12:10:32.758 INFO:tasks.workunit.client.0.smithi192.stdout: 10 161721 15.68 MB/sec execute 431 sec latency 211.947 ms 2020-11-20T12:10:33.758 INFO:tasks.workunit.client.0.smithi192.stdout: 10 162127 15.70 MB/sec execute 432 sec latency 93.995 ms 2020-11-20T12:10:34.758 INFO:tasks.workunit.client.0.smithi192.stdout: 10 162594 15.72 MB/sec execute 433 sec latency 76.402 ms 2020-11-20T12:10:35.759 INFO:tasks.workunit.client.0.smithi192.stdout: 10 162954 15.72 MB/sec execute 434 sec latency 89.932 ms 2020-11-20T12:10:36.758 INFO:tasks.workunit.client.0.smithi192.stdout: 10 163306 15.75 MB/sec execute 435 sec latency 66.034 ms 2020-11-20T12:10:37.759 INFO:tasks.workunit.client.0.smithi192.stdout: 10 163639 15.76 MB/sec execute 436 sec latency 180.514 ms 2020-11-20T12:10:38.759 INFO:tasks.workunit.client.0.smithi192.stdout: 10 163980 15.76 MB/sec execute 437 sec latency 106.528 ms 2020-11-20T12:10:39.758 INFO:tasks.workunit.client.0.smithi192.stdout: 10 164200 15.75 MB/sec execute 438 sec latency 119.557 ms 2020-11-20T12:10:40.758 INFO:tasks.workunit.client.0.smithi192.stdout: 10 164561 15.75 MB/sec execute 439 sec latency 62.953 ms 2020-11-20T12:10:42.506 INFO:tasks.workunit.client.0.smithi192.stdout: 10 165003 15.77 MB/sec execute 440 sec latency 67.773 ms 2020-11-20T12:10:42.759 INFO:tasks.workunit.client.0.smithi192.stdout: 10 165323 15.76 MB/sec execute 441 sec latency 119.812 ms 2020-11-20T12:10:43.759 INFO:tasks.workunit.client.0.smithi192.stdout: 10 165724 15.78 MB/sec execute 442 sec latency 103.173 ms 2020-11-20T12:10:44.759 INFO:tasks.workunit.client.0.smithi192.stdout: 10 166160 15.80 MB/sec execute 443 sec latency 93.042 ms 2020-11-20T12:10:45.759 INFO:tasks.workunit.client.0.smithi192.stdout: 10 166561 15.81 MB/sec execute 444 sec latency 73.069 ms 2020-11-20T12:10:46.759 INFO:tasks.workunit.client.0.smithi192.stdout: 10 166961 15.84 MB/sec execute 445 sec latency 67.141 ms 2020-11-20T12:10:47.759 INFO:tasks.workunit.client.0.smithi192.stdout: 10 167379 15.85 MB/sec execute 446 sec latency 76.801 ms 2020-11-20T12:10:48.759 INFO:tasks.workunit.client.0.smithi192.stdout: 10 167654 15.84 MB/sec execute 447 sec latency 93.691 ms 2020-11-20T12:10:49.765 INFO:tasks.workunit.client.0.smithi192.stdout: 10 167862 15.84 MB/sec execute 448 sec latency 129.601 ms 2020-11-20T12:10:50.765 INFO:tasks.workunit.client.0.smithi192.stdout: 10 168279 15.85 MB/sec execute 449 sec latency 59.606 ms 2020-11-20T12:10:51.765 INFO:tasks.workunit.client.0.smithi192.stdout: 10 168654 15.85 MB/sec execute 450 sec latency 86.475 ms 2020-11-20T12:10:52.759 INFO:tasks.workunit.client.0.smithi192.stdout: 10 168993 15.85 MB/sec execute 451 sec latency 89.456 ms 2020-11-20T12:10:53.759 INFO:tasks.workunit.client.0.smithi192.stdout: 10 169522 15.89 MB/sec execute 452 sec latency 51.852 ms 2020-11-20T12:10:54.759 INFO:tasks.workunit.client.0.smithi192.stdout: 10 169926 15.90 MB/sec execute 453 sec latency 94.368 ms 2020-11-20T12:10:55.760 INFO:tasks.workunit.client.0.smithi192.stdout: 10 170289 15.91 MB/sec execute 454 sec latency 67.722 ms 2020-11-20T12:10:56.759 INFO:tasks.workunit.client.0.smithi192.stdout: 10 170699 15.94 MB/sec execute 455 sec latency 60.638 ms 2020-11-20T12:10:57.760 INFO:tasks.workunit.client.0.smithi192.stdout: 10 170997 15.93 MB/sec execute 456 sec latency 105.774 ms 2020-11-20T12:10:58.759 INFO:tasks.workunit.client.0.smithi192.stdout: 10 171226 15.92 MB/sec execute 457 sec latency 109.423 ms 2020-11-20T12:10:59.759 INFO:tasks.workunit.client.0.smithi192.stdout: 10 171285 15.89 MB/sec execute 458 sec latency 431.071 ms 2020-11-20T12:11:00.759 INFO:tasks.workunit.client.0.smithi192.stdout: 10 171293 15.86 MB/sec execute 459 sec latency 1427.706 ms 2020-11-20T12:11:01.759 INFO:tasks.workunit.client.0.smithi192.stdout: 10 171296 15.82 MB/sec execute 460 sec latency 2427.736 ms 2020-11-20T12:11:02.759 INFO:tasks.workunit.client.0.smithi192.stdout: 10 171298 15.79 MB/sec execute 461 sec latency 3427.764 ms 2020-11-20T12:11:03.759 INFO:tasks.workunit.client.0.smithi192.stdout: 10 171402 15.77 MB/sec execute 462 sec latency 3741.779 ms 2020-11-20T12:11:04.759 INFO:tasks.workunit.client.0.smithi192.stdout: 10 171691 15.77 MB/sec execute 463 sec latency 119.886 ms 2020-11-20T12:11:05.759 INFO:tasks.workunit.client.0.smithi192.stdout: 10 171976 15.76 MB/sec execute 464 sec latency 108.450 ms 2020-11-20T12:11:06.759 INFO:tasks.workunit.client.0.smithi192.stdout: 10 172219 15.75 MB/sec execute 465 sec latency 118.257 ms 2020-11-20T12:11:07.759 INFO:tasks.workunit.client.0.smithi192.stdout: 10 172471 15.75 MB/sec execute 466 sec latency 102.347 ms 2020-11-20T12:11:08.759 INFO:tasks.workunit.client.0.smithi192.stdout: 10 172755 15.75 MB/sec execute 467 sec latency 93.437 ms 2020-11-20T12:11:09.761 INFO:tasks.workunit.client.0.smithi192.stdout: 10 172964 15.74 MB/sec execute 468 sec latency 270.051 ms 2020-11-20T12:11:10.759 INFO:tasks.workunit.client.0.smithi192.stdout: 10 173307 15.75 MB/sec execute 469 sec latency 115.783 ms 2020-11-20T12:11:11.759 INFO:tasks.workunit.client.0.smithi192.stdout: 10 173588 15.74 MB/sec execute 470 sec latency 174.835 ms 2020-11-20T12:11:12.759 INFO:tasks.workunit.client.0.smithi192.stdout: 10 173867 15.75 MB/sec execute 471 sec latency 86.733 ms 2020-11-20T12:11:13.759 INFO:tasks.workunit.client.0.smithi192.stdout: 10 174176 15.76 MB/sec execute 472 sec latency 71.470 ms 2020-11-20T12:11:14.760 INFO:tasks.workunit.client.0.smithi192.stdout: 10 174459 15.75 MB/sec execute 473 sec latency 92.488 ms 2020-11-20T12:11:15.760 INFO:tasks.workunit.client.0.smithi192.stdout: 10 174757 15.75 MB/sec execute 474 sec latency 83.332 ms 2020-11-20T12:11:16.760 INFO:tasks.workunit.client.0.smithi192.stdout: 10 175019 15.75 MB/sec execute 475 sec latency 117.265 ms 2020-11-20T12:11:17.760 INFO:tasks.workunit.client.0.smithi192.stdout: 10 175425 15.76 MB/sec execute 476 sec latency 71.429 ms 2020-11-20T12:11:18.760 INFO:tasks.workunit.client.0.smithi192.stdout: 10 175793 15.76 MB/sec execute 477 sec latency 60.887 ms 2020-11-20T12:11:19.760 INFO:tasks.workunit.client.0.smithi192.stdout: 10 176054 15.75 MB/sec execute 478 sec latency 205.959 ms 2020-11-20T12:11:20.760 INFO:tasks.workunit.client.0.smithi192.stdout: 10 176152 15.73 MB/sec execute 479 sec latency 698.419 ms 2020-11-20T12:11:21.761 INFO:tasks.workunit.client.0.smithi192.stdout: 10 176162 15.70 MB/sec execute 480 sec latency 1523.015 ms 2020-11-20T12:11:22.760 INFO:tasks.workunit.client.0.smithi192.stdout: 10 176405 15.71 MB/sec execute 481 sec latency 614.010 ms 2020-11-20T12:11:23.760 INFO:tasks.workunit.client.0.smithi192.stdout: 10 176749 15.71 MB/sec execute 482 sec latency 103.691 ms 2020-11-20T12:11:24.760 INFO:tasks.workunit.client.0.smithi192.stdout: 10 177063 15.71 MB/sec execute 483 sec latency 116.179 ms 2020-11-20T12:11:25.760 INFO:tasks.workunit.client.0.smithi192.stdout: 10 177370 15.72 MB/sec execute 484 sec latency 90.336 ms 2020-11-20T12:11:26.993 INFO:tasks.workunit.client.0.smithi192.stdout: 10 177687 15.72 MB/sec execute 485 sec latency 120.498 ms 2020-11-20T12:11:27.760 INFO:tasks.workunit.client.0.smithi192.stdout: 10 178051 15.72 MB/sec execute 486 sec latency 108.381 ms 2020-11-20T12:11:28.760 INFO:tasks.workunit.client.0.smithi192.stdout: 10 178370 15.74 MB/sec execute 487 sec latency 120.053 ms 2020-11-20T12:11:29.760 INFO:tasks.workunit.client.0.smithi192.stdout: 10 178670 15.74 MB/sec execute 488 sec latency 123.230 ms 2020-11-20T12:11:30.762 INFO:tasks.workunit.client.0.smithi192.stdout: 10 179083 15.74 MB/sec execute 489 sec latency 60.016 ms 2020-11-20T12:11:31.760 INFO:tasks.workunit.client.0.smithi192.stdout: 10 179422 15.74 MB/sec execute 490 sec latency 74.020 ms 2020-11-20T12:11:32.761 INFO:tasks.workunit.client.0.smithi192.stdout: 10 179807 15.75 MB/sec execute 491 sec latency 88.095 ms 2020-11-20T12:11:33.760 INFO:tasks.workunit.client.0.smithi192.stdout: 10 180239 15.77 MB/sec execute 492 sec latency 132.249 ms 2020-11-20T12:11:34.764 INFO:tasks.workunit.client.0.smithi192.stdout: 10 180667 15.79 MB/sec execute 493 sec latency 75.918 ms 2020-11-20T12:11:35.760 INFO:tasks.workunit.client.0.smithi192.stdout: 10 181064 15.80 MB/sec execute 494 sec latency 70.592 ms 2020-11-20T12:11:36.760 INFO:tasks.workunit.client.0.smithi192.stdout: 10 181461 15.81 MB/sec execute 495 sec latency 89.764 ms 2020-11-20T12:11:37.760 INFO:tasks.workunit.client.0.smithi192.stdout: 10 181799 15.81 MB/sec execute 496 sec latency 82.292 ms 2020-11-20T12:11:38.760 INFO:tasks.workunit.client.0.smithi192.stdout: 10 182044 15.81 MB/sec execute 497 sec latency 159.569 ms 2020-11-20T12:11:39.761 INFO:tasks.workunit.client.0.smithi192.stdout: 10 182452 15.83 MB/sec execute 498 sec latency 132.458 ms 2020-11-20T12:11:40.760 INFO:tasks.workunit.client.0.smithi192.stdout: 10 182790 15.82 MB/sec execute 499 sec latency 196.519 ms 2020-11-20T12:11:41.760 INFO:tasks.workunit.client.0.smithi192.stdout: 10 182795 15.79 MB/sec execute 500 sec latency 1196.555 ms 2020-11-20T12:11:42.761 INFO:tasks.workunit.client.0.smithi192.stdout: 10 182805 15.76 MB/sec execute 501 sec latency 2134.823 ms 2020-11-20T12:11:43.761 INFO:tasks.workunit.client.0.smithi192.stdout: 10 183021 15.75 MB/sec execute 502 sec latency 1100.348 ms 2020-11-20T12:11:44.761 INFO:tasks.workunit.client.0.smithi192.stdout: 10 183236 15.74 MB/sec execute 503 sec latency 108.794 ms 2020-11-20T12:11:45.761 INFO:tasks.workunit.client.0.smithi192.stdout: 10 183547 15.75 MB/sec execute 504 sec latency 81.646 ms 2020-11-20T12:11:46.761 INFO:tasks.workunit.client.0.smithi192.stdout: 10 183890 15.76 MB/sec execute 505 sec latency 106.354 ms 2020-11-20T12:11:47.761 INFO:tasks.workunit.client.0.smithi192.stdout: 10 184207 15.76 MB/sec execute 506 sec latency 105.990 ms 2020-11-20T12:11:48.761 INFO:tasks.workunit.client.0.smithi192.stdout: 10 184459 15.76 MB/sec execute 507 sec latency 89.069 ms 2020-11-20T12:11:49.761 INFO:tasks.workunit.client.0.smithi192.stdout: 10 184643 15.74 MB/sec execute 508 sec latency 139.914 ms 2020-11-20T12:11:50.763 INFO:tasks.workunit.client.0.smithi192.stdout: 10 184907 15.74 MB/sec execute 509 sec latency 146.198 ms 2020-11-20T12:11:51.761 INFO:tasks.workunit.client.0.smithi192.stdout: 10 185256 15.75 MB/sec execute 510 sec latency 84.305 ms 2020-11-20T12:11:52.761 INFO:tasks.workunit.client.0.smithi192.stdout: 10 185566 15.76 MB/sec execute 511 sec latency 88.442 ms 2020-11-20T12:11:53.761 INFO:tasks.workunit.client.0.smithi192.stdout: 10 185975 15.77 MB/sec execute 512 sec latency 61.933 ms 2020-11-20T12:11:54.761 INFO:tasks.workunit.client.0.smithi192.stdout: 10 186269 15.76 MB/sec execute 513 sec latency 78.045 ms 2020-11-20T12:11:55.761 INFO:tasks.workunit.client.0.smithi192.stdout: 10 186567 15.76 MB/sec execute 514 sec latency 243.623 ms 2020-11-20T12:11:56.761 INFO:tasks.workunit.client.0.smithi192.stdout: 10 186637 15.74 MB/sec execute 515 sec latency 907.379 ms 2020-11-20T12:11:57.761 INFO:tasks.workunit.client.0.smithi192.stdout: 10 186703 15.71 MB/sec execute 516 sec latency 1433.862 ms 2020-11-20T12:11:58.761 INFO:tasks.workunit.client.0.smithi192.stdout: 10 186932 15.71 MB/sec execute 517 sec latency 137.215 ms 2020-11-20T12:11:59.761 INFO:tasks.workunit.client.0.smithi192.stdout: 10 187183 15.71 MB/sec execute 518 sec latency 158.684 ms 2020-11-20T12:12:00.761 INFO:tasks.workunit.client.0.smithi192.stdout: 10 187437 15.70 MB/sec execute 519 sec latency 112.094 ms 2020-11-20T12:12:01.761 INFO:tasks.workunit.client.0.smithi192.stdout: 10 187742 15.70 MB/sec execute 520 sec latency 107.909 ms 2020-11-20T12:12:02.761 INFO:tasks.workunit.client.0.smithi192.stdout: 10 188084 15.70 MB/sec execute 521 sec latency 85.871 ms 2020-11-20T12:12:03.761 INFO:tasks.workunit.client.0.smithi192.stdout: 10 188415 15.70 MB/sec execute 522 sec latency 80.012 ms 2020-11-20T12:12:04.761 INFO:tasks.workunit.client.0.smithi192.stdout: 10 188796 15.72 MB/sec execute 523 sec latency 111.515 ms 2020-11-20T12:12:05.761 INFO:tasks.workunit.client.0.smithi192.stdout: 10 189109 15.73 MB/sec execute 524 sec latency 91.462 ms 2020-11-20T12:12:06.762 INFO:tasks.workunit.client.0.smithi192.stdout: 10 189430 15.73 MB/sec execute 525 sec latency 186.708 ms 2020-11-20T12:12:07.761 INFO:tasks.workunit.client.0.smithi192.stdout: 10 189744 15.74 MB/sec execute 526 sec latency 242.235 ms 2020-11-20T12:12:08.761 INFO:tasks.workunit.client.0.smithi192.stdout: 10 190079 15.73 MB/sec execute 527 sec latency 95.737 ms 2020-11-20T12:12:09.761 INFO:tasks.workunit.client.0.smithi192.stdout: 10 190290 15.72 MB/sec execute 528 sec latency 141.228 ms 2020-11-20T12:12:10.761 INFO:tasks.workunit.client.0.smithi192.stdout: 10 190703 15.74 MB/sec execute 529 sec latency 64.448 ms 2020-11-20T12:12:11.762 INFO:tasks.workunit.client.0.smithi192.stdout: 10 191128 15.75 MB/sec execute 530 sec latency 73.852 ms 2020-11-20T12:12:12.761 INFO:tasks.workunit.client.0.smithi192.stdout: 10 191475 15.75 MB/sec execute 531 sec latency 217.698 ms 2020-11-20T12:12:13.761 INFO:tasks.workunit.client.0.smithi192.stdout: 10 191882 15.77 MB/sec execute 532 sec latency 61.713 ms 2020-11-20T12:12:14.761 INFO:tasks.workunit.client.0.smithi192.stdout: 10 192219 15.77 MB/sec execute 533 sec latency 84.905 ms 2020-11-20T12:12:15.761 INFO:tasks.workunit.client.0.smithi192.stdout: 10 192549 15.78 MB/sec execute 534 sec latency 105.780 ms 2020-11-20T12:12:16.762 INFO:tasks.workunit.client.0.smithi192.stdout: 10 192802 15.78 MB/sec execute 535 sec latency 410.699 ms 2020-11-20T12:12:18.487 INFO:tasks.workunit.client.0.smithi192.stdout: 10 192807 15.75 MB/sec execute 536 sec latency 1410.734 ms 2020-11-20T12:12:18.762 INFO:tasks.workunit.client.0.smithi192.stdout: 10 192831 15.72 MB/sec execute 537 sec latency 2182.381 ms 2020-11-20T12:12:19.762 INFO:tasks.workunit.client.0.smithi192.stdout: 10 193032 15.72 MB/sec execute 538 sec latency 205.993 ms 2020-11-20T12:12:20.762 INFO:tasks.workunit.client.0.smithi192.stdout: 10 193326 15.71 MB/sec execute 539 sec latency 76.987 ms 2020-11-20T12:12:21.762 INFO:tasks.workunit.client.0.smithi192.stdout: 10 193623 15.71 MB/sec execute 540 sec latency 94.084 ms 2020-11-20T12:12:22.762 INFO:tasks.workunit.client.0.smithi192.stdout: 10 193831 15.69 MB/sec execute 541 sec latency 129.916 ms 2020-11-20T12:12:23.763 INFO:tasks.workunit.client.0.smithi192.stdout: 10 194090 15.70 MB/sec execute 542 sec latency 92.288 ms 2020-11-20T12:12:24.762 INFO:tasks.workunit.client.0.smithi192.stdout: 10 194374 15.70 MB/sec execute 543 sec latency 99.293 ms 2020-11-20T12:12:25.762 INFO:tasks.workunit.client.0.smithi192.stdout: 10 194763 15.70 MB/sec execute 544 sec latency 101.813 ms 2020-11-20T12:12:26.762 INFO:tasks.workunit.client.0.smithi192.stdout: 10 195152 15.71 MB/sec execute 545 sec latency 72.989 ms 2020-11-20T12:12:27.762 INFO:tasks.workunit.client.0.smithi192.stdout: 10 195509 15.72 MB/sec execute 546 sec latency 76.355 ms 2020-11-20T12:12:28.762 INFO:tasks.workunit.client.0.smithi192.stdout: 10 195824 15.72 MB/sec execute 547 sec latency 180.790 ms 2020-11-20T12:12:29.762 INFO:tasks.workunit.client.0.smithi192.stdout: 10 196089 15.73 MB/sec execute 548 sec latency 129.171 ms 2020-11-20T12:12:30.762 INFO:tasks.workunit.client.0.smithi192.stdout: 10 196444 15.74 MB/sec execute 549 sec latency 81.678 ms 2020-11-20T12:12:31.762 INFO:tasks.workunit.client.0.smithi192.stdout: 10 196809 15.74 MB/sec execute 550 sec latency 66.575 ms 2020-11-20T12:12:32.762 INFO:tasks.workunit.client.0.smithi192.stdout: 10 197079 15.73 MB/sec execute 551 sec latency 78.063 ms 2020-11-20T12:12:33.762 INFO:tasks.workunit.client.0.smithi192.stdout: 10 197399 15.73 MB/sec execute 552 sec latency 104.245 ms 2020-11-20T12:12:34.762 INFO:tasks.workunit.client.0.smithi192.stdout: 10 197724 15.74 MB/sec execute 553 sec latency 126.777 ms 2020-11-20T12:12:35.762 INFO:tasks.workunit.client.0.smithi192.stdout: 10 198120 15.75 MB/sec execute 554 sec latency 88.705 ms 2020-11-20T12:12:36.762 INFO:tasks.workunit.client.0.smithi192.stdout: 10 198527 15.76 MB/sec execute 555 sec latency 72.693 ms 2020-11-20T12:12:37.762 INFO:tasks.workunit.client.0.smithi192.stdout: 10 198578 15.73 MB/sec execute 556 sec latency 954.080 ms 2020-11-20T12:12:38.762 INFO:tasks.workunit.client.0.smithi192.stdout: 10 198585 15.70 MB/sec execute 557 sec latency 1037.331 ms 2020-11-20T12:12:39.762 INFO:tasks.workunit.client.0.smithi192.stdout: 10 198693 15.69 MB/sec execute 558 sec latency 955.073 ms 2020-11-20T12:12:40.762 INFO:tasks.workunit.client.0.smithi192.stdout: 10 199007 15.69 MB/sec execute 559 sec latency 78.534 ms 2020-11-20T12:12:41.762 INFO:tasks.workunit.client.0.smithi192.stdout: 10 199287 15.69 MB/sec execute 560 sec latency 88.506 ms 2020-11-20T12:12:42.762 INFO:tasks.workunit.client.0.smithi192.stdout: 10 199552 15.69 MB/sec execute 561 sec latency 96.721 ms 2020-11-20T12:12:43.762 INFO:tasks.workunit.client.0.smithi192.stdout: 10 199791 15.69 MB/sec execute 562 sec latency 105.973 ms 2020-11-20T12:12:44.762 INFO:tasks.workunit.client.0.smithi192.stdout: 10 200048 15.69 MB/sec execute 563 sec latency 108.398 ms 2020-11-20T12:12:45.762 INFO:tasks.workunit.client.0.smithi192.stdout: 10 200444 15.69 MB/sec execute 564 sec latency 67.849 ms 2020-11-20T12:12:46.763 INFO:tasks.workunit.client.0.smithi192.stdout: 10 200701 15.68 MB/sec execute 565 sec latency 115.144 ms 2020-11-20T12:12:47.762 INFO:tasks.workunit.client.0.smithi192.stdout: 10 201008 15.69 MB/sec execute 566 sec latency 87.588 ms 2020-11-20T12:12:48.763 INFO:tasks.workunit.client.0.smithi192.stdout: 10 201419 15.70 MB/sec execute 567 sec latency 84.824 ms 2020-11-20T12:12:49.763 INFO:tasks.workunit.client.0.smithi192.stdout: 10 201766 15.70 MB/sec execute 568 sec latency 155.040 ms 2020-11-20T12:12:50.763 INFO:tasks.workunit.client.0.smithi192.stdout: 10 202172 15.71 MB/sec execute 569 sec latency 64.415 ms 2020-11-20T12:12:51.763 INFO:tasks.workunit.client.0.smithi192.stdout: 10 202597 15.73 MB/sec execute 570 sec latency 72.685 ms 2020-11-20T12:12:52.763 INFO:tasks.workunit.client.0.smithi192.stdout: 10 202936 15.74 MB/sec execute 571 sec latency 82.005 ms 2020-11-20T12:12:53.763 INFO:tasks.workunit.client.0.smithi192.stdout: 10 203204 15.74 MB/sec execute 572 sec latency 111.546 ms 2020-11-20T12:12:54.763 INFO:tasks.workunit.client.0.smithi192.stdout: 10 203607 15.76 MB/sec execute 573 sec latency 73.129 ms 2020-11-20T12:12:55.763 INFO:tasks.workunit.client.0.smithi192.stdout: 10 204060 15.76 MB/sec execute 574 sec latency 50.496 ms 2020-11-20T12:12:56.763 INFO:tasks.workunit.client.0.smithi192.stdout: 10 204334 15.75 MB/sec execute 575 sec latency 109.835 ms 2020-11-20T12:12:57.763 INFO:tasks.workunit.client.0.smithi192.stdout: 10 204526 15.74 MB/sec execute 576 sec latency 426.816 ms 2020-11-20T12:12:58.763 INFO:tasks.workunit.client.0.smithi192.stdout: 10 204532 15.72 MB/sec execute 577 sec latency 1426.845 ms 2020-11-20T12:12:59.763 INFO:tasks.workunit.client.0.smithi192.stdout: 10 204567 15.69 MB/sec execute 578 sec latency 2001.751 ms 2020-11-20T12:13:00.763 INFO:tasks.workunit.client.0.smithi192.stdout: 10 204830 15.69 MB/sec execute 579 sec latency 131.418 ms 2020-11-20T12:13:01.763 INFO:tasks.workunit.client.0.smithi192.stdout: 10 205058 15.70 MB/sec execute 580 sec latency 136.267 ms 2020-11-20T12:13:02.763 INFO:tasks.workunit.client.0.smithi192.stdout: 10 205333 15.68 MB/sec execute 581 sec latency 104.652 ms 2020-11-20T12:13:03.763 INFO:tasks.workunit.client.0.smithi192.stdout: 10 205664 15.68 MB/sec execute 582 sec latency 107.078 ms 2020-11-20T12:13:04.763 INFO:tasks.workunit.client.0.smithi192.stdout: 10 205919 15.68 MB/sec execute 583 sec latency 64.703 ms 2020-11-20T12:13:05.763 INFO:tasks.workunit.client.0.smithi192.stdout: 10 206287 15.69 MB/sec execute 584 sec latency 94.533 ms 2020-11-20T12:13:06.763 INFO:tasks.workunit.client.0.smithi192.stdout: 10 206630 15.70 MB/sec execute 585 sec latency 89.563 ms 2020-11-20T12:13:07.763 INFO:tasks.workunit.client.0.smithi192.stdout: 10 206959 15.71 MB/sec execute 586 sec latency 198.006 ms 2020-11-20T12:13:08.763 INFO:tasks.workunit.client.0.smithi192.stdout: 10 207308 15.71 MB/sec execute 587 sec latency 84.299 ms 2020-11-20T12:13:09.763 INFO:tasks.workunit.client.0.smithi192.stdout: 10 207596 15.71 MB/sec execute 588 sec latency 128.647 ms 2020-11-20T12:13:10.763 INFO:tasks.workunit.client.0.smithi192.stdout: 10 207901 15.70 MB/sec execute 589 sec latency 84.479 ms 2020-11-20T12:13:11.763 INFO:tasks.workunit.client.0.smithi192.stdout: 10 208163 15.70 MB/sec execute 590 sec latency 139.611 ms 2020-11-20T12:13:12.763 INFO:tasks.workunit.client.0.smithi192.stdout: 10 208507 15.72 MB/sec execute 591 sec latency 133.902 ms 2020-11-20T12:13:13.763 INFO:tasks.workunit.client.0.smithi192.stdout: 10 208807 15.71 MB/sec execute 592 sec latency 208.902 ms 2020-11-20T12:13:14.764 INFO:tasks.workunit.client.0.smithi192.stdout: 10 209198 15.71 MB/sec execute 593 sec latency 93.150 ms 2020-11-20T12:13:15.763 INFO:tasks.workunit.client.0.smithi192.stdout: 10 209550 15.72 MB/sec execute 594 sec latency 80.787 ms 2020-11-20T12:13:16.763 INFO:tasks.workunit.client.0.smithi192.stdout: 10 209828 15.72 MB/sec execute 595 sec latency 82.832 ms 2020-11-20T12:13:17.764 INFO:tasks.workunit.client.0.smithi192.stdout: 10 210177 15.74 MB/sec execute 596 sec latency 108.078 ms 2020-11-20T12:13:18.764 INFO:tasks.workunit.client.0.smithi192.stdout: 10 210199 15.71 MB/sec execute 597 sec latency 967.970 ms 2020-11-20T12:13:19.764 INFO:tasks.workunit.client.0.smithi192.stdout: 10 210205 15.69 MB/sec execute 598 sec latency 1951.344 ms 2020-11-20T12:13:21.621 INFO:tasks.workunit.client.0.smithi192.stdout: 10 210387 15.67 MB/sec execute 599 sec latency 2094.453 ms 2020-11-20T12:13:21.764 INFO:tasks.workunit.client.0.smithi192.stdout: 10 cleanup 600 sec 2020-11-20T12:13:22.764 INFO:tasks.workunit.client.0.smithi192.stdout: 10 cleanup 601 sec 2020-11-20T12:13:23.764 INFO:tasks.workunit.client.0.smithi192.stdout: 9 cleanup 602 sec 2020-11-20T12:13:24.240 INFO:tasks.workunit.client.0.smithi192.stdout: 0 cleanup 603 sec 2020-11-20T12:13:24.240 INFO:tasks.workunit.client.0.smithi192.stdout: 2020-11-20T12:13:24.240 INFO:tasks.workunit.client.0.smithi192.stdout: Operation Count AvgLat MaxLat 2020-11-20T12:13:24.241 INFO:tasks.workunit.client.0.smithi192.stdout: ---------------------------------------- 2020-11-20T12:13:24.241 INFO:tasks.workunit.client.0.smithi192.stdout: NTCreateX 301162 7.543 2139.576 2020-11-20T12:13:24.241 INFO:tasks.workunit.client.0.smithi192.stdout: Close 221350 0.002 12.473 2020-11-20T12:13:24.241 INFO:tasks.workunit.client.0.smithi192.stdout: Rename 12791 34.186 1609.728 2020-11-20T12:13:24.242 INFO:tasks.workunit.client.0.smithi192.stdout: Unlink 60756 9.716 1570.534 2020-11-20T12:13:24.242 INFO:tasks.workunit.client.0.smithi192.stdout: Qpathinfo 273402 6.056 2172.207 2020-11-20T12:13:24.242 INFO:tasks.workunit.client.0.smithi192.stdout: Qfileinfo 47746 0.001 0.023 2020-11-20T12:13:24.242 INFO:tasks.workunit.client.0.smithi192.stdout: Qfsinfo 50115 0.170 109.494 2020-11-20T12:13:24.242 INFO:tasks.workunit.client.0.smithi192.stdout: Sfileinfo 24618 1.658 585.276 2020-11-20T12:13:24.243 INFO:tasks.workunit.client.0.smithi192.stdout: Find 105728 0.590 2116.926 2020-11-20T12:13:24.243 INFO:tasks.workunit.client.0.smithi192.stdout: WriteX 149116 0.497 4083.971 2020-11-20T12:13:24.243 INFO:tasks.workunit.client.0.smithi192.stdout: ReadX 473545 0.156 2187.082 2020-11-20T12:13:24.243 INFO:tasks.workunit.client.0.smithi192.stdout: LockX 984 9.115 242.070 2020-11-20T12:13:24.243 INFO:tasks.workunit.client.0.smithi192.stdout: UnlockX 984 7.660 291.037 2020-11-20T12:13:24.243 INFO:tasks.workunit.client.0.smithi192.stdout: Flush 21153 36.212 4051.147 2020-11-20T12:13:24.244 INFO:tasks.workunit.client.0.smithi192.stdout: 2020-11-20T12:13:24.244 INFO:tasks.workunit.client.0.smithi192.stdout:Throughput 15.6747 MB/sec 10 clients 10 procs max_latency=4083.984 ms 2020-11-20T12:13:24.257 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-11-20T12:13:24.258 INFO:teuthology.orchestra.run.smithi192:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-11-20T12:13:25.814 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2020-11-20T12:13:25.814 INFO:teuthology.orchestra.run.smithi192:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2020-11-20T12:13:26.243 DEBUG:teuthology.parallel:result is None 2020-11-20T12:13:26.244 INFO:teuthology.orchestra.run.smithi192:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2020-11-20T12:13:26.301 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2020-11-20T12:13:26.302 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2020-11-20T12:13:26.309 INFO:tasks.kclient:Unmounting kernel clients... 2020-11-20T12:13:26.309 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2020-11-20T12:13:26.310 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-11-20T12:13:26.310 INFO:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.0 2020-11-20T12:13:28.559 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2020-11-20T12:13:28.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:13:28.560 INFO:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-11-20T12:13:28.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:13:28.830 INFO:teuthology.orchestra.run.smithi192:> ip netns list 2020-11-20T12:13:29.199 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2020-11-20T12:13:29.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:13:29.200 INFO:teuthology.orchestra.run.smithi192:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2020-11-20T12:13:29.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:13:29.257 INFO:teuthology.orchestra.run.smithi192:> sudo ip link delete ceph-brx 2020-11-20T12:13:29.359 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2020-11-20T12:13:29.371 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2020-11-20T12:13:29.373 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T12:13:30.118 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.113+0000 7fd9e14c9700 1 Processor -- start 2020-11-20T12:13:30.118 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.113+0000 7fd9e14c9700 1 -- start start 2020-11-20T12:13:30.119 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.114+0000 7fd9e14c9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd9d40e0cb0 0x7fd9d4050ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:30.119 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.114+0000 7fd9e14c9700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d40e1410 con 0x7fd9d4007310 2020-11-20T12:13:30.119 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.114+0000 7fd9e14c9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d40e16b0 con 0x7fd9d4006f30 2020-11-20T12:13:30.119 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.114+0000 7fd9e14c9700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d40e1950 con 0x7fd9d40e0cb0 2020-11-20T12:13:30.119 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.114+0000 7fd9e0cc8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd9d40e0cb0 0x7fd9d4050ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:30.120 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.114+0000 7fd9e0cc8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd9d40e0cb0 0x7fd9d4050ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49694/0 (socket says 172.21.15.192:49694) 2020-11-20T12:13:30.120 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.114+0000 7fd9e0cc8700 1 -- 172.21.15.192:0/2736575383 learned_addr learned my addr 172.21.15.192:0/2736575383 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:30.120 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.115+0000 7fd9e0cc8700 1 -- 172.21.15.192:0/2736575383 >> v1:172.21.15.146:6789/0 conn(0x7fd9d4006f30 legacy=0x7fd9d40e05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:30.120 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.115+0000 7fd9e0cc8700 1 -- 172.21.15.192:0/2736575383 >> v1:172.21.15.87:6789/0 conn(0x7fd9d4007310 legacy=0x7fd9d40507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:30.123 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.115+0000 7fd9e0cc8700 1 -- 172.21.15.192:0/2736575383 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d40e1bf0 con 0x7fd9d40e0cb0 2020-11-20T12:13:30.123 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.115+0000 7fd9e0cc8700 1 --2- 172.21.15.192:0/2736575383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9d40e0cb0 0x7fd9d4050ed0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fd9dc0454c0 tx=0x7fd9dc05ba00).ready entity=mon.2 client_cookie=b8d3174971f22285 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:30.123 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.115+0000 7fd9daffd700 1 -- 172.21.15.192:0/2736575383 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc069eb0 con 0x7fd9d40e0cb0 2020-11-20T12:13:30.123 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.115+0000 7fd9daffd700 1 -- 172.21.15.192:0/2736575383 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9dc045600 con 0x7fd9d40e0cb0 2020-11-20T12:13:30.123 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.115+0000 7fd9daffd700 1 -- 172.21.15.192:0/2736575383 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc068ff0 con 0x7fd9d40e0cb0 2020-11-20T12:13:30.124 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.115+0000 7fd9e14c9700 1 -- 172.21.15.192:0/2736575383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9d40e0cb0 msgr2=0x7fd9d4050ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:30.124 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.115+0000 7fd9e14c9700 1 --2- 172.21.15.192:0/2736575383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9d40e0cb0 0x7fd9d4050ed0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fd9dc0454c0 tx=0x7fd9dc05ba00).stop 2020-11-20T12:13:30.124 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.115+0000 7fd9e14c9700 1 -- 172.21.15.192:0/2736575383 shutdown_connections 2020-11-20T12:13:30.124 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.115+0000 7fd9e14c9700 1 --2- 172.21.15.192:0/2736575383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9d40e0cb0 0x7fd9d4050ed0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:30.124 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.115+0000 7fd9e14c9700 1 -- 172.21.15.192:0/2736575383 >> 172.21.15.192:0/2736575383 conn(0x7fd9d4054470 msgr2=0x7fd9d4054880 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:30.125 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.116+0000 7fd9e14c9700 1 -- 172.21.15.192:0/2736575383 shutdown_connections 2020-11-20T12:13:30.125 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.116+0000 7fd9e14c9700 1 -- 172.21.15.192:0/2736575383 wait complete. 2020-11-20T12:13:30.125 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.117+0000 7fd9e14c9700 1 Processor -- start 2020-11-20T12:13:30.125 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.117+0000 7fd9e14c9700 1 -- start start 2020-11-20T12:13:30.125 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.118+0000 7fd9e14c9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9d4006f30 0x7fd9d40f3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:30.126 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.118+0000 7fd9e14c9700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9d4007310 0x7fd9d40a2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:30.126 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.118+0000 7fd9e14c9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9d40e0cb0 0x7fd9d4052910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:30.126 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.118+0000 7fd9e14c9700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d40f0340 con 0x7fd9d4007310 2020-11-20T12:13:30.126 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.118+0000 7fd9e14c9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d40f3e50 con 0x7fd9d4006f30 2020-11-20T12:13:30.126 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.118+0000 7fd9e14c9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d40f40f0 con 0x7fd9d40e0cb0 2020-11-20T12:13:30.127 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.118+0000 7fd9e0cc8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9d40e0cb0 0x7fd9d4052910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:30.127 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.118+0000 7fd9e0cc8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9d40e0cb0 0x7fd9d4052910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49700/0 (socket says 172.21.15.192:49700) 2020-11-20T12:13:30.127 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.118+0000 7fd9e0cc8700 1 -- 172.21.15.192:0/4065243036 learned_addr learned my addr 172.21.15.192:0/4065243036 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:30.127 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.118+0000 7fd9db7fe700 1 --2- 172.21.15.192:0/4065243036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9d4007310 0x7fd9d40a2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:30.127 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.118+0000 7fd9dbfff700 1 --2- 172.21.15.192:0/4065243036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9d4006f30 0x7fd9d40f3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:30.128 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.118+0000 7fd9e0cc8700 1 -- 172.21.15.192:0/4065243036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9d4006f30 msgr2=0x7fd9d40f3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:30.128 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.118+0000 7fd9e0cc8700 1 --2- 172.21.15.192:0/4065243036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9d4006f30 0x7fd9d40f3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:30.128 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.118+0000 7fd9e0cc8700 1 -- 172.21.15.192:0/4065243036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9d4007310 msgr2=0x7fd9d40a2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:30.128 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.118+0000 7fd9e0cc8700 1 --2- 172.21.15.192:0/4065243036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9d4007310 0x7fd9d40a2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:30.128 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.118+0000 7fd9e0cc8700 1 -- 172.21.15.192:0/4065243036 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d40f4390 con 0x7fd9d40e0cb0 2020-11-20T12:13:30.129 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.118+0000 7fd9e0cc8700 1 --2- 172.21.15.192:0/4065243036 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9d40e0cb0 0x7fd9d4052910 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fd9dc05f190 tx=0x7fd9dc088000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:30.129 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.118+0000 7fd9bffff700 1 -- 172.21.15.192:0/4065243036 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc091070 con 0x7fd9d40e0cb0 2020-11-20T12:13:30.130 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.118+0000 7fd9bffff700 1 -- 172.21.15.192:0/4065243036 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9dc069e60 con 0x7fd9d40e0cb0 2020-11-20T12:13:30.130 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.118+0000 7fd9e14c9700 1 -- 172.21.15.192:0/4065243036 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d40f0570 con 0x7fd9d40e0cb0 2020-11-20T12:13:30.131 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.118+0000 7fd9bffff700 1 -- 172.21.15.192:0/4065243036 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc068590 con 0x7fd9d40e0cb0 2020-11-20T12:13:30.131 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.118+0000 7fd9e14c9700 1 -- 172.21.15.192:0/4065243036 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d40a2640 con 0x7fd9d40e0cb0 2020-11-20T12:13:30.131 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.119+0000 7fd9e14c9700 1 -- 172.21.15.192:0/4065243036 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d40050b0 con 0x7fd9d40e0cb0 2020-11-20T12:13:30.131 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.120+0000 7fd9bffff700 1 -- 172.21.15.192:0/4065243036 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fd9dc0627b0 con 0x7fd9d40e0cb0 2020-11-20T12:13:30.131 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.120+0000 7fd9bffff700 1 --2- 172.21.15.192:0/4065243036 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fd9b4080670 0x7fd9b4082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:30.132 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.120+0000 7fd9bffff700 1 -- 172.21.15.192:0/4065243036 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fd9dc113460 con 0x7fd9d40e0cb0 2020-11-20T12:13:30.132 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.120+0000 7fd9dbfff700 1 --2- 172.21.15.192:0/4065243036 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fd9b4080670 0x7fd9b4082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:30.132 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.121+0000 7fd9dbfff700 1 --2- 172.21.15.192:0/4065243036 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fd9b4080670 0x7fd9b4082b30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fd9d0000c00 tx=0x7fd9d0007b80).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:30.132 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.124+0000 7fd9bffff700 1 -- 172.21.15.192:0/4065243036 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fd9dc0e7e10 con 0x7fd9d40e0cb0 2020-11-20T12:13:30.267 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.264+0000 7fd9e14c9700 1 -- 172.21.15.192:0/4065243036 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9d4008c50 con 0x7fd9d40e0cb0 2020-11-20T12:13:30.269 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.265+0000 7fd9bffff700 1 -- 172.21.15.192:0/4065243036 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21795 (secure 0 0 0) 0x7fd9dc084020 con 0x7fd9d40e0cb0 2020-11-20T12:13:30.269 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T12:13:30.270 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":28,"fsid":"4871390d-d110-4379-8302-5810d7b54f34","created":"2020-11-20T11:47:49.059675+0000","modified":"2020-11-20T11:48:09.832333+0000","last_up_change":"2020-11-20T11:47:57.317253+0000","last_in_change":"2020-11-20T11:47:57.317253+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:47:52.327778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:48:01.912951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:48:04.793810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:48:07.506705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77a5e1d9-0fb0-450c-872e-4aee77dede49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":23242},{"type":"v1","addr":"172.21.15.192:6827","nonce":23242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":23242},{"type":"v1","addr":"172.21.15.192:6829","nonce":23242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":23242},{"type":"v1","addr":"172.21.15.192:6833","nonce":23242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":23242},{"type":"v1","addr":"172.21.15.192:6831","nonce":23242}]},"public_addr":"172.21.15.192:6827/23242","cluster_addr":"172.21.15.192:6829/23242","heartbeat_back_addr":"172.21.15.192:6833/23242","heartbeat_front_addr":"172.21.15.192:6831/23242","state":["exists","up"]},{"osd":1,"uuid":"564330c6-5c45-4ef6-8718-bbfa97848e6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":22856},{"type":"v1","addr":"172.21.15.146:6801","nonce":22856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":22856},{"type":"v1","addr":"172.21.15.146:6803","nonce":22856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":22856},{"type":"v1","addr":"172.21.15.146:6807","nonce":22856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":22856},{"type":"v1","addr":"172.21.15.146:6805","nonce":22856}]},"public_addr":"172.21.15.146:6801/22856","cluster_addr":"172.21.15.146:6803/22856","heartbeat_back_addr":"172.21.15.146:6807/22856","heartbeat_front_addr":"172.21.15.146:6805/22856","state":["exists","up"]},{"osd":2,"uuid":"128ddb77-579b-4fa3-a0cb-7465ad959f3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6815","nonce":23326},{"type":"v1","addr":"172.21.15.87:6817","nonce":23326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":23326},{"type":"v1","addr":"172.21.15.87:6819","nonce":23326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":23326},{"type":"v1","addr":"172.21.15.87:6823","nonce":23326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":23326},{"type":"v1","addr":"172.21.15.87:6821","nonce":23326}]},"public_addr":"172.21.15.87:6817/23326","cluster_addr":"172.21.15.87:6819/23326","heartbeat_back_addr":"172.21.15.87:6823/23326","heartbeat_front_addr":"172.21.15.87:6821/23326","state":["exists","up"]},{"osd":3,"uuid":"4668cfdf-d172-4f30-95b8-ac842108a520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":23243},{"type":"v1","addr":"172.21.15.192:6803","nonce":23243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":23243},{"type":"v1","addr":"172.21.15.192:6805","nonce":23243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":23243},{"type":"v1","addr":"172.21.15.192:6809","nonce":23243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":23243},{"type":"v1","addr":"172.21.15.192:6807","nonce":23243}]},"public_addr":"172.21.15.192:6803/23243","cluster_addr":"172.21.15.192:6805/23243","heartbeat_back_addr":"172.21.15.192:6809/23243","heartbeat_front_addr":"172.21.15.192:6807/23243","state":["exists","up"]},{"osd":4,"uuid":"c4bc8ba5-0d22-49f5-97a6-2ca71e3a8c62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":22857},{"type":"v1","addr":"172.21.15.146:6809","nonce":22857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":22857},{"type":"v1","addr":"172.21.15.146:6811","nonce":22857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":22857},{"type":"v1","addr":"172.21.15.146:6815","nonce":22857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":22857},{"type":"v1","addr":"172.21.15.146:6813","nonce":22857}]},"public_addr":"172.21.15.146:6809/22857","cluster_addr":"172.21.15.146:6811/22857","heartbeat_back_addr":"172.21.15.146:6815/22857","heartbeat_front_addr":"172.21.15.146:6813/22857","state":["exists","up"]},{"osd":5,"uuid":"2d15f1db-e580-4715-9728-8fe5dd7e34d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":23316},{"type":"v1","addr":"172.21.15.87:6801","nonce":23316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":23316},{"type":"v1","addr":"172.21.15.87:6803","nonce":23316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":23316},{"type":"v1","addr":"172.21.15.87:6807","nonce":23316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":23316},{"type":"v1","addr":"172.21.15.87:6805","nonce":23316}]},"public_addr":"172.21.15.87:6801/23316","cluster_addr":"172.21.15.87:6803/23316","heartbeat_back_addr":"172.21.15.87:6807/23316","heartbeat_front_addr":"172.21.15.87:6805/23316","state":["exists","up"]},{"osd":6,"uuid":"a659da2b-bdce-42ac-8b30-b8c69b4c7041","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":23246},{"type":"v1","addr":"172.21.15.192:6811","nonce":23246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":23246},{"type":"v1","addr":"172.21.15.192:6813","nonce":23246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":23246},{"type":"v1","addr":"172.21.15.192:6817","nonce":23246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":23246},{"type":"v1","addr":"172.21.15.192:6815","nonce":23246}]},"public_addr":"172.21.15.192:6811/23246","cluster_addr":"172.21.15.192:6813/23246","heartbeat_back_addr":"172.21.15.192:6817/23246","heartbeat_front_addr":"172.21.15.192:6815/23246","state":["exists","up"]},{"osd":7,"uuid":"d6e41ac5-bab7-49e2-a17a-ef794bcc4a09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":22858},{"type":"v1","addr":"172.21.15.146:6818","nonce":22858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":22858},{"type":"v1","addr":"172.21.15.146:6822","nonce":22858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":22858},{"type":"v1","addr":"172.21.15.146:6830","nonce":22858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":22858},{"type":"v1","addr":"172.21.15.146:6826","nonce":22858}]},"public_addr":"172.21.15.146:6818/22858","cluster_addr":"172.21.15.146:6822/22858","heartbeat_back_addr":"172.21.15.146:6830/22858","heartbeat_front_addr":"172.21.15.146:6826/22858","state":["exists","up"]},{"osd":8,"uuid":"c4907993-7513-4162-974f-07dcb0a260a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":23333},{"type":"v1","addr":"172.21.15.87:6825","nonce":23333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":23333},{"type":"v1","addr":"172.21.15.87:6827","nonce":23333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":23333},{"type":"v1","addr":"172.21.15.87:6831","nonce":23333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":23333},{"type":"v1","addr":"172.21.15.87:6829","nonce":23333}]},"public_addr":"172.21.15.87:6825/23333","cluster_addr":"172.21.15.87:6827/23333","heartbeat_back_addr":"172.21.15.87:6831/23333","heartbeat_front_addr":"172.21.15.87:6829/23333","state":["exists","up"]},{"osd":9,"uuid":"3523676f-c9b8-47ae-86c0-4930dca17831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":23254},{"type":"v1","addr":"172.21.15.192:6819","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":23254},{"type":"v1","addr":"172.21.15.192:6821","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":23254},{"type":"v1","addr":"172.21.15.192:6825","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":23254},{"type":"v1","addr":"172.21.15.192:6823","nonce":23254}]},"public_addr":"172.21.15.192:6819/23254","cluster_addr":"172.21.15.192:6821/23254","heartbeat_back_addr":"172.21.15.192:6825/23254","heartbeat_front_addr":"172.21.15.192:6823/23254","state":["exists","up"]},{"osd":10,"uuid":"88d5c251-0bb1-4624-8fa2-7f3b74bd1bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":22859},{"type":"v1","addr":"172.21.15.146:6819","nonce":22859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6821","nonce":22859},{"type":"v1","addr":"172.21.15.146:6823","nonce":22859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":22859},{"type":"v1","addr":"172.21.15.146:6831","nonce":22859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6825","nonce":22859},{"type":"v1","addr":"172.21.15.146:6827","nonce":22859}]},"public_addr":"172.21.15.146:6819/22859","cluster_addr":"172.21.15.146:6823/22859","heartbeat_back_addr":"172.21.15.146:6831/22859","heartbeat_front_addr":"172.21.15.146:6827/22859","state":["exists","up"]},{"osd":11,"uuid":"31f650d6-ba1e-4f29-92ff-6abee04c0f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":23317},{"type":"v1","addr":"172.21.15.87:6809","nonce":23317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":23317},{"type":"v1","addr":"172.21.15.87:6811","nonce":23317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":23317},{"type":"v1","addr":"172.21.15.87:6816","nonce":23317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":23317},{"type":"v1","addr":"172.21.15.87:6813","nonce":23317}]},"public_addr":"172.21.15.87:6809/23317","cluster_addr":"172.21.15.87:6811/23317","heartbeat_back_addr":"172.21.15.87:6816/23317","heartbeat_front_addr":"172.21.15.87:6813/23317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.538863+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.552293+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.585265+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.505194+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.550032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.558089+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.565622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.587102+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.654330+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.599072+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.645833+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.596236+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T12:13:30.271 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.266+0000 7fd9e14c9700 1 -- 172.21.15.192:0/4065243036 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fd9b4080670 msgr2=0x7fd9b4082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:30.272 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.266+0000 7fd9e14c9700 1 --2- 172.21.15.192:0/4065243036 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fd9b4080670 0x7fd9b4082b30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fd9d0000c00 tx=0x7fd9d0007b80).stop 2020-11-20T12:13:30.272 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.266+0000 7fd9e14c9700 1 -- 172.21.15.192:0/4065243036 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9d40e0cb0 msgr2=0x7fd9d4052910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:30.272 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.266+0000 7fd9e14c9700 1 --2- 172.21.15.192:0/4065243036 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9d40e0cb0 0x7fd9d4052910 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fd9dc05f190 tx=0x7fd9dc088000).stop 2020-11-20T12:13:30.273 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.266+0000 7fd9e14c9700 1 -- 172.21.15.192:0/4065243036 shutdown_connections 2020-11-20T12:13:30.273 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.266+0000 7fd9e14c9700 1 --2- 172.21.15.192:0/4065243036 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fd9b4080670 0x7fd9b4082b30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:30.274 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.266+0000 7fd9e14c9700 1 --2- 172.21.15.192:0/4065243036 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9d40e0cb0 0x7fd9d4052910 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:30.274 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.266+0000 7fd9e14c9700 1 --2- 172.21.15.192:0/4065243036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9d4006f30 0x7fd9d40f3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:30.274 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.266+0000 7fd9e14c9700 1 --2- 172.21.15.192:0/4065243036 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd9d4007310 0x7fd9d40a2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:30.274 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.266+0000 7fd9e14c9700 1 -- 172.21.15.192:0/4065243036 >> 172.21.15.192:0/4065243036 conn(0x7fd9d4054470 msgr2=0x7fd9d40e4630 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:30.275 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.267+0000 7fd9e14c9700 1 -- 172.21.15.192:0/4065243036 shutdown_connections 2020-11-20T12:13:30.275 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.267+0000 7fd9e14c9700 1 -- 172.21.15.192:0/4065243036 wait complete. 2020-11-20T12:13:30.282 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-20T12:13:30.398 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.395+0000 7fc6dc9fe700 1 Processor -- start 2020-11-20T12:13:30.398 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.395+0000 7fc6dc9fe700 1 -- start start 2020-11-20T12:13:30.401 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.395+0000 7fc6dc9fe700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc6d80617f0 0x7fc6d8061bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:30.402 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.395+0000 7fc6dc9fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc6d8150560 0x7fc6d81509f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:30.402 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.395+0000 7fc6dc9fe700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6d8154610 con 0x7fc6d8151430 2020-11-20T12:13:30.402 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.395+0000 7fc6dc9fe700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6d8151fb0 con 0x7fc6d80617f0 2020-11-20T12:13:30.403 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.395+0000 7fc6dc9fe700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6d81548b0 con 0x7fc6d8150560 2020-11-20T12:13:30.403 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.396+0000 7fc6d6d9d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc6d80617f0 0x7fc6d8061bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:30.403 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.396+0000 7fc6d759e700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7fc6d8151430 0x7fc6d81518a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.192:39092/0 (socket says 172.21.15.192:39092) 2020-11-20T12:13:30.403 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.396+0000 7fc6d759e700 1 -- 172.21.15.192:0/27325601 learned_addr learned my addr 172.21.15.192:0/27325601 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T12:13:30.404 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.396+0000 7fc6d6d9d700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc6d80617f0 0x7fc6d8061bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.192:59144/0 (socket says 172.21.15.192:59144) 2020-11-20T12:13:30.404 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.396+0000 7fc6cffff700 1 --2- 172.21.15.192:0/27325601 >> v2:172.21.15.146:3300/0 conn(0x7fc6d8150560 0x7fc6d81509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:30.404 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.396+0000 7fc6d6d9d700 1 -- 172.21.15.192:0/27325601 >> v2:172.21.15.146:3300/0 conn(0x7fc6d8150560 msgr2=0x7fc6d81509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:30.405 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.396+0000 7fc6d6d9d700 1 --2- 172.21.15.192:0/27325601 >> v2:172.21.15.146:3300/0 conn(0x7fc6d8150560 0x7fc6d81509f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:30.405 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.396+0000 7fc6d6d9d700 1 -- 172.21.15.192:0/27325601 >> v1:172.21.15.87:6789/0 conn(0x7fc6d8151430 legacy=0x7fc6d81518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:30.405 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.396+0000 7fc6d659c700 1 -- 172.21.15.192:0/27325601 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2202761129 0 0) 0x7fc6d8154610 con 0x7fc6d8151430 2020-11-20T12:13:30.406 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.396+0000 7fc6d6d9d700 1 -- 172.21.15.192:0/27325601 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d8154b50 con 0x7fc6d80617f0 2020-11-20T12:13:30.406 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.396+0000 7fc6cffff700 1 --2- 172.21.15.192:0/27325601 >> v2:172.21.15.146:3300/0 conn(0x7fc6d8150560 0x7fc6d81509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:13:30.406 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.396+0000 7fc6d6d9d700 1 --2- 172.21.15.192:0/27325601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6d80617f0 0x7fc6d8061bd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fc6d80620c0 tx=0x7fc6c8006e30).ready entity=mon.0 client_cookie=535304ad11653d13 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:30.407 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.396+0000 7fc6d659c700 1 -- 172.21.15.192:0/27325601 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c8009840 con 0x7fc6d80617f0 2020-11-20T12:13:30.407 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.396+0000 7fc6d659c700 1 -- 172.21.15.192:0/27325601 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c8000e90 con 0x7fc6d80617f0 2020-11-20T12:13:30.407 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.396+0000 7fc6d659c700 1 -- 172.21.15.192:0/27325601 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c8009bb0 con 0x7fc6d80617f0 2020-11-20T12:13:30.408 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.397+0000 7fc6dc9fe700 1 -- 172.21.15.192:0/27325601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6d80617f0 msgr2=0x7fc6d8061bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:30.408 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.397+0000 7fc6dc9fe700 1 --2- 172.21.15.192:0/27325601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6d80617f0 0x7fc6d8061bd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fc6d80620c0 tx=0x7fc6c8006e30).stop 2020-11-20T12:13:30.408 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.397+0000 7fc6dc9fe700 1 -- 172.21.15.192:0/27325601 shutdown_connections 2020-11-20T12:13:30.408 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.397+0000 7fc6dc9fe700 1 --2- 172.21.15.192:0/27325601 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6d80617f0 0x7fc6d8061bd0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:30.409 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.397+0000 7fc6dc9fe700 1 --2- 172.21.15.192:0/27325601 >> v2:172.21.15.146:3300/0 conn(0x7fc6d8150560 0x7fc6d81509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:30.409 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.397+0000 7fc6dc9fe700 1 -- 172.21.15.192:0/27325601 >> 172.21.15.192:0/27325601 conn(0x7fc6d80c77f0 msgr2=0x7fc6d80c7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:30.409 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.397+0000 7fc6dc9fe700 1 -- 172.21.15.192:0/27325601 shutdown_connections 2020-11-20T12:13:30.409 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.397+0000 7fc6dc9fe700 1 -- 172.21.15.192:0/27325601 wait complete. 2020-11-20T12:13:30.410 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.398+0000 7fc6dc9fe700 1 Processor -- start 2020-11-20T12:13:30.410 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.398+0000 7fc6dc9fe700 1 -- start start 2020-11-20T12:13:30.413 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.399+0000 7fc6dc9fe700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6d80617f0 0x7fc6d80c0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:30.413 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.399+0000 7fc6dc9fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6d8150560 0x7fc6d814cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:30.413 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.399+0000 7fc6dc9fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6d8151430 0x7fc6d80c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:30.414 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.399+0000 7fc6dc9fe700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d814ff80 con 0x7fc6d80617f0 2020-11-20T12:13:30.414 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.399+0000 7fc6dc9fe700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d80c1200 con 0x7fc6d8150560 2020-11-20T12:13:30.414 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.399+0000 7fc6dc9fe700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d814e190 con 0x7fc6d8151430 2020-11-20T12:13:30.414 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.399+0000 7fc6d759e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6d8151430 0x7fc6d80c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:30.415 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.399+0000 7fc6d759e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6d8151430 0x7fc6d80c5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49714/0 (socket says 172.21.15.192:49714) 2020-11-20T12:13:30.415 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.399+0000 7fc6d759e700 1 -- 172.21.15.192:0/4277196227 learned_addr learned my addr 172.21.15.192:0/4277196227 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:30.415 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.399+0000 7fc6d6d9d700 1 --2- 172.21.15.192:0/4277196227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6d80617f0 0x7fc6d80c0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:30.415 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.399+0000 7fc6cffff700 1 --2- 172.21.15.192:0/4277196227 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6d8150560 0x7fc6d814cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:30.416 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.399+0000 7fc6d759e700 1 -- 172.21.15.192:0/4277196227 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6d8150560 msgr2=0x7fc6d814cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:30.416 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.399+0000 7fc6d759e700 1 --2- 172.21.15.192:0/4277196227 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6d8150560 0x7fc6d814cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:30.416 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.399+0000 7fc6d759e700 1 -- 172.21.15.192:0/4277196227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6d80617f0 msgr2=0x7fc6d80c0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:30.416 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.399+0000 7fc6d759e700 1 --2- 172.21.15.192:0/4277196227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6d80617f0 0x7fc6d80c0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:30.417 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.399+0000 7fc6d759e700 1 -- 172.21.15.192:0/4277196227 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d814e430 con 0x7fc6d8151430 2020-11-20T12:13:30.417 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.399+0000 7fc6d759e700 1 --2- 172.21.15.192:0/4277196227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6d8151430 0x7fc6d80c5d70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fc6d000cab0 tx=0x7fc6d0007dc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:30.417 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.399+0000 7fc6ceffd700 1 -- 172.21.15.192:0/4277196227 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d000ce90 con 0x7fc6d8151430 2020-11-20T12:13:30.417 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.400+0000 7fc6ceffd700 1 -- 172.21.15.192:0/4277196227 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d0005bc0 con 0x7fc6d8151430 2020-11-20T12:13:30.417 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.400+0000 7fc6dc9fe700 1 -- 172.21.15.192:0/4277196227 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6d814e6d0 con 0x7fc6d8151430 2020-11-20T12:13:30.418 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.400+0000 7fc6ceffd700 1 -- 172.21.15.192:0/4277196227 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0007110 con 0x7fc6d8151430 2020-11-20T12:13:30.418 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.400+0000 7fc6dc9fe700 1 -- 172.21.15.192:0/4277196227 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d80c0f60 con 0x7fc6d8151430 2020-11-20T12:13:30.418 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.400+0000 7fc6dc9fe700 1 -- 172.21.15.192:0/4277196227 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6d80c5b70 con 0x7fc6d8151430 2020-11-20T12:13:30.419 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.401+0000 7fc6ceffd700 1 -- 172.21.15.192:0/4277196227 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fc6d0010030 con 0x7fc6d8151430 2020-11-20T12:13:30.419 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.401+0000 7fc6ceffd700 1 --2- 172.21.15.192:0/4277196227 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fc6b4080670 0x7fc6b4082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:30.419 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.402+0000 7fc6ceffd700 1 -- 172.21.15.192:0/4277196227 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fc6d00a28c0 con 0x7fc6d8151430 2020-11-20T12:13:30.419 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.402+0000 7fc6d6d9d700 1 --2- 172.21.15.192:0/4277196227 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fc6b4080670 0x7fc6b4082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:30.419 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.402+0000 7fc6d6d9d700 1 --2- 172.21.15.192:0/4277196227 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fc6b4080670 0x7fc6b4082b30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fc6c8006e70 tx=0x7fc6c8015000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:30.420 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.405+0000 7fc6ceffd700 1 -- 172.21.15.192:0/4277196227 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fc6d00772d0 con 0x7fc6d8151430 2020-11-20T12:13:30.543 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.540+0000 7fc6dc9fe700 1 -- 172.21.15.192:0/4277196227 --> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc6d805ca80 con 0x7fc6b4080670 2020-11-20T12:13:30.551 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.547+0000 7fc6ceffd700 1 -- 172.21.15.192:0/4277196227 <== mgr.4106 v2:172.21.15.192:6800/22925 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+149897 (secure 0 0 0) 0x7fc6d805ca80 con 0x7fc6b4080670 2020-11-20T12:13:30.551 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T12:13:30.555 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.549+0000 7fc6dc9fe700 1 -- 172.21.15.192:0/4277196227 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fc6b4080670 msgr2=0x7fc6b4082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:30.556 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.549+0000 7fc6dc9fe700 1 --2- 172.21.15.192:0/4277196227 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fc6b4080670 0x7fc6b4082b30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fc6c8006e70 tx=0x7fc6c8015000).stop 2020-11-20T12:13:30.556 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.549+0000 7fc6dc9fe700 1 -- 172.21.15.192:0/4277196227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6d8151430 msgr2=0x7fc6d80c5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:30.556 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.549+0000 7fc6dc9fe700 1 --2- 172.21.15.192:0/4277196227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6d8151430 0x7fc6d80c5d70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fc6d000cab0 tx=0x7fc6d0007dc0).stop 2020-11-20T12:13:30.556 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.549+0000 7fc6dc9fe700 1 -- 172.21.15.192:0/4277196227 shutdown_connections 2020-11-20T12:13:30.556 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.549+0000 7fc6dc9fe700 1 --2- 172.21.15.192:0/4277196227 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fc6b4080670 0x7fc6b4082b30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:30.557 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.549+0000 7fc6dc9fe700 1 --2- 172.21.15.192:0/4277196227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6d8151430 0x7fc6d80c5d70 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:30.557 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.549+0000 7fc6dc9fe700 1 --2- 172.21.15.192:0/4277196227 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc6d80617f0 0x7fc6d80c0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:30.557 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.549+0000 7fc6dc9fe700 1 --2- 172.21.15.192:0/4277196227 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6d8150560 0x7fc6d814cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:30.557 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.549+0000 7fc6dc9fe700 1 -- 172.21.15.192:0/4277196227 >> 172.21.15.192:0/4277196227 conn(0x7fc6d80c77f0 msgr2=0x7fc6d805bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:30.558 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.549+0000 7fc6dc9fe700 1 -- 172.21.15.192:0/4277196227 shutdown_connections 2020-11-20T12:13:30.558 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.549+0000 7fc6dc9fe700 1 -- 172.21.15.192:0/4277196227 wait complete. 2020-11-20T12:13:30.558 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2020-11-20T12:13:30.564 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":784,"stamp":"2020-11-20T12:13:28.610554+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":444241426,"num_objects":880,"num_object_clones":0,"num_object_copies":3114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":880,"num_whiteouts":0,"num_read":13763,"num_read_kb":740826,"num_write":315597,"num_write_kb":5399822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":137,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160725,"ondisk_log_size":160725,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":3966816,"kb_used_data":549964,"kb_used_omap":0,"kb_used_meta":3416704,"kb_avail":1128495264,"statfs":{"total":1159641169920,"available":1155579150336,"internally_reserved":0,"allocated":563163136,"data_stored":850581773,"data_compressed":70823863,"data_compressed_allocated":289386496,"data_compressed_original":578772992,"omap_allocated":0,"internal_metadata":3498704896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2,2,4,8,7,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27554370,"num_objects":-132,"num_object_clones":0,"num_object_copies":-540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-132,"num_whiteouts":0,"num_read":115,"num_read_kb":6302,"num_write":2845,"num_write_kb":72703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002292"},"pg_stats":[{"pgid":"4.2","version":"28'28039","reported_seq":"29297","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:23.997404+0000","last_change":"2020-11-20T11:48:09.603681+0000","last_active":"2020-11-20T12:13:23.997404+0000","last_peered":"2020-11-20T12:13:23.997404+0000","last_clean":"2020-11-20T12:13:23.997404+0000","last_became_active":"2020-11-20T11:48:09.603149+0000","last_became_peered":"2020-11-20T11:48:09.603149+0000","last_unstale":"2020-11-20T12:13:23.997404+0000","last_undegraded":"2020-11-20T12:13:23.997404+0000","last_fullsized":"2020-11-20T12:13:23.997404+0000","mapping_epoch":26,"log_start":"28'17954","ondisk_log_start":"28'17954","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_clean_scrub_stamp":"2020-11-20T11:48:08.486179+0000","log_size":10085,"ondisk_log_size":10085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":29242813,"num_objects":93,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":1247,"num_read_kb":71900,"num_write":20066,"num_write_kb":534067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4,7],"acting":[1,8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.493100+0000","last_change":"2020-11-20T11:48:03.440989+0000","last_active":"2020-11-20T11:48:09.493100+0000","last_peered":"2020-11-20T11:48:09.493100+0000","last_clean":"2020-11-20T11:48:09.493100+0000","last_became_active":"2020-11-20T11:48:03.440545+0000","last_became_peered":"2020-11-20T11:48:03.440545+0000","last_unstale":"2020-11-20T11:48:09.493100+0000","last_undegraded":"2020-11-20T11:48:09.493100+0000","last_fullsized":"2020-11-20T11:48:09.493100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_clean_scrub_stamp":"2020-11-20T11:48:02.343998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10],"acting":[9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"28'26290","reported_seq":"26301","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:19.850271+0000","last_change":"2020-11-20T11:48:06.484654+0000","last_active":"2020-11-20T12:13:19.850271+0000","last_peered":"2020-11-20T12:13:19.850271+0000","last_clean":"2020-11-20T12:13:19.850271+0000","last_became_active":"2020-11-20T11:48:06.484261+0000","last_became_peered":"2020-11-20T11:48:06.484261+0000","last_unstale":"2020-11-20T12:13:19.850271+0000","last_undegraded":"2020-11-20T12:13:19.850271+0000","last_fullsized":"2020-11-20T12:13:19.850271+0000","mapping_epoch":23,"log_start":"28'16200","ondisk_log_start":"28'16200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_clean_scrub_stamp":"2020-11-20T11:48:05.473687+0000","log_size":10090,"ondisk_log_size":10090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971680,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":26381,"num_write_kb":171628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'26887","reported_seq":"28234","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:24.500498+0000","last_change":"2020-11-20T11:48:09.601081+0000","last_active":"2020-11-20T12:13:24.500498+0000","last_peered":"2020-11-20T12:13:24.500498+0000","last_clean":"2020-11-20T12:13:24.500498+0000","last_became_active":"2020-11-20T11:48:09.600693+0000","last_became_peered":"2020-11-20T11:48:09.600693+0000","last_unstale":"2020-11-20T12:13:24.500498+0000","last_undegraded":"2020-11-20T12:13:24.500498+0000","last_fullsized":"2020-11-20T12:13:24.500498+0000","mapping_epoch":26,"log_start":"28'16867","ondisk_log_start":"28'16867","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_clean_scrub_stamp":"2020-11-20T11:48:08.486179+0000","log_size":10020,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28199686,"num_objects":93,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":1336,"num_read_kb":87000,"num_write":19050,"num_write_kb":538715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,8,10],"acting":[6,0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.495347+0000","last_change":"2020-11-20T11:48:03.364301+0000","last_active":"2020-11-20T11:48:09.495347+0000","last_peered":"2020-11-20T11:48:09.495347+0000","last_clean":"2020-11-20T11:48:09.495347+0000","last_became_active":"2020-11-20T11:48:03.364003+0000","last_became_peered":"2020-11-20T11:48:03.364003+0000","last_unstale":"2020-11-20T11:48:09.495347+0000","last_undegraded":"2020-11-20T11:48:09.495347+0000","last_fullsized":"2020-11-20T11:48:09.495347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_clean_scrub_stamp":"2020-11-20T11:48:02.343998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"28'22107","reported_seq":"22118","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:11.768863+0000","last_change":"2020-11-20T11:48:06.628946+0000","last_active":"2020-11-20T12:13:11.768863+0000","last_peered":"2020-11-20T12:13:11.768863+0000","last_clean":"2020-11-20T12:13:11.768863+0000","last_became_active":"2020-11-20T11:48:06.628670+0000","last_became_peered":"2020-11-20T11:48:06.628670+0000","last_unstale":"2020-11-20T12:13:11.768863+0000","last_undegraded":"2020-11-20T12:13:11.768863+0000","last_fullsized":"2020-11-20T12:13:11.768863+0000","mapping_epoch":23,"log_start":"28'12100","ondisk_log_start":"28'12100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_clean_scrub_stamp":"2020-11-20T11:48:05.473687+0000","log_size":10007,"ondisk_log_size":10007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":37748770,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":22160,"num_write_kb":164436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.7","version":"28'26077","reported_seq":"27608","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:24.474292+0000","last_change":"2020-11-20T11:48:09.598612+0000","last_active":"2020-11-20T12:13:24.474292+0000","last_peered":"2020-11-20T12:13:24.474292+0000","last_clean":"2020-11-20T12:13:24.474292+0000","last_became_active":"2020-11-20T11:48:09.598147+0000","last_became_peered":"2020-11-20T11:48:09.598147+0000","last_unstale":"2020-11-20T12:13:24.474292+0000","last_undegraded":"2020-11-20T12:13:24.474292+0000","last_fullsized":"2020-11-20T12:13:24.474292+0000","mapping_epoch":26,"log_start":"28'16065","ondisk_log_start":"28'16065","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_clean_scrub_stamp":"2020-11-20T11:48:08.486179+0000","log_size":10012,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24233700,"num_objects":79,"num_object_clones":0,"num_object_copies":316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":1520,"num_read_kb":90522,"num_write":18172,"num_write_kb":561050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5,0],"acting":[6,1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.492302+0000","last_change":"2020-11-20T11:48:03.436692+0000","last_active":"2020-11-20T11:48:09.492302+0000","last_peered":"2020-11-20T11:48:09.492302+0000","last_clean":"2020-11-20T11:48:09.492302+0000","last_became_active":"2020-11-20T11:48:03.436251+0000","last_became_peered":"2020-11-20T11:48:03.436251+0000","last_unstale":"2020-11-20T11:48:09.492302+0000","last_undegraded":"2020-11-20T11:48:09.492302+0000","last_fullsized":"2020-11-20T11:48:09.492302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_clean_scrub_stamp":"2020-11-20T11:48:02.343998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"28'18822","reported_seq":"18834","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:19.402833+0000","last_change":"2020-11-20T11:48:06.645759+0000","last_active":"2020-11-20T12:13:19.402833+0000","last_peered":"2020-11-20T12:13:19.402833+0000","last_clean":"2020-11-20T12:13:19.402833+0000","last_became_active":"2020-11-20T11:48:06.645318+0000","last_became_peered":"2020-11-20T11:48:06.645318+0000","last_unstale":"2020-11-20T12:13:19.402833+0000","last_undegraded":"2020-11-20T12:13:19.402833+0000","last_fullsized":"2020-11-20T12:13:19.402833+0000","mapping_epoch":23,"log_start":"28'8800","ondisk_log_start":"28'8800","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_clean_scrub_stamp":"2020-11-20T11:48:05.473687+0000","log_size":10022,"ondisk_log_size":10022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":18937,"num_write_kb":142544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"28'26437","reported_seq":"27726","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:23.361801+0000","last_change":"2020-11-20T11:48:09.600841+0000","last_active":"2020-11-20T12:13:23.361801+0000","last_peered":"2020-11-20T12:13:23.361801+0000","last_clean":"2020-11-20T12:13:23.361801+0000","last_became_active":"2020-11-20T11:48:09.600181+0000","last_became_peered":"2020-11-20T11:48:09.600181+0000","last_unstale":"2020-11-20T12:13:23.361801+0000","last_undegraded":"2020-11-20T12:13:23.361801+0000","last_fullsized":"2020-11-20T12:13:23.361801+0000","mapping_epoch":26,"log_start":"28'16347","ondisk_log_start":"28'16347","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_clean_scrub_stamp":"2020-11-20T11:48:08.486179+0000","log_size":10090,"ondisk_log_size":10090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28001578,"num_objects":100,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1278,"num_read_kb":79856,"num_write":18538,"num_write_kb":484874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,4,11],"acting":[5,10,4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.598292+0000","last_change":"2020-11-20T11:48:03.361972+0000","last_active":"2020-11-20T11:48:09.598292+0000","last_peered":"2020-11-20T11:48:09.598292+0000","last_clean":"2020-11-20T11:48:09.598292+0000","last_became_active":"2020-11-20T11:48:03.361549+0000","last_became_peered":"2020-11-20T11:48:03.361549+0000","last_unstale":"2020-11-20T11:48:09.598292+0000","last_undegraded":"2020-11-20T11:48:09.598292+0000","last_fullsized":"2020-11-20T11:48:09.598292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_clean_scrub_stamp":"2020-11-20T11:48:02.343998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"1.0","version":"18'3","reported_seq":"21","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.597862+0000","last_change":"2020-11-20T11:47:58.639760+0000","last_active":"2020-11-20T11:48:09.597862+0000","last_peered":"2020-11-20T11:48:09.597862+0000","last_clean":"2020-11-20T11:48:09.597862+0000","last_became_active":"2020-11-20T11:47:58.639096+0000","last_became_peered":"2020-11-20T11:47:58.639096+0000","last_unstale":"2020-11-20T11:48:09.597862+0000","last_undegraded":"2020-11-20T11:48:09.597862+0000","last_fullsized":"2020-11-20T11:48:09.597862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:47:52.386743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:47:52.386743+0000","last_clean_scrub_stamp":"2020-11-20T11:47:52.386743+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"28'23085","reported_seq":"23096","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:02.674207+0000","last_change":"2020-11-20T11:48:06.725267+0000","last_active":"2020-11-20T12:13:02.674207+0000","last_peered":"2020-11-20T12:13:02.674207+0000","last_clean":"2020-11-20T12:13:02.674207+0000","last_became_active":"2020-11-20T11:48:06.724982+0000","last_became_peered":"2020-11-20T11:48:06.724982+0000","last_unstale":"2020-11-20T12:13:02.674207+0000","last_undegraded":"2020-11-20T12:13:02.674207+0000","last_fullsized":"2020-11-20T12:13:02.674207+0000","mapping_epoch":23,"log_start":"28'13000","ondisk_log_start":"28'13000","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_clean_scrub_stamp":"2020-11-20T11:48:05.473687+0000","log_size":10085,"ondisk_log_size":10085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":37748736,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":23132,"num_write_kb":169301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"28'26351","reported_seq":"28404","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:24.245617+0000","last_change":"2020-11-20T11:48:09.600385+0000","last_active":"2020-11-20T12:13:24.245617+0000","last_peered":"2020-11-20T12:13:24.245617+0000","last_clean":"2020-11-20T12:13:24.245617+0000","last_became_active":"2020-11-20T11:48:09.599710+0000","last_became_peered":"2020-11-20T11:48:09.599710+0000","last_unstale":"2020-11-20T12:13:24.245617+0000","last_undegraded":"2020-11-20T12:13:24.245617+0000","last_fullsized":"2020-11-20T12:13:24.245617+0000","mapping_epoch":26,"log_start":"28'16349","ondisk_log_start":"28'16349","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_clean_scrub_stamp":"2020-11-20T11:48:08.486179+0000","log_size":10002,"ondisk_log_size":10002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34628196,"num_objects":103,"num_object_clones":0,"num_object_copies":412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":0,"num_read":2042,"num_read_kb":123354,"num_write":18356,"num_write_kb":485714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6,11],"acting":[10,9,6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.597758+0000","last_change":"2020-11-20T11:48:03.438147+0000","last_active":"2020-11-20T11:48:09.597758+0000","last_peered":"2020-11-20T11:48:09.597758+0000","last_clean":"2020-11-20T11:48:09.597758+0000","last_became_active":"2020-11-20T11:48:03.437759+0000","last_became_peered":"2020-11-20T11:48:03.437759+0000","last_unstale":"2020-11-20T11:48:09.597758+0000","last_undegraded":"2020-11-20T11:48:09.597758+0000","last_fullsized":"2020-11-20T11:48:09.597758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_clean_scrub_stamp":"2020-11-20T11:48:02.343998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"28'15761","reported_seq":"16635","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:12:49.017655+0000","last_change":"2020-11-20T11:48:06.485245+0000","last_active":"2020-11-20T12:12:49.017655+0000","last_peered":"2020-11-20T12:12:49.017655+0000","last_clean":"2020-11-20T12:12:49.017655+0000","last_became_active":"2020-11-20T11:48:06.484857+0000","last_became_peered":"2020-11-20T11:48:06.484857+0000","last_unstale":"2020-11-20T12:12:49.017655+0000","last_undegraded":"2020-11-20T12:12:49.017655+0000","last_fullsized":"2020-11-20T12:12:49.017655+0000","mapping_epoch":23,"log_start":"28'5700","ondisk_log_start":"28'5700","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_clean_scrub_stamp":"2020-11-20T11:48:05.473687+0000","log_size":10061,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25165824,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":863,"num_read_kb":4704,"num_write":15790,"num_write_kb":119765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"28'26275","reported_seq":"28298","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:24.032130+0000","last_change":"2020-11-20T11:48:09.601300+0000","last_active":"2020-11-20T12:13:24.032130+0000","last_peered":"2020-11-20T12:13:24.032130+0000","last_clean":"2020-11-20T12:13:24.032130+0000","last_became_active":"2020-11-20T11:48:09.599735+0000","last_became_peered":"2020-11-20T11:48:09.599735+0000","last_unstale":"2020-11-20T12:13:24.032130+0000","last_undegraded":"2020-11-20T12:13:24.032130+0000","last_fullsized":"2020-11-20T12:13:24.032130+0000","mapping_epoch":26,"log_start":"28'16255","ondisk_log_start":"28'16255","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_clean_scrub_stamp":"2020-11-20T11:48:08.486179+0000","log_size":10020,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25164414,"num_objects":85,"num_object_clones":0,"num_object_copies":340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":2012,"num_read_kb":122872,"num_write":18253,"num_write_kb":512835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,11,6],"acting":[1,4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.596913+0000","last_change":"2020-11-20T11:48:03.435827+0000","last_active":"2020-11-20T11:48:09.596913+0000","last_peered":"2020-11-20T11:48:09.596913+0000","last_clean":"2020-11-20T11:48:09.596913+0000","last_became_active":"2020-11-20T11:48:03.435438+0000","last_became_peered":"2020-11-20T11:48:03.435438+0000","last_unstale":"2020-11-20T11:48:09.596913+0000","last_undegraded":"2020-11-20T11:48:09.596913+0000","last_fullsized":"2020-11-20T11:48:09.596913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_clean_scrub_stamp":"2020-11-20T11:48:02.343998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"28'21897","reported_seq":"22442","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:24.135111+0000","last_change":"2020-11-20T11:48:06.484739+0000","last_active":"2020-11-20T12:13:24.135111+0000","last_peered":"2020-11-20T12:13:24.135111+0000","last_clean":"2020-11-20T12:13:24.135111+0000","last_became_active":"2020-11-20T11:48:06.484250+0000","last_became_peered":"2020-11-20T11:48:06.484250+0000","last_unstale":"2020-11-20T12:13:24.135111+0000","last_undegraded":"2020-11-20T12:13:24.135111+0000","last_fullsized":"2020-11-20T12:13:24.135111+0000","mapping_epoch":23,"log_start":"28'11800","ondisk_log_start":"28'11800","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_clean_scrub_stamp":"2020-11-20T11:48:05.473687+0000","log_size":10097,"ondisk_log_size":10097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":58125879,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":534,"num_read_kb":3866,"num_write":21953,"num_write_kb":180308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"28'27168","reported_seq":"28367","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:23.327269+0000","last_change":"2020-11-20T11:48:09.599059+0000","last_active":"2020-11-20T12:13:23.327269+0000","last_peered":"2020-11-20T12:13:23.327269+0000","last_clean":"2020-11-20T12:13:23.327269+0000","last_became_active":"2020-11-20T11:48:09.598112+0000","last_became_peered":"2020-11-20T11:48:09.598112+0000","last_unstale":"2020-11-20T12:13:23.327269+0000","last_undegraded":"2020-11-20T12:13:23.327269+0000","last_fullsized":"2020-11-20T12:13:23.327269+0000","mapping_epoch":26,"log_start":"28'17156","ondisk_log_start":"28'17156","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_clean_scrub_stamp":"2020-11-20T11:48:08.486179+0000","log_size":10012,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25405952,"num_objects":95,"num_object_clones":0,"num_object_copies":380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":1188,"num_read_kb":87936,"num_write":19381,"num_write_kb":508104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"28'14057","reported_seq":"14665","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:12:53.968880+0000","last_change":"2020-11-20T11:48:06.645335+0000","last_active":"2020-11-20T12:12:53.968880+0000","last_peered":"2020-11-20T12:12:53.968880+0000","last_clean":"2020-11-20T12:12:53.968880+0000","last_became_active":"2020-11-20T11:48:06.644950+0000","last_became_peered":"2020-11-20T11:48:06.644950+0000","last_unstale":"2020-11-20T12:12:53.968880+0000","last_undegraded":"2020-11-20T12:12:53.968880+0000","last_fullsized":"2020-11-20T12:12:53.968880+0000","mapping_epoch":23,"log_start":"28'4000","ondisk_log_start":"28'4000","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_clean_scrub_stamp":"2020-11-20T11:48:05.473687+0000","log_size":10057,"ondisk_log_size":10057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":29360703,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":602,"num_read_kb":4468,"num_write":14180,"num_write_kb":107079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.493229+0000","last_change":"2020-11-20T11:48:03.441004+0000","last_active":"2020-11-20T11:48:09.493229+0000","last_peered":"2020-11-20T11:48:09.493229+0000","last_clean":"2020-11-20T11:48:09.493229+0000","last_became_active":"2020-11-20T11:48:03.440579+0000","last_became_peered":"2020-11-20T11:48:03.440579+0000","last_unstale":"2020-11-20T11:48:09.493229+0000","last_undegraded":"2020-11-20T11:48:09.493229+0000","last_fullsized":"2020-11-20T11:48:09.493229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_clean_scrub_stamp":"2020-11-20T11:48:02.343998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10],"acting":[9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1","version":"28'27289","reported_seq":"28428","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:27.216343+0000","last_change":"2020-11-20T11:48:09.625378+0000","last_active":"2020-11-20T12:13:27.216343+0000","last_peered":"2020-11-20T12:13:27.216343+0000","last_clean":"2020-11-20T12:13:27.216343+0000","last_became_active":"2020-11-20T11:48:09.624778+0000","last_became_peered":"2020-11-20T11:48:09.624778+0000","last_unstale":"2020-11-20T12:13:27.216343+0000","last_undegraded":"2020-11-20T12:13:27.216343+0000","last_fullsized":"2020-11-20T12:13:27.216343+0000","mapping_epoch":26,"log_start":"28'17276","ondisk_log_start":"28'17276","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_clean_scrub_stamp":"2020-11-20T11:48:08.486179+0000","log_size":10013,"ondisk_log_size":10013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6689063,"num_objects":29,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":1128,"num_read_kb":64348,"num_write":19452,"num_write_kb":566162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,11,8],"acting":[4,2,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.597648+0000","last_change":"2020-11-20T11:48:03.359921+0000","last_active":"2020-11-20T11:48:09.597648+0000","last_peered":"2020-11-20T11:48:09.597648+0000","last_clean":"2020-11-20T11:48:09.597648+0000","last_became_active":"2020-11-20T11:48:03.359617+0000","last_became_peered":"2020-11-20T11:48:03.359617+0000","last_unstale":"2020-11-20T11:48:09.597648+0000","last_undegraded":"2020-11-20T11:48:09.597648+0000","last_fullsized":"2020-11-20T11:48:09.597648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_clean_scrub_stamp":"2020-11-20T11:48:02.343998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.6","version":"28'21149","reported_seq":"21160","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:14.040382+0000","last_change":"2020-11-20T11:48:06.484350+0000","last_active":"2020-11-20T12:13:14.040382+0000","last_peered":"2020-11-20T12:13:14.040382+0000","last_clean":"2020-11-20T12:13:14.040382+0000","last_became_active":"2020-11-20T11:48:06.483910+0000","last_became_peered":"2020-11-20T11:48:06.483910+0000","last_unstale":"2020-11-20T12:13:14.040382+0000","last_undegraded":"2020-11-20T12:13:14.040382+0000","last_fullsized":"2020-11-20T12:13:14.040382+0000","mapping_epoch":23,"log_start":"28'11100","ondisk_log_start":"28'11100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_clean_scrub_stamp":"2020-11-20T11:48:05.473687+0000","log_size":10049,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25165824,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21793,"num_write_kb":153225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":201565402,"num_objects":677,"num_object_clones":0,"num_object_copies":2708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":677,"num_whiteouts":0,"num_read":11751,"num_read_kb":727788,"num_write":151268,"num_write_kb":4191521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":177008640,"data_stored":346832896,"data_compressed":16584400,"data_compressed_allocated":169824256,"data_compressed_original":339648512,"omap_allocated":0,"internal_metadata":0},"log_size":80254,"ondisk_log_size":80254,"up":32,"acting":32,"num_store_stats":12},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":242676024,"num_objects":200,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":0,"num_read":2012,"num_read_kb":13038,"num_write":164326,"num_write_kb":1208286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":134,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":373223424,"data_stored":486041362,"data_compressed":53393263,"data_compressed_allocated":112877568,"data_compressed_original":225755136,"omap_allocated":0,"internal_metadata":0},"log_size":80468,"ondisk_log_size":80468,"up":16,"acting":16,"num_store_stats":9},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":10}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444339,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":473400,"kb_used_data":79600,"kb_used_omap":0,"kb_used_meta":393792,"kb_avail":93898440,"statfs":{"total":96636764160,"available":96152002560,"internally_reserved":0,"allocated":81510400,"data_stored":123966269,"data_compressed":8957117,"data_compressed_allocated":42618880,"data_compressed_original":85237760,"omap_allocated":0,"internal_metadata":403243008},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":1.1359999999999999,"15min":0.99199999999999999},"min":{"1min":0.57499999999999996,"5min":0.55600000000000005,"15min":0.53300000000000003},"max":{"1min":2.323,"5min":12.345000000000001,"15min":12.345000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":1.419,"5min":1.1990000000000001,"15min":1.0589999999999999},"min":{"1min":0.628,"5min":0.57799999999999996,"15min":0.54800000000000004},"max":{"1min":3.722,"5min":12.679,"15min":12.679},"last":0.753}]},{"osd":1,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.143,"15min":1.1930000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58099999999999996},"max":{"1min":4.1580000000000004,"5min":12.709,"15min":12.709},"last":0.67600000000000005},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.379,"15min":2.9710000000000001},"min":{"1min":0.628,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.3180000000000001,"5min":12.489000000000001,"15min":285.29500000000002},"last":1.085}]},{"osd":2,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.393,"15min":1.224},"min":{"1min":0.69699999999999995,"5min":0.56999999999999995,"15min":0.55600000000000005},"max":{"1min":4.4950000000000001,"5min":12.311,"15min":12.311},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.528,"5min":1.399,"15min":1.246},"min":{"1min":0.67200000000000004,"5min":0.624,"15min":0.59099999999999997},"max":{"1min":4.9370000000000003,"5min":12.285,"15min":12.285},"last":0.97699999999999998}]},{"osd":3,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.5,"15min":1.742},"min":{"1min":0.80500000000000005,"5min":0.621,"15min":0.621},"max":{"1min":4.4219999999999997,"5min":12.523999999999999,"15min":90.236999999999995},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.6319999999999999,"15min":1.8540000000000001},"min":{"1min":0.95799999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":2.4159999999999999,"5min":12.629,"15min":90.265000000000001},"last":0.89700000000000002}]},{"osd":4,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.849,"15min":2.113},"min":{"1min":0.83299999999999996,"5min":0.81499999999999995,"15min":0.76800000000000002},"max":{"1min":2.7869999999999999,"5min":12.944000000000001,"15min":120.355},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.9770000000000001,"5min":1.829,"15min":1.6379999999999999},"min":{"1min":1.0289999999999999,"5min":0.89900000000000002,"15min":0.79500000000000004},"max":{"1min":5.242,"5min":12.964,"15min":12.964},"last":1.0509999999999999}]},{"osd":5,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":1.7110000000000001,"5min":1.7430000000000001,"15min":1.593},"min":{"1min":0.83099999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":4.6360000000000001,"5min":12.843999999999999,"15min":12.843999999999999},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.849,"5min":1.9530000000000001,"15min":1.9650000000000001},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.85699999999999998},"max":{"1min":5.2949999999999999,"5min":13.067,"15min":68.132000000000005},"last":1.2150000000000001}]},{"osd":6,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":1.883,"5min":1.7669999999999999,"15min":1.782},"min":{"1min":1.157,"5min":1.0649999999999999,"15min":1.0189999999999999},"max":{"1min":4.3730000000000002,"5min":12.826000000000001,"15min":12.826000000000001},"last":1.482},{"interface":"front","average":{"1min":1.768,"5min":1.829,"15min":1.7190000000000001},"min":{"1min":1.0669999999999999,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":4.5309999999999997,"5min":12.98,"15min":12.98},"last":1.2370000000000001}]},{"osd":7,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":2.1139999999999999,"5min":1.978,"15min":1.857},"min":{"1min":1.292,"5min":0.96699999999999997,"15min":0.96699999999999997},"max":{"1min":4.6139999999999999,"5min":13.167999999999999,"15min":13.167999999999999},"last":1.603},{"interface":"front","average":{"1min":2.0470000000000002,"5min":2.105,"15min":1.946},"min":{"1min":1.139,"5min":1.0860000000000001,"15min":1.0860000000000001},"max":{"1min":4.7380000000000004,"5min":13.102,"15min":13.102},"last":1.349}]},{"osd":8,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":1.6459999999999999,"5min":1.9750000000000001,"15min":1.8360000000000001},"min":{"1min":1.179,"5min":1.141,"15min":1.016},"max":{"1min":2.5539999999999998,"5min":13.148,"15min":13.148},"last":1.333},{"interface":"front","average":{"1min":2.153,"5min":1.9299999999999999,"15min":1.8200000000000001},"min":{"1min":1.2569999999999999,"5min":1.0680000000000001,"15min":1.0389999999999999},"max":{"1min":4.7279999999999998,"5min":13.086,"15min":13.086},"last":1.7330000000000001}]},{"osd":10,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":2.262,"5min":2.2069999999999999,"15min":2.0070000000000001},"min":{"1min":1.2849999999999999,"5min":1.254,"15min":1.1639999999999999},"max":{"1min":7.6239999999999997,"5min":13.220000000000001,"15min":13.220000000000001},"last":1.4139999999999999},{"interface":"front","average":{"1min":2.488,"5min":2.2829999999999999,"15min":2.0979999999999999},"min":{"1min":1.3999999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"max":{"1min":6.9320000000000004,"5min":13.233000000000001,"15min":19.605},"last":1.855}]}]},{"osd":10,"up_from":17,"seq":73014444340,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":158320,"kb_used_data":23400,"kb_used_omap":0,"kb_used_meta":134912,"kb_avail":94213520,"statfs":{"total":96636764160,"available":96474644480,"internally_reserved":0,"allocated":23961600,"data_stored":46699291,"data_compressed":2238389,"data_compressed_allocated":22896640,"data_compressed_original":45793280,"omap_allocated":0,"internal_metadata":138149888},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:12:43 2020","interfaces":[{"interface":"back","average":{"1min":1.986,"5min":1.5960000000000001,"15min":1.3069999999999999},"min":{"1min":0.61199999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":4.5570000000000004,"5min":7.4349999999999996,"15min":8.9849999999999994},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.944,"5min":1.5249999999999999,"15min":1.232},"min":{"1min":0.752,"5min":0.60999999999999999,"15min":0.60199999999999998},"max":{"1min":4.766,"5min":6.7789999999999999,"15min":6.7789999999999999},"last":1.504}]},{"osd":1,"last update":"Fri Nov 20 12:12:43 2020","interfaces":[{"interface":"back","average":{"1min":2.2970000000000002,"5min":2.1040000000000001,"15min":1.754},"min":{"1min":0.71999999999999997,"5min":0.66300000000000003,"15min":0.58699999999999997},"max":{"1min":4.7149999999999999,"5min":12.619999999999999,"15min":12.619999999999999},"last":1.1120000000000001},{"interface":"front","average":{"1min":2.6139999999999999,"5min":1.96,"15min":1.732},"min":{"1min":0.876,"5min":0.70899999999999996,"15min":0.58899999999999997},"max":{"1min":5.1890000000000001,"5min":6.6509999999999998,"15min":10.332000000000001},"last":1.375}]},{"osd":2,"last update":"Fri Nov 20 12:12:43 2020","interfaces":[{"interface":"back","average":{"1min":2.5939999999999999,"5min":1.696,"15min":1.458},"min":{"1min":0.89200000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":5.3520000000000003,"5min":6.601,"15min":6.601},"last":0.83899999999999997},{"interface":"front","average":{"1min":2.4009999999999998,"5min":2.044,"15min":1.7330000000000001},"min":{"1min":0.98999999999999999,"5min":0.89600000000000002,"15min":0.79600000000000004},"max":{"1min":5.1079999999999997,"5min":7.718,"15min":13.505000000000001},"last":1.478}]},{"osd":3,"last update":"Fri Nov 20 12:12:43 2020","interfaces":[{"interface":"back","average":{"1min":2.5009999999999999,"5min":2.0760000000000001,"15min":1.7929999999999999},"min":{"1min":1.2450000000000001,"5min":0.92600000000000005,"15min":0.69399999999999995},"max":{"1min":5.8769999999999998,"5min":8.4529999999999994,"15min":12.358000000000001},"last":2.754},{"interface":"front","average":{"1min":2.8119999999999998,"5min":1.956,"15min":1.671},"min":{"1min":0.70599999999999996,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":5.4960000000000004,"5min":6.8540000000000001,"15min":6.8540000000000001},"last":3.1680000000000001}]},{"osd":4,"last update":"Fri Nov 20 12:12:43 2020","interfaces":[{"interface":"back","average":{"1min":2.6739999999999999,"5min":2.4780000000000002,"15min":2.1970000000000001},"min":{"1min":1.1299999999999999,"5min":0.95699999999999996,"15min":0.85799999999999998},"max":{"1min":5.9219999999999997,"5min":8.4710000000000001,"15min":26.497},"last":2.484},{"interface":"front","average":{"1min":2.9580000000000002,"5min":2.5139999999999998,"15min":2.117},"min":{"1min":1.548,"5min":1.0589999999999999,"15min":0.79000000000000004},"max":{"1min":6.2590000000000003,"5min":10.172000000000001,"15min":10.478999999999999},"last":2.0880000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:12:43 2020","interfaces":[{"interface":"back","average":{"1min":2.8780000000000001,"5min":2.3940000000000001,"15min":2.0779999999999998},"min":{"1min":1.133,"5min":1.133,"15min":1.0760000000000001},"max":{"1min":6.3609999999999998,"5min":7.8479999999999999,"15min":13.752000000000001},"last":2.048},{"interface":"front","average":{"1min":2.7010000000000001,"5min":2.3700000000000001,"15min":2.097},"min":{"1min":1.3640000000000001,"5min":1.165,"15min":1.0580000000000001},"max":{"1min":6.0030000000000001,"5min":8.4529999999999994,"15min":12.118},"last":2.9079999999999999}]},{"osd":6,"last update":"Fri Nov 20 12:12:43 2020","interfaces":[{"interface":"back","average":{"1min":2.9929999999999999,"5min":2.242,"15min":1.9379999999999999},"min":{"1min":1.091,"5min":0.88600000000000001,"15min":0.85899999999999999},"max":{"1min":5.7450000000000001,"5min":7.5549999999999997,"15min":7.5549999999999997},"last":1.4470000000000001},{"interface":"front","average":{"1min":2.7589999999999999,"5min":2.504,"15min":2.2469999999999999},"min":{"1min":1.252,"5min":1.145,"15min":1.054},"max":{"1min":5.3789999999999996,"5min":9.9580000000000002,"15min":13.630000000000001},"last":2.1899999999999999}]},{"osd":7,"last update":"Fri Nov 20 12:12:43 2020","interfaces":[{"interface":"back","average":{"1min":3.0470000000000002,"5min":2.633,"15min":2.3239999999999998},"min":{"1min":1.613,"5min":1.248,"15min":1.1839999999999999},"max":{"1min":6.1900000000000004,"5min":8.8710000000000004,"15min":11.385999999999999},"last":3.0390000000000001},{"interface":"front","average":{"1min":3.3109999999999999,"5min":2.5169999999999999,"15min":2.2839999999999998},"min":{"1min":1.2,"5min":1.012,"15min":0.94899999999999995},"max":{"1min":5.9219999999999997,"5min":7.7830000000000004,"15min":20.707000000000001},"last":1.861}]},{"osd":9,"last update":"Fri Nov 20 12:12:43 2020","interfaces":[{"interface":"back","average":{"1min":3.3820000000000001,"5min":2.544,"15min":2.222},"min":{"1min":1.484,"5min":1.113,"15min":1.034},"max":{"1min":5.7679999999999998,"5min":7.6699999999999999,"15min":11.432},"last":2},{"interface":"front","average":{"1min":2.8969999999999998,"5min":2.5920000000000001,"15min":2.2629999999999999},"min":{"1min":1.363,"5min":1.351,"15min":1.1519999999999999},"max":{"1min":6.4989999999999997,"5min":8.2859999999999996,"15min":13.865},"last":2.3399999999999999}]},{"osd":11,"last update":"Fri Nov 20 12:12:43 2020","interfaces":[{"interface":"back","average":{"1min":2.9239999999999999,"5min":2.5859999999999999,"15min":2.25},"min":{"1min":1.4930000000000001,"5min":1.2729999999999999,"15min":1.268},"max":{"1min":6.1150000000000002,"5min":8.6549999999999994,"15min":10.875},"last":3.2690000000000001},{"interface":"front","average":{"1min":3.3479999999999999,"5min":2.5750000000000002,"15min":2.2599999999999998},"min":{"1min":1.3660000000000001,"5min":1.1279999999999999,"15min":1.101},"max":{"1min":5.8179999999999996,"5min":7.9109999999999996,"15min":11.536},"last":1.5609999999999999}]}]},{"osd":9,"up_from":17,"seq":73014444340,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49548,"kb_used_data":4292,"kb_used_omap":0,"kb_used_meta":45248,"kb_avail":94322292,"statfs":{"total":96636764160,"available":96586027008,"internally_reserved":0,"allocated":4395008,"data_stored":8241947,"data_compressed":393589,"data_compressed_allocated":4005888,"data_compressed_original":8011776,"omap_allocated":0,"internal_metadata":46333952},"hb_peers":[0,1,2,3,4,5,6,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:12:57 2020","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.095,"15min":1.123},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":3.3069999999999999,"5min":5.5289999999999999,"15min":8.7680000000000007},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1879999999999999,"15min":1.2789999999999999},"min":{"1min":0.72799999999999998,"5min":0.627,"15min":0.627},"max":{"1min":3.3730000000000002,"5min":5.4500000000000002,"15min":9.0199999999999996},"last":0.95099999999999996}]},{"osd":1,"last update":"Fri Nov 20 12:12:57 2020","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.9370000000000001,"15min":2.0790000000000002},"min":{"1min":0.627,"5min":0.627,"15min":0.59699999999999998},"max":{"1min":6.2560000000000002,"5min":66.763000000000005,"15min":126.151},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.601,"15min":1.625},"min":{"1min":0.753,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.0579999999999998,"5min":6.556,"15min":31.262},"last":1.216}]},{"osd":2,"last update":"Fri Nov 20 12:12:57 2020","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.339,"15min":1.379},"min":{"1min":0.75,"5min":0.67400000000000004,"15min":0.67100000000000004},"max":{"1min":2.6619999999999999,"5min":4.0179999999999998,"15min":8.9760000000000009},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.5720000000000001,"5min":1.4670000000000001,"15min":1.524},"min":{"1min":0.96399999999999997,"5min":0.748,"15min":0.69899999999999995},"max":{"1min":6.9359999999999999,"5min":6.9359999999999999,"15min":9.0449999999999999},"last":1.3360000000000001}]},{"osd":3,"last update":"Fri Nov 20 12:12:57 2020","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.2310000000000001,"15min":1.3899999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.61599999999999999},"max":{"1min":2.262,"5min":6.3440000000000003,"15min":8.7949999999999999},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.476,"5min":1.643,"15min":1.7110000000000001},"min":{"1min":0.94599999999999995,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":2.7879999999999998,"5min":6.2050000000000001,"15min":9.2219999999999995},"last":1.401}]},{"osd":4,"last update":"Fri Nov 20 12:12:57 2020","interfaces":[{"interface":"back","average":{"1min":1.7729999999999999,"5min":1.891,"15min":1.7569999999999999},"min":{"1min":1.1180000000000001,"5min":0.93200000000000005,"15min":0.61599999999999999},"max":{"1min":6.8019999999999996,"5min":6.8259999999999996,"15min":9.6609999999999996},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.7450000000000001,"5min":1.665,"15min":1.7010000000000001},"min":{"1min":0.73099999999999998,"5min":0.65500000000000003,"15min":0.65200000000000002},"max":{"1min":4.2649999999999997,"5min":6.0810000000000004,"15min":9.2829999999999995},"last":1.3700000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:12:57 2020","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.554,"15min":1.6379999999999999},"min":{"1min":0.872,"5min":0.872,"15min":0.746},"max":{"1min":1.96,"5min":6.0170000000000003,"15min":9.1519999999999992},"last":1.496},{"interface":"front","average":{"1min":1.619,"5min":1.8220000000000001,"15min":1.804},"min":{"1min":1.097,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":2.903,"5min":6.3310000000000004,"15min":9.0980000000000008},"last":1.532}]},{"osd":6,"last update":"Fri Nov 20 12:12:57 2020","interfaces":[{"interface":"back","average":{"1min":1.835,"5min":1.978,"15min":2.0169999999999999},"min":{"1min":1.23,"5min":1.0109999999999999,"15min":0.84499999999999997},"max":{"1min":3.238,"5min":6.5890000000000004,"15min":9.8030000000000008},"last":1.6519999999999999},{"interface":"front","average":{"1min":1.782,"5min":1.9470000000000001,"15min":1.95},"min":{"1min":1.2509999999999999,"5min":1.115,"15min":1.03},"max":{"1min":3.4889999999999999,"5min":7.2110000000000003,"15min":10.294},"last":1.597}]},{"osd":8,"last update":"Fri Nov 20 12:12:57 2020","interfaces":[{"interface":"back","average":{"1min":1.7090000000000001,"5min":1.901,"15min":1.9099999999999999},"min":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":0.96899999999999997},"max":{"1min":3.359,"5min":6.9560000000000004,"15min":10.076000000000001},"last":1.708},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.72,"15min":1.861},"min":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"max":{"1min":2.0979999999999999,"5min":5.226,"15min":9.5210000000000008},"last":1.6279999999999999}]},{"osd":10,"last update":"Fri Nov 20 12:12:57 2020","interfaces":[{"interface":"back","average":{"1min":2.161,"5min":2.226,"15min":2.0990000000000002},"min":{"1min":1.1830000000000001,"5min":1.139,"15min":1.1359999999999999},"max":{"1min":4.9880000000000004,"5min":7.0339999999999998,"15min":9.4830000000000005},"last":1.7789999999999999},{"interface":"front","average":{"1min":2.4590000000000001,"5min":2.242,"15min":2.0830000000000002},"min":{"1min":1.359,"5min":1.2010000000000001,"15min":1.093},"max":{"1min":9.3160000000000007,"5min":9.3160000000000007,"15min":10.202999999999999},"last":3.4420000000000002}]},{"osd":11,"last update":"Fri Nov 20 12:12:57 2020","interfaces":[{"interface":"back","average":{"1min":1.754,"5min":1.833,"15min":1.962},"min":{"1min":1.129,"5min":1.1100000000000001,"15min":1.1100000000000001},"max":{"1min":4.8920000000000003,"5min":5.4450000000000003,"15min":9.4060000000000006},"last":1.7490000000000001},{"interface":"front","average":{"1min":1.8919999999999999,"5min":2.052,"15min":2.0830000000000002},"min":{"1min":1.2809999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"max":{"1min":3.8809999999999998,"5min":8.5890000000000004,"15min":9.6059999999999999},"last":1.897}]}]},{"osd":8,"up_from":17,"seq":73014444341,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315836,"kb_used_data":36596,"kb_used_omap":0,"kb_used_meta":279232,"kb_avail":94056004,"statfs":{"total":96636764160,"available":96313348096,"internally_reserved":0,"allocated":37474304,"data_stored":50852669,"data_compressed":4037641,"data_compressed_allocated":13541376,"data_compressed_original":27082752,"omap_allocated":0,"internal_metadata":285933568},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":0.93999999999999995,"15min":0.94899999999999995},"min":{"1min":0.55800000000000005,"5min":0.55600000000000005,"15min":0.54500000000000004},"max":{"1min":2.589,"5min":4.7709999999999999,"15min":8.4719999999999995},"last":0.63500000000000001},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.1559999999999999,"15min":1.0600000000000001},"min":{"1min":0.57799999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":5.1909999999999998,"5min":6.3029999999999999,"15min":6.3029999999999999},"last":0.61399999999999999}]},{"osd":1,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.3799999999999999,"15min":1.1319999999999999},"min":{"1min":0.60499999999999998,"5min":0.58999999999999997,"15min":0.56000000000000005},"max":{"1min":4.5449999999999999,"5min":13.785,"15min":13.785},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.385,"5min":1.546,"15min":1.3320000000000001},"min":{"1min":0.79500000000000004,"5min":0.59299999999999997,"15min":0.59099999999999997},"max":{"1min":3.0179999999999998,"5min":14.462999999999999,"15min":14.462999999999999},"last":1.1060000000000001}]},{"osd":2,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":1.5700000000000001,"5min":1.3380000000000001,"15min":1.1970000000000001},"min":{"1min":0.70199999999999996,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":5.5419999999999998,"5min":6.444,"15min":6.444},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.3799999999999999,"15min":1.258},"min":{"1min":0.627,"5min":0.60399999999999998,"15min":0.56100000000000005},"max":{"1min":3.1080000000000001,"5min":5.5149999999999997,"15min":5.5149999999999997},"last":0.65900000000000003}]},{"osd":3,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.482,"15min":1.3819999999999999},"min":{"1min":0.70499999999999996,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":5.4180000000000001,"5min":5.4180000000000001,"15min":5.4180000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.486,"5min":1.6799999999999999,"15min":1.482},"min":{"1min":0.89600000000000002,"5min":0.82399999999999995,"15min":0.73199999999999998},"max":{"1min":2.6890000000000001,"5min":29.010999999999999,"15min":29.010999999999999},"last":0.73399999999999999}]},{"osd":4,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":1.8440000000000001,"5min":1.675,"15min":1.9530000000000001},"min":{"1min":0.91500000000000004,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":5.4589999999999996,"5min":5.4589999999999996,"15min":54.881},"last":1.0169999999999999},{"interface":"front","average":{"1min":2.0880000000000001,"5min":1.786,"15min":1.952},"min":{"1min":1.0760000000000001,"5min":0.875,"15min":0.85199999999999998},"max":{"1min":5.6710000000000003,"5min":6.5679999999999996,"15min":55.497},"last":0.93899999999999995}]},{"osd":5,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":1.8049999999999999,"5min":1.9410000000000001,"15min":1.9239999999999999},"min":{"1min":0.96599999999999997,"5min":0.92500000000000004,"15min":0.86499999999999999},"max":{"1min":5.944,"5min":8.7219999999999995,"15min":54.777000000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.784,"5min":1.861,"15min":1.9550000000000001},"min":{"1min":1.095,"5min":1.095,"15min":0.84899999999999998},"max":{"1min":3.371,"5min":8.7609999999999992,"15min":54.634999999999998},"last":1.179}]},{"osd":7,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":2.1829999999999998,"5min":2.0209999999999999,"15min":2.0049999999999999},"min":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"max":{"1min":5.9880000000000004,"5min":6.702,"15min":55.015999999999998},"last":1.087},{"interface":"front","average":{"1min":2.0830000000000002,"5min":1.9370000000000001,"15min":2.0019999999999998},"min":{"1min":1.042,"5min":1.042,"15min":1.042},"max":{"1min":5.7729999999999997,"5min":5.7729999999999997,"15min":54.698},"last":1.143}]},{"osd":9,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":1.794,"5min":1.7490000000000001,"15min":1.944},"min":{"1min":1.04,"5min":1.04,"15min":1.04},"max":{"1min":3.1269999999999998,"5min":4.8869999999999996,"15min":54.500999999999998},"last":0.91400000000000003},{"interface":"front","average":{"1min":2.0070000000000001,"5min":1.8380000000000001,"15min":1.9690000000000001},"min":{"1min":1.155,"5min":1.048,"15min":1.048},"max":{"1min":5.7969999999999997,"5min":6.8280000000000003,"15min":55.392000000000003},"last":1.1639999999999999}]},{"osd":10,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":2.137,"5min":2.1520000000000001,"15min":2.1469999999999998},"min":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.0580000000000001},"max":{"1min":5.8209999999999997,"5min":6.3700000000000001,"15min":54.901000000000003},"last":1.22},{"interface":"front","average":{"1min":1.911,"5min":2.081,"15min":2.1139999999999999},"min":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.1559999999999999},"max":{"1min":3.7240000000000002,"5min":10.696999999999999,"15min":54.753},"last":1.262}]},{"osd":11,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":2.1309999999999998,"5min":1.97,"15min":2.0219999999999998},"min":{"1min":1.077,"5min":1.077,"15min":1.077},"max":{"1min":6.5149999999999997,"5min":6.9530000000000003,"15min":55.133000000000003},"last":1.2450000000000001},{"interface":"front","average":{"1min":2.0409999999999999,"5min":1.9610000000000001,"15min":2.0350000000000001},"min":{"1min":1.111,"5min":1.111,"15min":1.095},"max":{"1min":5.5700000000000003,"5min":5.7270000000000003,"15min":54.609999999999999},"last":1.286}]}]},{"osd":7,"up_from":17,"seq":73014444341,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":285916,"kb_used_data":30484,"kb_used_omap":0,"kb_used_meta":255424,"kb_avail":94085924,"statfs":{"total":96636764160,"available":96343986176,"internally_reserved":0,"allocated":31215616,"data_stored":42788186,"data_compressed":4693555,"data_compressed_allocated":11739136,"data_compressed_original":23478272,"omap_allocated":0,"internal_metadata":261554176},"hb_peers":[0,1,2,3,4,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.3180000000000001,"15min":1.117},"min":{"1min":0.67400000000000004,"5min":0.63500000000000001,"15min":0.60099999999999998},"max":{"1min":5.9260000000000002,"5min":6.5129999999999999,"15min":6.5129999999999999},"last":4.0910000000000002},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.4470000000000001,"15min":1.3120000000000001},"min":{"1min":0.80100000000000005,"5min":0.71299999999999997,"15min":0.67100000000000004},"max":{"1min":3.927,"5min":5.508,"15min":8.5229999999999997},"last":1.3500000000000001}]},{"osd":1,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.54,"15min":1.401},"min":{"1min":0.64500000000000002,"5min":0.60199999999999998,"15min":0.57099999999999995},"max":{"1min":3.8420000000000001,"5min":7.7850000000000001,"15min":27.488},"last":2.694},{"interface":"front","average":{"1min":1.6639999999999999,"5min":2.6480000000000001,"15min":1.9950000000000001},"min":{"1min":0.68899999999999995,"5min":0.61299999999999999,"15min":0.55200000000000005},"max":{"1min":4.5419999999999998,"5min":71.591999999999999,"15min":71.591999999999999},"last":5.3840000000000003}]},{"osd":2,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":2.1659999999999999,"5min":1.8029999999999999,"15min":1.4750000000000001},"min":{"1min":0.97999999999999998,"5min":0.81399999999999995,"15min":0.55800000000000005},"max":{"1min":6.2359999999999998,"5min":6.9569999999999999,"15min":6.9569999999999999},"last":4.1769999999999996},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.728,"15min":1.516},"min":{"1min":0.86799999999999999,"5min":0.82499999999999996,"15min":0.63100000000000001},"max":{"1min":2.2229999999999999,"5min":7.4569999999999999,"15min":12.949999999999999},"last":3.5939999999999999}]},{"osd":3,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":1.804,"5min":1.8859999999999999,"15min":1.6879999999999999},"min":{"1min":0.90100000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":5.4349999999999996,"5min":6.8529999999999998,"15min":8.6959999999999997},"last":1.597},{"interface":"front","average":{"1min":2.5510000000000002,"5min":2.1339999999999999,"15min":1.774},"min":{"1min":0.97399999999999998,"5min":0.91000000000000003,"15min":0.748},"max":{"1min":6.6500000000000004,"5min":6.8289999999999997,"15min":6.8479999999999999},"last":4.2380000000000004}]},{"osd":4,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":2.2530000000000001,"5min":2.028,"15min":1.8400000000000001},"min":{"1min":0.76000000000000001,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":6.4930000000000003,"5min":7.5350000000000001,"15min":26.966000000000001},"last":3.8149999999999999},{"interface":"front","average":{"1min":2.347,"5min":2.3279999999999998,"15min":2.0870000000000002},"min":{"1min":1.149,"5min":0.876,"15min":0.78900000000000003},"max":{"1min":8.6560000000000006,"5min":8.6560000000000006,"15min":26.786999999999999},"last":1.486}]},{"osd":6,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":2.573,"5min":2.4470000000000001,"15min":1.9950000000000001},"min":{"1min":0.995,"5min":0.995,"15min":0.66000000000000003},"max":{"1min":6.3849999999999998,"5min":10.233000000000001,"15min":10.233000000000001},"last":4.2990000000000004},{"interface":"front","average":{"1min":1.9710000000000001,"5min":2.109,"15min":1.839},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.75800000000000001},"max":{"1min":6.3479999999999999,"5min":7.5990000000000002,"15min":11.321},"last":3.9409999999999998}]},{"osd":8,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":2.2040000000000002,"5min":2.1970000000000001,"15min":1.992},"min":{"1min":0.999,"5min":0.999,"15min":0.92400000000000004},"max":{"1min":7.0549999999999997,"5min":7.1020000000000003,"15min":8.843},"last":1.8049999999999999},{"interface":"front","average":{"1min":2.7370000000000001,"5min":2.4039999999999999,"15min":2.036},"min":{"1min":1.212,"5min":1.1910000000000001,"15min":0.874},"max":{"1min":6.5990000000000002,"5min":7.2930000000000001,"15min":9.2720000000000002},"last":4.3579999999999997}]},{"osd":9,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":2.7850000000000001,"5min":2.5379999999999998,"15min":2.1560000000000001},"min":{"1min":1.395,"5min":1.21,"15min":1.032},"max":{"1min":6.7709999999999999,"5min":7.3479999999999999,"15min":7.5979999999999999},"last":4.4779999999999998},{"interface":"front","average":{"1min":2.5059999999999998,"5min":2.3919999999999999,"15min":2.0329999999999999},"min":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":0.97199999999999998},"max":{"1min":7.1719999999999997,"5min":7.6619999999999999,"15min":11.436999999999999},"last":4.0590000000000002}]},{"osd":10,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":2.3889999999999998,"5min":2.4620000000000002,"15min":2.2599999999999998},"min":{"1min":1.431,"5min":1.105,"15min":0.81999999999999995},"max":{"1min":8.423,"5min":8.423,"15min":8.9809999999999999},"last":1.998},{"interface":"front","average":{"1min":2.9359999999999999,"5min":2.806,"15min":2.3479999999999999},"min":{"1min":1.506,"5min":0.96799999999999997,"15min":0.96099999999999997},"max":{"1min":6.8879999999999999,"5min":8.0190000000000001,"15min":8.0190000000000001},"last":4.4189999999999996}]},{"osd":11,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":2.548,"5min":2.3460000000000001,"15min":2.0449999999999999},"min":{"1min":1.1799999999999999,"5min":1.133,"15min":0.88600000000000001},"max":{"1min":7.5380000000000003,"5min":7.7229999999999999,"15min":11.547000000000001},"last":6.1900000000000004},{"interface":"front","average":{"1min":2.407,"5min":2.4249999999999998,"15min":2.2639999999999998},"min":{"1min":1.22,"5min":1.1759999999999999,"15min":0.98199999999999998},"max":{"1min":8.5500000000000007,"5min":10.367000000000001,"15min":14.678000000000001},"last":2.1139999999999999}]}]},{"osd":6,"up_from":17,"seq":73014444340,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":485184,"kb_used_data":90296,"kb_used_omap":0,"kb_used_meta":394880,"kb_avail":93886656,"statfs":{"total":96636764160,"available":96139935744,"internally_reserved":0,"allocated":92463104,"data_stored":141554002,"data_compressed":12539647,"data_compressed_allocated":49258496,"data_compressed_original":98516992,"omap_allocated":0,"internal_metadata":404357120},"hb_peers":[0,1,2,3,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.306,"15min":1.1639999999999999},"min":{"1min":0.63,"5min":0.56399999999999995,"15min":0.54100000000000004},"max":{"1min":4.4059999999999997,"5min":11.004,"15min":11.004},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.97999999999999998,"15min":1.0189999999999999},"min":{"1min":0.623,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":3.9860000000000002,"5min":3.9860000000000002,"15min":8.5150000000000006},"last":0.94099999999999995}]},{"osd":1,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":1.5629999999999999,"5min":1.323,"15min":1.363},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":4.5,"5min":4.5179999999999998,"15min":6.1369999999999996},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.177,"5min":1.55,"15min":2.181},"min":{"1min":0.63300000000000001,"5min":0.58099999999999996,"15min":0.56899999999999995},"max":{"1min":3.8330000000000002,"5min":21.001000000000001,"15min":136.38},"last":1.22}]},{"osd":2,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.3069999999999999,"15min":1.4159999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.58399999999999996},"max":{"1min":3.4820000000000002,"5min":6.9470000000000001,"15min":34.850999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.554,"5min":1.6180000000000001,"15min":1.502},"min":{"1min":0.89000000000000001,"5min":0.77400000000000002,"15min":0.64600000000000002},"max":{"1min":4.6360000000000001,"5min":12.048999999999999,"15min":12.048999999999999},"last":1.7629999999999999}]},{"osd":3,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.423,"15min":1.4259999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.68700000000000006},"max":{"1min":2.2759999999999998,"5min":4.6500000000000004,"15min":6.5990000000000002},"last":1.8560000000000001},{"interface":"front","average":{"1min":1.423,"5min":1.3999999999999999,"15min":1.6279999999999999},"min":{"1min":0.79100000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":4.9889999999999999,"5min":4.9889999999999999,"15min":54.747},"last":1.746}]},{"osd":5,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":1.7030000000000001,"5min":1.8560000000000001,"15min":1.738},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":4.5250000000000004,"5min":12.162000000000001,"15min":21.766999999999999},"last":2.02},{"interface":"front","average":{"1min":1.7330000000000001,"5min":1.621,"15min":1.665},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.84899999999999998},"max":{"1min":4.7460000000000004,"5min":4.7880000000000003,"15min":22.012},"last":1.974}]},{"osd":7,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":1.875,"5min":1.6870000000000001,"15min":1.7789999999999999},"min":{"1min":1.0189999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":4.4569999999999999,"5min":6.8789999999999996,"15min":34.982999999999997},"last":1.881},{"interface":"front","average":{"1min":2.2050000000000001,"5min":2.0899999999999999,"15min":1.917},"min":{"1min":1.1040000000000001,"5min":0.98599999999999999,"15min":0.84799999999999998},"max":{"1min":4.859,"5min":11.670999999999999,"15min":11.670999999999999},"last":1.8979999999999999}]},{"osd":8,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":1.7430000000000001,"5min":1.8220000000000001,"15min":1.7549999999999999},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":4.383,"5min":7.4560000000000004,"15min":7.4560000000000004},"last":2.0819999999999999},{"interface":"front","average":{"1min":2.0249999999999999,"5min":1.849,"15min":1.974},"min":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":5.4779999999999998,"5min":6.4550000000000001,"15min":54.307000000000002},"last":1.996}]},{"osd":9,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":1.9179999999999999,"5min":2.0009999999999999,"15min":1.9179999999999999},"min":{"1min":1.0369999999999999,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":4.7519999999999998,"5min":11.795999999999999,"15min":11.795999999999999},"last":2.1400000000000001},{"interface":"front","average":{"1min":1.653,"5min":1.8240000000000001,"15min":1.819},"min":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"max":{"1min":4.6299999999999999,"5min":7.3869999999999996,"15min":7.3869999999999996},"last":2.3029999999999999}]},{"osd":10,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":2.0259999999999998,"5min":2.0489999999999999,"15min":2.1230000000000002},"min":{"1min":1.2869999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":5.109,"5min":8.8759999999999994,"15min":54.162999999999997},"last":2.2309999999999999},{"interface":"front","average":{"1min":2.254,"5min":2.2770000000000001,"15min":2.137},"min":{"1min":1.1819999999999999,"5min":1.093,"15min":1.0469999999999999},"max":{"1min":4.9640000000000004,"5min":11.913,"15min":11.913},"last":2.2530000000000001}]},{"osd":11,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":1.7769999999999999,"5min":1.9510000000000001,"15min":1.9279999999999999},"min":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"max":{"1min":4.859,"5min":7.2610000000000001,"15min":7.2610000000000001},"last":2.1949999999999998},{"interface":"front","average":{"1min":1.972,"5min":1.9359999999999999,"15min":2.1080000000000001},"min":{"1min":1.1100000000000001,"5min":1.077,"15min":1.077},"max":{"1min":5.3540000000000001,"5min":6.6970000000000001,"15min":54.432000000000002},"last":2.1190000000000002}]}]},{"osd":1,"up_from":17,"seq":73014444338,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":496204,"kb_used_data":78084,"kb_used_omap":0,"kb_used_meta":418112,"kb_avail":93875636,"statfs":{"total":96636764160,"available":96128651264,"internally_reserved":0,"allocated":79958016,"data_stored":124635388,"data_compressed":11040222,"data_compressed_allocated":44847104,"data_compressed_original":89694208,"omap_allocated":0,"internal_metadata":428146688},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,1,5,7,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":1.4810000000000001,"5min":1.296,"15min":1.103},"min":{"1min":0.70099999999999996,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":5.4329999999999998,"5min":6.0700000000000003,"15min":6.1559999999999997},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.9850000000000001,"5min":1.5049999999999999,"15min":1.325},"min":{"1min":0.65600000000000003,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":6.0190000000000001,"5min":6.1580000000000004,"15min":9.3610000000000007},"last":0.93100000000000005}]},{"osd":2,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.512,"15min":1.284},"min":{"1min":0.60699999999999998,"5min":0.59799999999999998,"15min":0.58699999999999997},"max":{"1min":5.4610000000000003,"5min":6.6760000000000002,"15min":6.6760000000000002},"last":1.585},{"interface":"front","average":{"1min":1.732,"5min":1.6579999999999999,"15min":1.4279999999999999},"min":{"1min":0.81999999999999995,"5min":0.73899999999999999,"15min":0.54900000000000004},"max":{"1min":5.7050000000000001,"5min":6.3159999999999998,"15min":8.5210000000000008},"last":2.2210000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":4,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":2.6749999999999998,"5min":1.9419999999999999,"15min":1.7170000000000001},"min":{"1min":0.69999999999999996,"5min":0.68000000000000005,"15min":0.60799999999999998},"max":{"1min":6.702,"5min":6.702,"15min":9.5419999999999998},"last":1.306},{"interface":"front","average":{"1min":2.1389999999999998,"5min":2.0329999999999999,"15min":1.782},"min":{"1min":0.77900000000000003,"5min":0.67700000000000005,"15min":0.66700000000000004},"max":{"1min":6.7699999999999996,"5min":7.077,"15min":12.92},"last":3.1120000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":2.371,"5min":1.996,"15min":1.784},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.78400000000000003},"max":{"1min":6.1639999999999997,"5min":6.1639999999999997,"15min":9.7870000000000008},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.9259999999999999,"15min":1.6160000000000001},"min":{"1min":0.85099999999999998,"5min":0.82899999999999996,"15min":0.60299999999999998},"max":{"1min":5.766,"5min":7.165,"15min":7.4240000000000004},"last":1.9019999999999999}]},{"osd":6,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":2.0089999999999999,"5min":1.962,"15min":1.7110000000000001},"min":{"1min":1.0449999999999999,"5min":0.81399999999999995,"15min":0.68400000000000005},"max":{"1min":6.0529999999999999,"5min":7.7210000000000001,"15min":7.7210000000000001},"last":2.5920000000000001},{"interface":"front","average":{"1min":2.5910000000000002,"5min":2.2480000000000002,"15min":1.9950000000000001},"min":{"1min":1.226,"5min":1.0740000000000001,"15min":0.96599999999999997},"max":{"1min":6.3220000000000001,"5min":7.3600000000000003,"15min":9.2859999999999996},"last":1.556}]},{"osd":7,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":1.835,"5min":2.2050000000000001,"15min":1.901},"min":{"1min":0.82499999999999996,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":5.9420000000000002,"5min":7.2539999999999996,"15min":8.8810000000000002},"last":3.3420000000000001},{"interface":"front","average":{"1min":2.48,"5min":2.23,"15min":2.0139999999999998},"min":{"1min":1.1919999999999999,"5min":1.042,"15min":0.92300000000000004},"max":{"1min":7.0540000000000003,"5min":7.0540000000000003,"15min":8.6080000000000005},"last":2.7120000000000002}]},{"osd":8,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":2.758,"5min":2.5779999999999998,"15min":2.2490000000000001},"min":{"1min":1.284,"5min":1.2,"15min":1.1950000000000001},"max":{"1min":6.7439999999999998,"5min":14.266999999999999,"15min":14.266999999999999},"last":1.714},{"interface":"front","average":{"1min":2.0739999999999998,"5min":2.4809999999999999,"15min":2.0699999999999998},"min":{"1min":1.153,"5min":0.98299999999999998,"15min":0.82599999999999996},"max":{"1min":6.0810000000000004,"5min":14.351000000000001,"15min":14.351000000000001},"last":3.23}]},{"osd":9,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":2.4780000000000002,"5min":2.202,"15min":2.036},"min":{"1min":1.107,"5min":1.079,"15min":1.079},"max":{"1min":7.2149999999999999,"5min":7.2149999999999999,"15min":11.465999999999999},"last":2.8889999999999998},{"interface":"front","average":{"1min":2.9049999999999998,"5min":2.4870000000000001,"15min":2.262},"min":{"1min":1.347,"5min":1.2689999999999999,"15min":1.1970000000000001},"max":{"1min":6.8810000000000002,"5min":6.8810000000000002,"15min":12.558999999999999},"last":1.8149999999999999}]},{"osd":10,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":2.7149999999999999,"5min":2.4750000000000001,"15min":2.1949999999999998},"min":{"1min":1.45,"5min":1.1120000000000001,"15min":1.0069999999999999},"max":{"1min":7.335,"5min":7.335,"15min":8.7420000000000009},"last":3.0070000000000001},{"interface":"front","average":{"1min":3.2850000000000001,"5min":2.9260000000000002,"15min":2.629},"min":{"1min":1.615,"5min":1.343,"15min":1.272},"max":{"1min":7.298,"5min":7.298,"15min":12.689},"last":2.1360000000000001}]},{"osd":11,"last update":"Fri Nov 20 12:13:08 2020","interfaces":[{"interface":"back","average":{"1min":2.9239999999999999,"5min":2.6949999999999998,"15min":2.4830000000000001},"min":{"1min":1.4570000000000001,"5min":1.409,"15min":1.3540000000000001},"max":{"1min":7.141,"5min":7.141,"15min":12.827},"last":1.9259999999999999},{"interface":"front","average":{"1min":3.077,"5min":2.7610000000000001,"15min":2.5699999999999998},"min":{"1min":1.544,"5min":1.4710000000000001,"15min":1.389},"max":{"1min":7.25,"5min":7.25,"15min":12.941000000000001},"last":2.0259999999999998}]}]},{"osd":0,"up_from":17,"seq":73014444339,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302992,"kb_used_data":40852,"kb_used_omap":0,"kb_used_meta":262080,"kb_avail":94068848,"statfs":{"total":96636764160,"available":96326500352,"internally_reserved":0,"allocated":41832448,"data_stored":68039451,"data_compressed":4676103,"data_compressed_allocated":26365952,"data_compressed_original":52731904,"omap_allocated":0,"internal_metadata":268369920},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 20 12:12:44 2020","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.0269999999999999,"15min":1.095},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.56100000000000005},"max":{"1min":2.4660000000000002,"5min":8.7539999999999996,"15min":13.342000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.089,"5min":1.1459999999999999,"15min":1.1879999999999999},"min":{"1min":0.63800000000000001,"5min":0.61699999999999999,"15min":0.58999999999999997},"max":{"1min":2.0110000000000001,"5min":9.157,"15min":12.875},"last":0.82799999999999996}]},{"osd":2,"last update":"Fri Nov 20 12:12:44 2020","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.0489999999999999,"15min":1.127},"min":{"1min":0.69599999999999995,"5min":0.65100000000000002,"15min":0.61199999999999999},"max":{"1min":4.4459999999999997,"5min":4.4459999999999997,"15min":5.7370000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.236,"5min":1.1910000000000001,"15min":1.238},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.56799999999999995},"max":{"1min":1.8200000000000001,"5min":2.2330000000000001,"15min":6.3029999999999999},"last":1.0740000000000001}]},{"osd":3,"last update":"Fri Nov 20 12:12:44 2020","interfaces":[{"interface":"back","average":{"1min":1.746,"5min":1.3440000000000001,"15min":1.3240000000000001},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":4.7539999999999996,"5min":4.7539999999999996,"15min":13.930999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.587,"5min":1.1830000000000001,"15min":1.2450000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.59299999999999997},"max":{"1min":4.46,"5min":4.46,"15min":5.5339999999999998},"last":0.92700000000000005}]},{"osd":4,"last update":"Fri Nov 20 12:12:44 2020","interfaces":[{"interface":"back","average":{"1min":1.74,"5min":1.5029999999999999,"15min":1.4890000000000001},"min":{"1min":0.80200000000000005,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":4.5700000000000003,"5min":5.7610000000000001,"15min":7.8120000000000003},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.609,"5min":1.5049999999999999,"15min":1.494},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.58299999999999996},"max":{"1min":5.4000000000000004,"5min":5.4000000000000004,"15min":7.9980000000000002},"last":1.4650000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:12:44 2020","interfaces":[{"interface":"back","average":{"1min":1.593,"5min":1.5589999999999999,"15min":1.5820000000000001},"min":{"1min":0.92500000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":3.8999999999999999,"5min":6.5609999999999999,"15min":13.669},"last":1.7190000000000001},{"interface":"front","average":{"1min":1.877,"5min":1.5209999999999999,"15min":1.5569999999999999},"min":{"1min":0.95999999999999996,"5min":0.83199999999999996,"15min":0.81899999999999995},"max":{"1min":4.8289999999999997,"5min":5.2160000000000002,"15min":13.018000000000001},"last":1.5}]},{"osd":6,"last update":"Fri Nov 20 12:12:44 2020","interfaces":[{"interface":"back","average":{"1min":2.0670000000000002,"5min":1.6559999999999999,"15min":1.6759999999999999},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":6.6790000000000003,"5min":6.6790000000000003,"15min":8.0410000000000004},"last":1.869},{"interface":"front","average":{"1min":1.742,"5min":1.629,"15min":1.7030000000000001},"min":{"1min":1.085,"5min":0.95399999999999996,"15min":0.73799999999999999},"max":{"1min":3.2709999999999999,"5min":3.2709999999999999,"15min":6.6909999999999998},"last":1.6020000000000001}]},{"osd":7,"last update":"Fri Nov 20 12:12:44 2020","interfaces":[{"interface":"back","average":{"1min":2.2719999999999998,"5min":1.7010000000000001,"15min":1.7},"min":{"1min":1.0329999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":7.827,"5min":7.827,"15min":8.5820000000000007},"last":1.79},{"interface":"front","average":{"1min":2.2469999999999999,"5min":1.833,"15min":1.869},"min":{"1min":1.1830000000000001,"5min":1.0509999999999999,"15min":1.0509999999999999},"max":{"1min":6.4400000000000004,"5min":6.4400000000000004,"15min":9.5909999999999993},"last":1.571}]},{"osd":8,"last update":"Fri Nov 20 12:12:44 2020","interfaces":[{"interface":"back","average":{"1min":2.0510000000000002,"5min":1.764,"15min":1.7609999999999999},"min":{"1min":1.1020000000000001,"5min":1.0549999999999999,"15min":1.0549999999999999},"max":{"1min":4.952,"5min":5.2309999999999999,"15min":8.3469999999999995},"last":1.917},{"interface":"front","average":{"1min":2.2709999999999999,"5min":1.782,"15min":1.8240000000000001},"min":{"1min":1.3089999999999999,"5min":1.157,"15min":1.0900000000000001},"max":{"1min":6.556,"5min":6.556,"15min":8.4039999999999999},"last":1.6890000000000001}]},{"osd":9,"last update":"Fri Nov 20 12:12:44 2020","interfaces":[{"interface":"back","average":{"1min":1.9850000000000001,"5min":1.804,"15min":1.8300000000000001},"min":{"1min":1.157,"5min":1.1000000000000001,"15min":1.1000000000000001},"max":{"1min":4.3129999999999997,"5min":4.3129999999999997,"15min":8.4610000000000003},"last":1.837},{"interface":"front","average":{"1min":2.2509999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"min":{"1min":1.21,"5min":1.042,"15min":1.042},"max":{"1min":5.0309999999999997,"5min":5.6879999999999997,"15min":8.4649999999999999},"last":2.0489999999999999}]},{"osd":11,"last update":"Fri Nov 20 12:12:44 2020","interfaces":[{"interface":"back","average":{"1min":1.954,"5min":1.78,"15min":1.8660000000000001},"min":{"1min":1.2250000000000001,"5min":1.177,"15min":1.1699999999999999},"max":{"1min":4.4740000000000002,"5min":4.4740000000000002,"15min":8.3800000000000008},"last":1.956},{"interface":"front","average":{"1min":2.2450000000000001,"5min":1.889,"15min":1.9259999999999999},"min":{"1min":1.282,"5min":1.1240000000000001,"15min":1.1240000000000001},"max":{"1min":5.2519999999999998,"5min":5.4909999999999997,"15min":8.7029999999999994},"last":2.1800000000000002}]}]},{"osd":2,"up_from":17,"seq":73014444340,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53408,"kb_used_data":2008,"kb_used_omap":0,"kb_used_meta":51392,"kb_avail":94318432,"statfs":{"total":96636764160,"available":96582074368,"internally_reserved":0,"allocated":2056192,"data_stored":3535643,"data_compressed":162389,"data_compressed_allocated":1638400,"data_compressed_original":3276800,"omap_allocated":0,"internal_metadata":52625408},"hb_peers":[0,1,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.93200000000000005,"15min":0.96599999999999997},"min":{"1min":0.64900000000000002,"5min":0.60599999999999998,"15min":0.56299999999999994},"max":{"1min":1.3140000000000001,"5min":3.5840000000000001,"15min":3.8690000000000002},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.244,"5min":1.163,"15min":1.175},"min":{"1min":0.77300000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":3.8679999999999999,"5min":6.4470000000000001,"15min":8.0739999999999998},"last":0.68799999999999994}]},{"osd":1,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.214,"15min":1.2589999999999999},"min":{"1min":0.67100000000000004,"5min":0.60199999999999998,"15min":0.55800000000000005},"max":{"1min":4.6479999999999997,"5min":4.867,"15min":29.183},"last":4.9740000000000002},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.4330000000000001,"15min":1.3580000000000001},"min":{"1min":0.82399999999999995,"5min":0.58799999999999997,"15min":0.57699999999999996},"max":{"1min":4.5060000000000002,"5min":7.7560000000000002,"15min":11.492000000000001},"last":1.206}]},{"osd":3,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.01,"15min":1.0700000000000001},"min":{"1min":0.69199999999999995,"5min":0.59499999999999997,"15min":0.58099999999999996},"max":{"1min":4.0129999999999999,"5min":4.0129999999999999,"15min":6.0220000000000002},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.222,"15min":1.2110000000000001},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":4.2080000000000002,"5min":4.2080000000000002,"15min":9.3160000000000007},"last":2.327}]},{"osd":4,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":1.4810000000000001,"5min":1.3839999999999999,"15min":1.383},"min":{"1min":0.78400000000000003,"5min":0.746,"15min":0.58299999999999996},"max":{"1min":4.7279999999999998,"5min":4.7279999999999998,"15min":7.0510000000000002},"last":2.5579999999999998},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.4590000000000001,"15min":1.401},"min":{"1min":0.82599999999999996,"5min":0.745,"15min":0.72499999999999998},"max":{"1min":3.1000000000000001,"5min":5.1349999999999998,"15min":5.875},"last":2.5339999999999998}]},{"osd":5,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.3839999999999999,"15min":1.3380000000000001},"min":{"1min":0.69899999999999995,"5min":0.66300000000000003,"15min":0.624},"max":{"1min":6.016,"5min":6.5869999999999997,"15min":7.3659999999999997},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.359,"5min":1.484,"15min":1.579},"min":{"1min":0.83299999999999996,"5min":0.82999999999999996,"15min":0.65600000000000003},"max":{"1min":4.4649999999999999,"5min":9.1240000000000006,"15min":35.177},"last":2.4420000000000002}]},{"osd":6,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.482,"15min":1.4470000000000001},"min":{"1min":0.93999999999999995,"5min":0.86299999999999999,"15min":0.75900000000000001},"max":{"1min":4.3780000000000001,"5min":4.3780000000000001,"15min":5.4880000000000004},"last":1.105},{"interface":"front","average":{"1min":1.617,"5min":1.583,"15min":1.611},"min":{"1min":1.1399999999999999,"5min":0.92800000000000005,"15min":0.80500000000000005},"max":{"1min":4.1390000000000002,"5min":6.7149999999999999,"15min":8.202},"last":1.4299999999999999}]},{"osd":7,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":1.8149999999999999,"15min":1.712},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":4.5629999999999997,"5min":9.3460000000000001,"15min":10.002000000000001},"last":2.7749999999999999},{"interface":"front","average":{"1min":1.752,"5min":1.6639999999999999,"15min":1.5920000000000001},"min":{"1min":1.2430000000000001,"5min":1.002,"15min":0.85799999999999998},"max":{"1min":4.7460000000000004,"5min":4.7460000000000004,"15min":4.9340000000000002},"last":3.9089999999999998}]},{"osd":8,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":1.718,"5min":1.76,"15min":1.6619999999999999},"min":{"1min":1.2210000000000001,"5min":1.0029999999999999,"15min":0.81399999999999995},"max":{"1min":4.2969999999999997,"5min":8.3019999999999996,"15min":8.3019999999999996},"last":1.667},{"interface":"front","average":{"1min":1.5960000000000001,"5min":1.76,"15min":1.6990000000000001},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":4.6609999999999996,"5min":9.2420000000000009,"15min":9.2420000000000009},"last":2.665}]},{"osd":9,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":1.5449999999999999,"5min":1.671,"15min":1.621},"min":{"1min":1.1719999999999999,"5min":1.081,"15min":0.999},"max":{"1min":1.8879999999999999,"5min":4.2000000000000002,"15min":6.3769999999999998},"last":1.306},{"interface":"front","average":{"1min":1.788,"5min":1.77,"15min":1.772},"min":{"1min":1.3120000000000001,"5min":1.109,"15min":1.028},"max":{"1min":4.4180000000000001,"5min":6.8319999999999999,"15min":9.0559999999999992},"last":1.5489999999999999}]},{"osd":10,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":1.8999999999999999,"5min":1.944,"15min":1.821},"min":{"1min":1.2969999999999999,"5min":1.224,"15min":1.1739999999999999},"max":{"1min":4.6239999999999997,"5min":5.3609999999999998,"15min":6.4409999999999998},"last":1.4039999999999999},{"interface":"front","average":{"1min":2.6720000000000002,"5min":2.1080000000000001,"15min":2.1299999999999999},"min":{"1min":1.381,"5min":1.2190000000000001,"15min":1.127},"max":{"1min":13.752000000000001,"5min":13.752000000000001,"15min":29.145},"last":1.7789999999999999}]}]},{"osd":3,"up_from":17,"seq":73014444340,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":665996,"kb_used_data":91972,"kb_used_omap":0,"kb_used_meta":574016,"kb_avail":93705844,"statfs":{"total":96636764160,"available":95954784256,"internally_reserved":0,"allocated":94179328,"data_stored":126408186,"data_compressed":13023179,"data_compressed_allocated":32403456,"data_compressed_original":64806912,"omap_allocated":0,"internal_metadata":587792384},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.452,"15min":1.1060000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.54700000000000004},"max":{"1min":5.6319999999999997,"5min":32.991,"15min":32.991},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.6799999999999999,"15min":1.3560000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.621},"max":{"1min":1.591,"5min":33.176000000000002,"15min":33.176000000000002},"last":1.244}]},{"osd":1,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":5.3460000000000001,"5min":2.0750000000000002,"15min":1.532},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":35.597999999999999,"5min":35.597999999999999,"15min":35.597999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":2.9550000000000001,"5min":1.6899999999999999,"15min":1.27},"min":{"1min":0.623,"5min":0.61299999999999999,"15min":0.59299999999999997},"max":{"1min":33.368000000000002,"5min":33.368000000000002,"15min":33.368000000000002},"last":0.83399999999999996}]},{"osd":2,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":3.4870000000000001,"5min":1.778,"15min":1.4059999999999999},"min":{"1min":0.75,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":33.314,"5min":33.314,"15min":33.314},"last":1.0069999999999999},{"interface":"front","average":{"1min":3.1629999999999998,"5min":1.72,"15min":1.4350000000000001},"min":{"1min":0.71199999999999997,"5min":0.60899999999999999,"15min":0.60199999999999998},"max":{"1min":33.457000000000001,"5min":33.457000000000001,"15min":33.457000000000001},"last":1.1020000000000001}]},{"osd":4,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":3.0449999999999999,"5min":1.8200000000000001,"15min":1.5109999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":33.484999999999999,"5min":33.484999999999999,"15min":33.484999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":3.8599999999999999,"5min":2.0289999999999999,"15min":1.609},"min":{"1min":0.81599999999999995,"5min":0.80000000000000004,"15min":0.72599999999999998},"max":{"1min":33.442999999999998,"5min":33.442999999999998,"15min":33.442999999999998},"last":1.1399999999999999}]},{"osd":5,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":3.5800000000000001,"5min":2.0179999999999998,"15min":1.647},"min":{"1min":0.91300000000000003,"5min":0.90800000000000003,"15min":0.79000000000000004},"max":{"1min":33.523000000000003,"5min":33.523000000000003,"15min":33.523000000000003},"last":1.2789999999999999},{"interface":"front","average":{"1min":3.3959999999999999,"5min":1.9610000000000001,"15min":1.6910000000000001},"min":{"1min":1.0760000000000001,"5min":1.028,"15min":0.90600000000000003},"max":{"1min":33.753,"5min":33.753,"15min":33.753},"last":1.337}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":7,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":3.468,"5min":2.1779999999999999,"15min":1.873},"min":{"1min":1.1299999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":33.869,"5min":33.869,"15min":33.869},"last":1.425},{"interface":"front","average":{"1min":3.5329999999999999,"5min":2.0169999999999999,"15min":1.6719999999999999},"min":{"1min":0.93600000000000005,"5min":0.879,"15min":0.83999999999999997},"max":{"1min":36.171999999999997,"5min":36.171999999999997,"15min":36.171999999999997},"last":1.206}]},{"osd":8,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":3.5619999999999998,"5min":2.1579999999999999,"15min":1.891},"min":{"1min":1.2470000000000001,"5min":1.0269999999999999,"15min":0.89300000000000002},"max":{"1min":33.996000000000002,"5min":33.996000000000002,"15min":33.996000000000002},"last":1.496},{"interface":"front","average":{"1min":3.3679999999999999,"5min":1.9139999999999999,"15min":1.6240000000000001},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.82299999999999995},"max":{"1min":36.100000000000001,"5min":36.100000000000001,"15min":36.100000000000001},"last":1.3120000000000001}]},{"osd":9,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":3.6230000000000002,"5min":2.1989999999999998,"15min":1.8200000000000001},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":33.655999999999999,"5min":33.655999999999999,"15min":33.655999999999999},"last":1.405},{"interface":"front","average":{"1min":3.734,"5min":2.2999999999999998,"15min":2.052},"min":{"1min":1.3879999999999999,"5min":1.036,"15min":1.036},"max":{"1min":34.082999999999998,"5min":34.082999999999998,"15min":34.082999999999998},"last":1.635}]},{"osd":10,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":3.6970000000000001,"5min":2.1629999999999998,"15min":1.8759999999999999},"min":{"1min":1.0329999999999999,"5min":0.94099999999999995,"15min":0.90000000000000002},"max":{"1min":36.235999999999997,"5min":36.235999999999997,"15min":36.235999999999997},"last":3.8039999999999998},{"interface":"front","average":{"1min":3.8490000000000002,"5min":2.387,"15min":2.02},"min":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.071},"max":{"1min":33.789999999999999,"5min":33.789999999999999,"15min":33.789999999999999},"last":3.762}]},{"osd":11,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":4.0819999999999999,"5min":2.4620000000000002,"15min":2.1219999999999999},"min":{"1min":1.4059999999999999,"5min":1.24,"15min":1.153},"max":{"1min":35.018999999999998,"5min":35.018999999999998,"15min":35.018999999999998},"last":1.5680000000000001},{"interface":"front","average":{"1min":3.9700000000000002,"5min":2.1909999999999998,"15min":1.869},"min":{"1min":1.202,"5min":1.0569999999999999,"15min":1.0029999999999999},"max":{"1min":36.298000000000002,"5min":36.298000000000002,"15min":36.298000000000002},"last":1.47}]}]},{"osd":4,"up_from":17,"seq":73014444341,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":351832,"kb_used_data":36496,"kb_used_omap":0,"kb_used_meta":315328,"kb_avail":94020008,"statfs":{"total":96636764160,"available":96276488192,"internally_reserved":0,"allocated":37371904,"data_stored":52800714,"data_compressed":4798549,"data_compressed_allocated":15589376,"data_compressed_original":31178752,"omap_allocated":0,"internal_metadata":322895872},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":1,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.6579999999999999,"15min":1.52},"min":{"1min":0.68200000000000005,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":3.5070000000000001,"5min":10.784000000000001,"15min":35.734999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.542,"5min":1.8819999999999999,"15min":2.0070000000000001},"min":{"1min":0.68799999999999994,"5min":0.629,"15min":0.52500000000000002},"max":{"1min":6.048,"5min":8.0079999999999991,"15min":104.79300000000001},"last":0.72899999999999998}]},{"osd":2,"last update":"Fri Nov 20 12:12:58 2020","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.6100000000000001,"15min":1.506},"min":{"1min":0.83499999999999996,"5min":0.749,"15min":0.65600000000000003},"max":{"1min":2.556,"5min":6.843,"15min":6.843},"last":1.069},{"interface":"front","average":{"1min":1.373,"5min":1.8460000000000001,"15min":1.603},"min":{"1min":0.67000000000000004,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.5470000000000002,"5min":7.3079999999999998,"15min":16.853999999999999},"last":1.0960000000000001}]},{"osd":3,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.853,"15min":1.667},"min":{"1min":1.069,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":2.827,"5min":10.906000000000001,"15min":10.906000000000001},"last":1.5720000000000001},{"interface":"front","average":{"1min":1.536,"5min":2.028,"15min":1.7450000000000001},"min":{"1min":0.748,"5min":0.748,"15min":0.63700000000000001},"max":{"1min":2.6579999999999999,"5min":6.9779999999999998,"15min":11.813000000000001},"last":1.1879999999999999}]},{"osd":5,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":1.569,"5min":1.6339999999999999,"15min":1.385},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.59599999999999997},"max":{"1min":5.5700000000000003,"5min":6.1689999999999996,"15min":6.6600000000000001},"last":1.05},{"interface":"front","average":{"1min":1.704,"5min":2.0870000000000002,"15min":1.8919999999999999},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":2.7509999999999999,"5min":5.9820000000000002,"15min":9.2070000000000007},"last":1.3300000000000001}]},{"osd":6,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":1.768,"5min":1.6890000000000001,"15min":1.595},"min":{"1min":0.71799999999999997,"5min":0.64500000000000002,"15min":0.60499999999999998},"max":{"1min":5.6970000000000001,"5min":5.7850000000000001,"15min":25.809000000000001},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.8169999999999999,"5min":2.27,"15min":2.0819999999999999},"min":{"1min":1.1719999999999999,"5min":1.101,"15min":0.998},"max":{"1min":3.077,"5min":10.268000000000001,"15min":12.85},"last":1.4610000000000001}]},{"osd":7,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":2.0760000000000001,"5min":2.464,"15min":2.109},"min":{"1min":1.0149999999999999,"5min":0.92500000000000004,"15min":0.82899999999999996},"max":{"1min":5.8140000000000001,"5min":8.9719999999999995,"15min":16.713999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":2.1230000000000002,"5min":2.1389999999999998,"15min":1.774},"min":{"1min":1.03,"5min":0.876,"15min":0.71399999999999997},"max":{"1min":6.1589999999999998,"5min":11.853,"15min":11.853},"last":0.86099999999999999}]},{"osd":8,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":2.0270000000000001,"5min":2.637,"15min":2.2450000000000001},"min":{"1min":1.3540000000000001,"5min":1.161,"15min":1.1439999999999999},"max":{"1min":3.0720000000000001,"5min":12.117000000000001,"15min":12.117000000000001},"last":1.204},{"interface":"front","average":{"1min":2.1339999999999999,"5min":2.4399999999999999,"15min":2.1160000000000001},"min":{"1min":1.1619999999999999,"5min":1.127,"15min":1.099},"max":{"1min":6,"5min":9.0939999999999994,"15min":11.938000000000001},"last":1.2649999999999999}]},{"osd":9,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":2.1539999999999999,"5min":2.5779999999999998,"15min":2.214},"min":{"1min":1.284,"5min":1.1890000000000001,"15min":1.0629999999999999},"max":{"1min":6.109,"5min":9.202,"15min":12.176},"last":1.3640000000000001},{"interface":"front","average":{"1min":2.1579999999999999,"5min":2.1469999999999998,"15min":1.887},"min":{"1min":1.147,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":6.085,"5min":6.085,"15min":7.8689999999999998},"last":1.3859999999999999}]},{"osd":10,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":2.7589999999999999,"5min":2.5310000000000001,"15min":2.105},"min":{"1min":1.304,"5min":1.109,"15min":0.99399999999999999},"max":{"1min":6.4850000000000003,"5min":6.4850000000000003,"15min":8.0099999999999998},"last":1.236},{"interface":"front","average":{"1min":2.4510000000000001,"5min":2.6579999999999999,"15min":2.3490000000000002},"min":{"1min":1.246,"5min":1.2210000000000001,"15min":1.2050000000000001},"max":{"1min":5.4009999999999998,"5min":10.391,"15min":10.391},"last":1.639}]},{"osd":11,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":2.1829999999999998,"5min":2.6299999999999999,"15min":2.3220000000000001},"min":{"1min":1.4139999999999999,"5min":1.278,"15min":1.1399999999999999},"max":{"1min":3.4380000000000002,"5min":10.654,"15min":10.654},"last":1.704},{"interface":"front","average":{"1min":2.298,"5min":2.7639999999999998,"15min":2.3330000000000002},"min":{"1min":1.351,"5min":1.2190000000000001,"15min":1.1359999999999999},"max":{"1min":6.2229999999999999,"5min":11.749000000000001,"15min":12.053000000000001},"last":1.4830000000000001}]}]},{"osd":5,"up_from":17,"seq":73014444341,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":328180,"kb_used_data":35884,"kb_used_omap":0,"kb_used_meta":292288,"kb_avail":94043660,"statfs":{"total":96636764160,"available":96300707840,"internally_reserved":0,"allocated":36745216,"data_stored":61060027,"data_compressed":4263483,"data_compressed_allocated":24481792,"data_compressed_original":48963584,"omap_allocated":0,"internal_metadata":299302912},"hb_peers":[0,1,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:12:39 2020","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":0.874,"15min":0.876},"min":{"1min":0.57699999999999996,"5min":0.54100000000000004,"15min":0.53800000000000003},"max":{"1min":4.5519999999999996,"5min":4.5519999999999996,"15min":6.7670000000000003},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.96999999999999997,"15min":0.96199999999999997},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":3.7770000000000001,"5min":6.3840000000000003,"15min":6.3840000000000003},"last":0.52400000000000002}]},{"osd":1,"last update":"Fri Nov 20 12:12:39 2020","interfaces":[{"interface":"back","average":{"1min":1.877,"5min":1.2909999999999999,"15min":1.2},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.52900000000000003},"max":{"1min":7.069,"5min":8.5269999999999992,"15min":11.497},"last":0.55500000000000005},{"interface":"front","average":{"1min":1.9830000000000001,"5min":1.518,"15min":1.389},"min":{"1min":0.89400000000000002,"5min":0.76900000000000002,"15min":0.52900000000000003},"max":{"1min":5.1390000000000002,"5min":8.4290000000000003,"15min":8.4290000000000003},"last":1.2110000000000001}]},{"osd":3,"last update":"Fri Nov 20 12:12:39 2020","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.2929999999999999,"15min":1.236},"min":{"1min":0.63700000000000001,"5min":0.58099999999999996,"15min":0.56000000000000005},"max":{"1min":3.9169999999999998,"5min":6.1299999999999999,"15min":20.777000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.605,"5min":1.331,"15min":1.3340000000000001},"min":{"1min":0.80500000000000005,"5min":0.67800000000000005,"15min":0.58599999999999997},"max":{"1min":5.7279999999999998,"5min":5.7279999999999998,"15min":11.946},"last":0.75900000000000001}]},{"osd":4,"last update":"Fri Nov 20 12:12:39 2020","interfaces":[{"interface":"back","average":{"1min":1.885,"5min":1.496,"15min":1.3380000000000001},"min":{"1min":0.71499999999999997,"5min":0.69899999999999995,"15min":0.56399999999999995},"max":{"1min":6.1299999999999999,"5min":6.4909999999999997,"15min":11.629},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.7729999999999999,"5min":1.6970000000000001,"15min":1.5589999999999999},"min":{"1min":0.86299999999999999,"5min":0.73499999999999999,"15min":0.56200000000000006},"max":{"1min":5.9409999999999998,"5min":7.484,"15min":10.872999999999999},"last":0.89100000000000001}]},{"osd":6,"last update":"Fri Nov 20 12:12:39 2020","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.4159999999999999,"15min":1.3979999999999999},"min":{"1min":0.77900000000000003,"5min":0.625,"15min":0.625},"max":{"1min":5.0949999999999998,"5min":5.0949999999999998,"15min":7.0060000000000002},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.397,"5min":1.4610000000000001,"15min":1.6479999999999999},"min":{"1min":0.81499999999999995,"5min":0.75800000000000001,"15min":0.71299999999999997},"max":{"1min":3.6619999999999999,"5min":6.2370000000000001,"15min":54.036000000000001},"last":0.71599999999999997}]},{"osd":7,"last update":"Fri Nov 20 12:12:39 2020","interfaces":[{"interface":"back","average":{"1min":1.6559999999999999,"5min":1.7210000000000001,"15min":1.526},"min":{"1min":0.91100000000000003,"5min":0.83599999999999997,"15min":0.76100000000000001},"max":{"1min":4.5739999999999998,"5min":7.0910000000000002,"15min":7.0910000000000002},"last":0.997},{"interface":"front","average":{"1min":1.7090000000000001,"5min":1.7230000000000001,"15min":1.6479999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":3.9950000000000001,"5min":5.8810000000000002,"15min":11.364000000000001},"last":1.194}]},{"osd":8,"last update":"Fri Nov 20 12:12:39 2020","interfaces":[{"interface":"back","average":{"1min":1.6819999999999999,"5min":1.6279999999999999,"15min":1.5740000000000001},"min":{"1min":0.93600000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":5.0129999999999999,"5min":5.1609999999999996,"15min":7.1189999999999998},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.5249999999999999,"5min":1.754,"15min":1.619},"min":{"1min":0.95299999999999996,"5min":0.86299999999999999,"15min":0.78400000000000003},"max":{"1min":3.956,"5min":7.3860000000000001,"15min":7.3860000000000001},"last":1.105}]},{"osd":9,"last update":"Fri Nov 20 12:12:39 2020","interfaces":[{"interface":"back","average":{"1min":1.788,"5min":1.694,"15min":1.6759999999999999},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.84799999999999998},"max":{"1min":4.0579999999999998,"5min":4.0579999999999998,"15min":10.994},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.7629999999999999,"5min":1.7070000000000001,"15min":1.6830000000000001},"min":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"max":{"1min":5.1639999999999997,"5min":5.1639999999999997,"15min":7.2320000000000002},"last":1.3540000000000001}]},{"osd":10,"last update":"Fri Nov 20 12:12:39 2020","interfaces":[{"interface":"back","average":{"1min":2.0350000000000001,"5min":1.9870000000000001,"15min":1.893},"min":{"1min":1.121,"5min":1.0760000000000001,"15min":1.036},"max":{"1min":4.5949999999999998,"5min":11.638999999999999,"15min":11.638999999999999},"last":1.272},{"interface":"front","average":{"1min":2.044,"5min":1.8300000000000001,"15min":1.7909999999999999},"min":{"1min":1.163,"5min":1.1020000000000001,"15min":1.0780000000000001},"max":{"1min":5.7800000000000002,"5min":5.7800000000000002,"15min":7.3410000000000002},"last":1.472}]},{"osd":11,"last update":"Fri Nov 20 12:12:39 2020","interfaces":[{"interface":"back","average":{"1min":1.631,"5min":1.792,"15min":1.655},"min":{"1min":1.038,"5min":1.0249999999999999,"15min":1.0009999999999999},"max":{"1min":3.8460000000000001,"5min":7.2539999999999996,"15min":7.2539999999999996},"last":1.177},{"interface":"front","average":{"1min":1.948,"5min":1.829,"15min":1.819},"min":{"1min":1.121,"5min":1.0840000000000001,"15min":1.0840000000000001},"max":{"1min":4.4329999999999998,"5min":4.6959999999999997,"15min":11.231999999999999},"last":1.3340000000000001}]}]}]}} 2020-11-20T12:13:30.571 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T12:13:30.688 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.684+0000 7f1c2a7c2700 1 Processor -- start 2020-11-20T12:13:30.688 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.684+0000 7f1c2a7c2700 1 -- start start 2020-11-20T12:13:30.694 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.685+0000 7f1c2a7c2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1c24154920 0x7f1c24060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:30.694 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.685+0000 7f1c2a7c2700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c24151e80 con 0x7f1c24060370 2020-11-20T12:13:30.694 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.685+0000 7f1c2a7c2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c24152120 con 0x7f1c24064c40 2020-11-20T12:13:30.695 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.685+0000 7f1c2a7c2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c24064260 con 0x7f1c24154920 2020-11-20T12:13:30.695 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.685+0000 7f1c23fff700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f1c24060370 0x7f1c240c2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.192:39102/0 (socket says 172.21.15.192:39102) 2020-11-20T12:13:30.695 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.685+0000 7f1c23fff700 1 -- 172.21.15.192:0/2008299944 learned_addr learned my addr 172.21.15.192:0/2008299944 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T12:13:30.696 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.685+0000 7f1c237fe700 1 --2- 172.21.15.192:0/2008299944 >> v2:172.21.15.146:3300/0 conn(0x7f1c24154920 0x7f1c24060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:30.696 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.686+0000 7f1c22ffd700 1 -- 172.21.15.192:0/2008299944 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1611440920 0 0) 0x7f1c24151e80 con 0x7f1c24060370 2020-11-20T12:13:30.696 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.686+0000 7f1c22ffd700 1 -- 172.21.15.192:0/2008299944 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c10003280 con 0x7f1c24060370 2020-11-20T12:13:30.696 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.686+0000 7f1c237fe700 1 -- 172.21.15.192:0/2008299944 >> v1:172.21.15.146:6789/0 conn(0x7f1c24064c40 legacy=0x7f1c24151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:30.697 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.686+0000 7f1c237fe700 1 -- 172.21.15.192:0/2008299944 >> v1:172.21.15.87:6789/0 conn(0x7f1c24060370 legacy=0x7f1c240c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:30.697 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.686+0000 7f1c237fe700 1 -- 172.21.15.192:0/2008299944 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c24064500 con 0x7f1c24154920 2020-11-20T12:13:30.697 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.686+0000 7f1c237fe700 1 --2- 172.21.15.192:0/2008299944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c24154920 0x7f1c24060750 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f1c18006fd0 tx=0x7f1c18006e30).ready entity=mon.1 client_cookie=e3e79cb866293118 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:30.697 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.686+0000 7f1c22ffd700 1 -- 172.21.15.192:0/2008299944 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c18009870 con 0x7f1c24154920 2020-11-20T12:13:30.698 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.686+0000 7f1c22ffd700 1 -- 172.21.15.192:0/2008299944 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c18000e90 con 0x7f1c24154920 2020-11-20T12:13:30.698 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.686+0000 7f1c22ffd700 1 -- 172.21.15.192:0/2008299944 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c18009be0 con 0x7f1c24154920 2020-11-20T12:13:30.698 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.687+0000 7f1c2a7c2700 1 -- 172.21.15.192:0/2008299944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c24154920 msgr2=0x7f1c24060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:30.699 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.687+0000 7f1c2a7c2700 1 --2- 172.21.15.192:0/2008299944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c24154920 0x7f1c24060750 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f1c18006fd0 tx=0x7f1c18006e30).stop 2020-11-20T12:13:30.699 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.687+0000 7f1c2a7c2700 1 -- 172.21.15.192:0/2008299944 shutdown_connections 2020-11-20T12:13:30.699 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.687+0000 7f1c2a7c2700 1 --2- 172.21.15.192:0/2008299944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c24154920 0x7f1c24060750 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:30.699 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.687+0000 7f1c2a7c2700 1 -- 172.21.15.192:0/2008299944 >> 172.21.15.192:0/2008299944 conn(0x7f1c24062100 msgr2=0x7f1c240c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:30.700 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.687+0000 7f1c2a7c2700 1 -- 172.21.15.192:0/2008299944 shutdown_connections 2020-11-20T12:13:30.700 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.687+0000 7f1c2a7c2700 1 -- 172.21.15.192:0/2008299944 wait complete. 2020-11-20T12:13:30.700 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.688+0000 7f1c2a7c2700 1 Processor -- start 2020-11-20T12:13:30.701 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.688+0000 7f1c2a7c2700 1 -- start start 2020-11-20T12:13:30.701 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.689+0000 7f1c2a7c2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c24060370 0x7f1c240b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:30.701 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.689+0000 7f1c2a7c2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c24064c40 0x7f1c24156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:30.702 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.689+0000 7f1c2a7c2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1c24154920 0x7f1c2414c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:30.702 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.689+0000 7f1c2a7c2700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c24155a80 con 0x7f1c24154920 2020-11-20T12:13:30.702 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.689+0000 7f1c2a7c2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c24155d20 con 0x7f1c24060370 2020-11-20T12:13:30.702 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.689+0000 7f1c2a7c2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c24155fc0 con 0x7f1c24064c40 2020-11-20T12:13:30.703 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.689+0000 7f1c237fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c24064c40 0x7f1c24156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:30.703 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.689+0000 7f1c237fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c24064c40 0x7f1c24156e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49726/0 (socket says 172.21.15.192:49726) 2020-11-20T12:13:30.703 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.689+0000 7f1c237fe700 1 -- 172.21.15.192:0/4259686769 learned_addr learned my addr 172.21.15.192:0/4259686769 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:30.704 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.689+0000 7f1c23fff700 1 --2- 172.21.15.192:0/4259686769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c24060370 0x7f1c240b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:30.704 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.689+0000 7f1c28d5f700 1 --2- 172.21.15.192:0/4259686769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1c24154920 0x7f1c2414c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:30.704 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.689+0000 7f1c237fe700 1 -- 172.21.15.192:0/4259686769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c24060370 msgr2=0x7f1c240b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:30.705 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.689+0000 7f1c237fe700 1 --2- 172.21.15.192:0/4259686769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c24060370 0x7f1c240b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:30.705 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.689+0000 7f1c237fe700 1 -- 172.21.15.192:0/4259686769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1c24154920 msgr2=0x7f1c2414c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:30.705 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.689+0000 7f1c237fe700 1 --2- 172.21.15.192:0/4259686769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1c24154920 0x7f1c2414c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:30.705 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.689+0000 7f1c237fe700 1 -- 172.21.15.192:0/4259686769 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c24163bd0 con 0x7f1c24064c40 2020-11-20T12:13:30.706 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.689+0000 7f1c237fe700 1 --2- 172.21.15.192:0/4259686769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c24064c40 0x7f1c24156e00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f1c18010000 tx=0x7f1c18015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:30.706 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.689+0000 7f1c0bfff700 1 -- 172.21.15.192:0/4259686769 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c18011d90 con 0x7f1c24064c40 2020-11-20T12:13:30.706 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.690+0000 7f1c0bfff700 1 -- 172.21.15.192:0/4259686769 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1801d3c0 con 0x7f1c24064c40 2020-11-20T12:13:30.707 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.690+0000 7f1c2a7c2700 1 -- 172.21.15.192:0/4259686769 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c240b0990 con 0x7f1c24064c40 2020-11-20T12:13:30.707 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.690+0000 7f1c0bfff700 1 -- 172.21.15.192:0/4259686769 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1801d740 con 0x7f1c24064c40 2020-11-20T12:13:30.707 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.690+0000 7f1c2a7c2700 1 -- 172.21.15.192:0/4259686769 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c241606d0 con 0x7f1c24064c40 2020-11-20T12:13:30.707 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.690+0000 7f1c2a7c2700 1 -- 172.21.15.192:0/4259686769 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c240699a0 con 0x7f1c24064c40 2020-11-20T12:13:30.709 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.691+0000 7f1c0bfff700 1 -- 172.21.15.192:0/4259686769 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f1c1801a040 con 0x7f1c24064c40 2020-11-20T12:13:30.709 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.692+0000 7f1c0bfff700 1 --2- 172.21.15.192:0/4259686769 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f1c00080670 0x7f1c00082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:30.710 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.692+0000 7f1c0bfff700 1 -- 172.21.15.192:0/4259686769 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f1c180a3eb0 con 0x7f1c24064c40 2020-11-20T12:13:30.710 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.692+0000 7f1c23fff700 1 --2- 172.21.15.192:0/4259686769 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f1c00080670 0x7f1c00082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:30.710 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.692+0000 7f1c23fff700 1 --2- 172.21.15.192:0/4259686769 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f1c00080670 0x7f1c00082b30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f1c140055e0 tx=0x7f1c14009040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:30.711 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.694+0000 7f1c0bfff700 1 -- 172.21.15.192:0/4259686769 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f1c180788c0 con 0x7f1c24064c40 2020-11-20T12:13:30.840 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.837+0000 7f1c2a7c2700 1 -- 172.21.15.192:0/4259686769 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c2405ca80 con 0x7f1c24064c40 2020-11-20T12:13:30.840 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.838+0000 7f1c0bfff700 1 -- 172.21.15.192:0/4259686769 <== mon.2 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21795 (secure 0 0 0) 0x7f1c1807bee0 con 0x7f1c24064c40 2020-11-20T12:13:30.841 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T12:13:30.842 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":28,"fsid":"4871390d-d110-4379-8302-5810d7b54f34","created":"2020-11-20T11:47:49.059675+0000","modified":"2020-11-20T11:48:09.832333+0000","last_up_change":"2020-11-20T11:47:57.317253+0000","last_in_change":"2020-11-20T11:47:57.317253+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:47:52.327778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:48:01.912951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:48:04.793810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:48:07.506705+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77a5e1d9-0fb0-450c-872e-4aee77dede49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":23242},{"type":"v1","addr":"172.21.15.192:6827","nonce":23242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":23242},{"type":"v1","addr":"172.21.15.192:6829","nonce":23242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":23242},{"type":"v1","addr":"172.21.15.192:6833","nonce":23242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":23242},{"type":"v1","addr":"172.21.15.192:6831","nonce":23242}]},"public_addr":"172.21.15.192:6827/23242","cluster_addr":"172.21.15.192:6829/23242","heartbeat_back_addr":"172.21.15.192:6833/23242","heartbeat_front_addr":"172.21.15.192:6831/23242","state":["exists","up"]},{"osd":1,"uuid":"564330c6-5c45-4ef6-8718-bbfa97848e6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":22856},{"type":"v1","addr":"172.21.15.146:6801","nonce":22856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":22856},{"type":"v1","addr":"172.21.15.146:6803","nonce":22856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":22856},{"type":"v1","addr":"172.21.15.146:6807","nonce":22856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":22856},{"type":"v1","addr":"172.21.15.146:6805","nonce":22856}]},"public_addr":"172.21.15.146:6801/22856","cluster_addr":"172.21.15.146:6803/22856","heartbeat_back_addr":"172.21.15.146:6807/22856","heartbeat_front_addr":"172.21.15.146:6805/22856","state":["exists","up"]},{"osd":2,"uuid":"128ddb77-579b-4fa3-a0cb-7465ad959f3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6815","nonce":23326},{"type":"v1","addr":"172.21.15.87:6817","nonce":23326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":23326},{"type":"v1","addr":"172.21.15.87:6819","nonce":23326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":23326},{"type":"v1","addr":"172.21.15.87:6823","nonce":23326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":23326},{"type":"v1","addr":"172.21.15.87:6821","nonce":23326}]},"public_addr":"172.21.15.87:6817/23326","cluster_addr":"172.21.15.87:6819/23326","heartbeat_back_addr":"172.21.15.87:6823/23326","heartbeat_front_addr":"172.21.15.87:6821/23326","state":["exists","up"]},{"osd":3,"uuid":"4668cfdf-d172-4f30-95b8-ac842108a520","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":23243},{"type":"v1","addr":"172.21.15.192:6803","nonce":23243}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":23243},{"type":"v1","addr":"172.21.15.192:6805","nonce":23243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":23243},{"type":"v1","addr":"172.21.15.192:6809","nonce":23243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":23243},{"type":"v1","addr":"172.21.15.192:6807","nonce":23243}]},"public_addr":"172.21.15.192:6803/23243","cluster_addr":"172.21.15.192:6805/23243","heartbeat_back_addr":"172.21.15.192:6809/23243","heartbeat_front_addr":"172.21.15.192:6807/23243","state":["exists","up"]},{"osd":4,"uuid":"c4bc8ba5-0d22-49f5-97a6-2ca71e3a8c62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":22857},{"type":"v1","addr":"172.21.15.146:6809","nonce":22857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":22857},{"type":"v1","addr":"172.21.15.146:6811","nonce":22857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":22857},{"type":"v1","addr":"172.21.15.146:6815","nonce":22857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":22857},{"type":"v1","addr":"172.21.15.146:6813","nonce":22857}]},"public_addr":"172.21.15.146:6809/22857","cluster_addr":"172.21.15.146:6811/22857","heartbeat_back_addr":"172.21.15.146:6815/22857","heartbeat_front_addr":"172.21.15.146:6813/22857","state":["exists","up"]},{"osd":5,"uuid":"2d15f1db-e580-4715-9728-8fe5dd7e34d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":23316},{"type":"v1","addr":"172.21.15.87:6801","nonce":23316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":23316},{"type":"v1","addr":"172.21.15.87:6803","nonce":23316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":23316},{"type":"v1","addr":"172.21.15.87:6807","nonce":23316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":23316},{"type":"v1","addr":"172.21.15.87:6805","nonce":23316}]},"public_addr":"172.21.15.87:6801/23316","cluster_addr":"172.21.15.87:6803/23316","heartbeat_back_addr":"172.21.15.87:6807/23316","heartbeat_front_addr":"172.21.15.87:6805/23316","state":["exists","up"]},{"osd":6,"uuid":"a659da2b-bdce-42ac-8b30-b8c69b4c7041","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":23246},{"type":"v1","addr":"172.21.15.192:6811","nonce":23246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":23246},{"type":"v1","addr":"172.21.15.192:6813","nonce":23246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":23246},{"type":"v1","addr":"172.21.15.192:6817","nonce":23246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":23246},{"type":"v1","addr":"172.21.15.192:6815","nonce":23246}]},"public_addr":"172.21.15.192:6811/23246","cluster_addr":"172.21.15.192:6813/23246","heartbeat_back_addr":"172.21.15.192:6817/23246","heartbeat_front_addr":"172.21.15.192:6815/23246","state":["exists","up"]},{"osd":7,"uuid":"d6e41ac5-bab7-49e2-a17a-ef794bcc4a09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":22858},{"type":"v1","addr":"172.21.15.146:6818","nonce":22858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":22858},{"type":"v1","addr":"172.21.15.146:6822","nonce":22858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":22858},{"type":"v1","addr":"172.21.15.146:6830","nonce":22858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":22858},{"type":"v1","addr":"172.21.15.146:6826","nonce":22858}]},"public_addr":"172.21.15.146:6818/22858","cluster_addr":"172.21.15.146:6822/22858","heartbeat_back_addr":"172.21.15.146:6830/22858","heartbeat_front_addr":"172.21.15.146:6826/22858","state":["exists","up"]},{"osd":8,"uuid":"c4907993-7513-4162-974f-07dcb0a260a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":23333},{"type":"v1","addr":"172.21.15.87:6825","nonce":23333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6826","nonce":23333},{"type":"v1","addr":"172.21.15.87:6827","nonce":23333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6830","nonce":23333},{"type":"v1","addr":"172.21.15.87:6831","nonce":23333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6828","nonce":23333},{"type":"v1","addr":"172.21.15.87:6829","nonce":23333}]},"public_addr":"172.21.15.87:6825/23333","cluster_addr":"172.21.15.87:6827/23333","heartbeat_back_addr":"172.21.15.87:6831/23333","heartbeat_front_addr":"172.21.15.87:6829/23333","state":["exists","up"]},{"osd":9,"uuid":"3523676f-c9b8-47ae-86c0-4930dca17831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":23254},{"type":"v1","addr":"172.21.15.192:6819","nonce":23254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":23254},{"type":"v1","addr":"172.21.15.192:6821","nonce":23254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":23254},{"type":"v1","addr":"172.21.15.192:6825","nonce":23254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":23254},{"type":"v1","addr":"172.21.15.192:6823","nonce":23254}]},"public_addr":"172.21.15.192:6819/23254","cluster_addr":"172.21.15.192:6821/23254","heartbeat_back_addr":"172.21.15.192:6825/23254","heartbeat_front_addr":"172.21.15.192:6823/23254","state":["exists","up"]},{"osd":10,"uuid":"88d5c251-0bb1-4624-8fa2-7f3b74bd1bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6817","nonce":22859},{"type":"v1","addr":"172.21.15.146:6819","nonce":22859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6821","nonce":22859},{"type":"v1","addr":"172.21.15.146:6823","nonce":22859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6829","nonce":22859},{"type":"v1","addr":"172.21.15.146:6831","nonce":22859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6825","nonce":22859},{"type":"v1","addr":"172.21.15.146:6827","nonce":22859}]},"public_addr":"172.21.15.146:6819/22859","cluster_addr":"172.21.15.146:6823/22859","heartbeat_back_addr":"172.21.15.146:6831/22859","heartbeat_front_addr":"172.21.15.146:6827/22859","state":["exists","up"]},{"osd":11,"uuid":"31f650d6-ba1e-4f29-92ff-6abee04c0f12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":23317},{"type":"v1","addr":"172.21.15.87:6809","nonce":23317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":23317},{"type":"v1","addr":"172.21.15.87:6811","nonce":23317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":23317},{"type":"v1","addr":"172.21.15.87:6816","nonce":23317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":23317},{"type":"v1","addr":"172.21.15.87:6813","nonce":23317}]},"public_addr":"172.21.15.87:6809/23317","cluster_addr":"172.21.15.87:6811/23317","heartbeat_back_addr":"172.21.15.87:6816/23317","heartbeat_front_addr":"172.21.15.87:6813/23317","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.538863+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.552293+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.585265+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.505194+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.550032+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.558089+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.565622+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.587102+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.654330+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.599072+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.645833+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:47:55.596236+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T12:13:30.843 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.839+0000 7f1c2a7c2700 1 -- 172.21.15.192:0/4259686769 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f1c00080670 msgr2=0x7f1c00082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:30.843 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.839+0000 7f1c2a7c2700 1 --2- 172.21.15.192:0/4259686769 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f1c00080670 0x7f1c00082b30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f1c140055e0 tx=0x7f1c14009040).stop 2020-11-20T12:13:30.843 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.839+0000 7f1c2a7c2700 1 -- 172.21.15.192:0/4259686769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c24064c40 msgr2=0x7f1c24156e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:30.844 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.839+0000 7f1c2a7c2700 1 --2- 172.21.15.192:0/4259686769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c24064c40 0x7f1c24156e00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f1c18010000 tx=0x7f1c18015000).stop 2020-11-20T12:13:30.844 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.839+0000 7f1c2a7c2700 1 -- 172.21.15.192:0/4259686769 shutdown_connections 2020-11-20T12:13:30.844 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.839+0000 7f1c2a7c2700 1 --2- 172.21.15.192:0/4259686769 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f1c00080670 0x7f1c00082b30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:30.844 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.839+0000 7f1c2a7c2700 1 --2- 172.21.15.192:0/4259686769 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f1c24154920 0x7f1c2414c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:30.845 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.839+0000 7f1c2a7c2700 1 --2- 172.21.15.192:0/4259686769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c24060370 0x7f1c240b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:30.845 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.839+0000 7f1c2a7c2700 1 --2- 172.21.15.192:0/4259686769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c24064c40 0x7f1c24156e00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:30.845 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.839+0000 7f1c2a7c2700 1 -- 172.21.15.192:0/4259686769 >> 172.21.15.192:0/4259686769 conn(0x7f1c24062100 msgr2=0x7f1c240c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:30.845 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.839+0000 7f1c2a7c2700 1 -- 172.21.15.192:0/4259686769 shutdown_connections 2020-11-20T12:13:30.845 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:30.839+0000 7f1c2a7c2700 1 -- 172.21.15.192:0/4259686769 wait complete. 2020-11-20T12:13:31.857 INFO:tasks.ceph:Scrubbing osd.0 2020-11-20T12:13:31.857 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:13:31.984 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.981+0000 7f102ca59700 1 Processor -- start 2020-11-20T12:13:31.984 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.981+0000 7f102ca59700 1 -- start start 2020-11-20T12:13:31.986 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.981+0000 7f102ca59700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1028060370 0x7f1028060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:31.987 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.981+0000 7f102ca59700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f1028154920 0x7f1028064c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:31.987 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.981+0000 7f102ca59700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f10280c2340 0x7f1028151340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:31.987 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.981+0000 7f102ca59700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1028065130 con 0x7f1028154920 2020-11-20T12:13:31.987 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.981+0000 7f102ca59700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1028151e80 con 0x7f1028060370 2020-11-20T12:13:31.988 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.981+0000 7f102ca59700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1028152120 con 0x7f10280c2340 2020-11-20T12:13:31.988 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.982+0000 7f1026d9d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f10280c2340 0x7f1028151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:31.988 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.982+0000 7f1026d9d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f10280c2340 0x7f1028151340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49732/0 (socket says 172.21.15.192:49732) 2020-11-20T12:13:31.988 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.982+0000 7f1026d9d700 1 -- 172.21.15.192:0/335026152 learned_addr learned my addr 172.21.15.192:0/335026152 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:31.988 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.982+0000 7f101ffff700 1 --2- 172.21.15.192:0/335026152 >> v2:172.21.15.87:3300/0 conn(0x7f1028154920 0x7f1028064c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:31.989 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.982+0000 7f102659c700 1 --2- 172.21.15.192:0/335026152 >> v2:172.21.15.146:3300/0 conn(0x7f1028060370 0x7f1028060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:31.989 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.982+0000 7f1026d9d700 1 -- 172.21.15.192:0/335026152 >> v2:172.21.15.146:3300/0 conn(0x7f1028060370 msgr2=0x7f1028060750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:31.989 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.982+0000 7f1026d9d700 1 --2- 172.21.15.192:0/335026152 >> v2:172.21.15.146:3300/0 conn(0x7f1028060370 0x7f1028060750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:31.989 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.982+0000 7f1026d9d700 1 -- 172.21.15.192:0/335026152 >> v2:172.21.15.87:3300/0 conn(0x7f1028154920 msgr2=0x7f1028064c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:31.989 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.982+0000 7f1026d9d700 1 --2- 172.21.15.192:0/335026152 >> v2:172.21.15.87:3300/0 conn(0x7f1028154920 0x7f1028064c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:31.990 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.982+0000 7f1026d9d700 1 -- 172.21.15.192:0/335026152 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1028064260 con 0x7f10280c2340 2020-11-20T12:13:31.990 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.982+0000 7f1026d9d700 1 --2- 172.21.15.192:0/335026152 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10280c2340 0x7f1028151340 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f10280c5450 tx=0x7f10200092d0).ready entity=mon.2 client_cookie=33f19ae1a618e243 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:31.990 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.982+0000 7f1025d9b700 1 -- 172.21.15.192:0/335026152 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102000bc50 con 0x7f10280c2340 2020-11-20T12:13:31.990 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.982+0000 7f1025d9b700 1 -- 172.21.15.192:0/335026152 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102000bdb0 con 0x7f10280c2340 2020-11-20T12:13:31.990 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.982+0000 7f1025d9b700 1 -- 172.21.15.192:0/335026152 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1020011610 con 0x7f10280c2340 2020-11-20T12:13:31.991 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.983+0000 7f102ca59700 1 -- 172.21.15.192:0/335026152 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10280c2340 msgr2=0x7f1028151340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:31.991 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.983+0000 7f102ca59700 1 --2- 172.21.15.192:0/335026152 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10280c2340 0x7f1028151340 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f10280c5450 tx=0x7f10200092d0).stop 2020-11-20T12:13:31.991 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.983+0000 7f102ca59700 1 -- 172.21.15.192:0/335026152 shutdown_connections 2020-11-20T12:13:31.991 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.983+0000 7f102ca59700 1 --2- 172.21.15.192:0/335026152 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10280c2340 0x7f1028151340 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:31.991 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.983+0000 7f102ca59700 1 --2- 172.21.15.192:0/335026152 >> v2:172.21.15.146:3300/0 conn(0x7f1028060370 0x7f1028060750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:31.992 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.983+0000 7f102ca59700 1 --2- 172.21.15.192:0/335026152 >> v2:172.21.15.87:3300/0 conn(0x7f1028154920 0x7f1028064c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:31.992 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.983+0000 7f102ca59700 1 -- 172.21.15.192:0/335026152 >> 172.21.15.192:0/335026152 conn(0x7f1028062100 msgr2=0x7f10280c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:31.992 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.983+0000 7f102ca59700 1 -- 172.21.15.192:0/335026152 shutdown_connections 2020-11-20T12:13:31.992 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.983+0000 7f102ca59700 1 -- 172.21.15.192:0/335026152 wait complete. 2020-11-20T12:13:31.995 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.984+0000 7f102ca59700 1 Processor -- start 2020-11-20T12:13:31.996 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.984+0000 7f102ca59700 1 -- start start 2020-11-20T12:13:31.996 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.985+0000 7f102ca59700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1028060370 0x7f10280c18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:31.996 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.985+0000 7f102ca59700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10280c2340 0x7f10280c0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:31.996 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.985+0000 7f102ca59700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1028154920 0x7f10280c28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:31.996 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.985+0000 7f102ca59700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1028163af0 con 0x7f10280c2340 2020-11-20T12:13:31.997 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.985+0000 7f102ca59700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10281649a0 con 0x7f1028060370 2020-11-20T12:13:31.997 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.985+0000 7f102ca59700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10280c0de0 con 0x7f1028154920 2020-11-20T12:13:31.997 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.985+0000 7f1026d9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1028154920 0x7f10280c28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:31.997 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.985+0000 7f1026d9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1028154920 0x7f10280c28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49740/0 (socket says 172.21.15.192:49740) 2020-11-20T12:13:31.997 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.985+0000 7f1026d9d700 1 -- 172.21.15.192:0/2178646934 learned_addr learned my addr 172.21.15.192:0/2178646934 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:31.998 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.985+0000 7f101ffff700 1 --2- 172.21.15.192:0/2178646934 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10280c2340 0x7f10280c0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:31.998 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.985+0000 7f102659c700 1 --2- 172.21.15.192:0/2178646934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1028060370 0x7f10280c18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:31.998 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.985+0000 7f1026d9d700 1 -- 172.21.15.192:0/2178646934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1028060370 msgr2=0x7f10280c18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:31.998 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.985+0000 7f1026d9d700 1 --2- 172.21.15.192:0/2178646934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1028060370 0x7f10280c18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:31.999 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.985+0000 7f1026d9d700 1 -- 172.21.15.192:0/2178646934 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10280c2340 msgr2=0x7f10280c0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:31.999 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.985+0000 7f1026d9d700 1 --2- 172.21.15.192:0/2178646934 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f10280c2340 0x7f10280c0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:31.999 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.985+0000 7f1026d9d700 1 -- 172.21.15.192:0/2178646934 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1028163d20 con 0x7f1028154920 2020-11-20T12:13:31.999 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.985+0000 7f102659c700 1 --2- 172.21.15.192:0/2178646934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1028060370 0x7f10280c18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:13:31.999 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.985+0000 7f1026d9d700 1 --2- 172.21.15.192:0/2178646934 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1028154920 0x7f10280c28e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f1028152260 tx=0x7f1020016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:32.000 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.985+0000 7f101e7fc700 1 -- 172.21.15.192:0/2178646934 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1020010700 con 0x7f1028154920 2020-11-20T12:13:32.000 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.985+0000 7f101e7fc700 1 -- 172.21.15.192:0/2178646934 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1020010860 con 0x7f1028154920 2020-11-20T12:13:32.000 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.985+0000 7f102ca59700 1 -- 172.21.15.192:0/2178646934 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1028163fc0 con 0x7f1028154920 2020-11-20T12:13:32.000 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.985+0000 7f101e7fc700 1 -- 172.21.15.192:0/2178646934 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1020010be0 con 0x7f1028154920 2020-11-20T12:13:32.000 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.985+0000 7f102ca59700 1 -- 172.21.15.192:0/2178646934 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1028164500 con 0x7f1028154920 2020-11-20T12:13:32.001 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.986+0000 7f102ca59700 1 -- 172.21.15.192:0/2178646934 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f10280c0b90 con 0x7f1028154920 2020-11-20T12:13:32.001 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.987+0000 7f101e7fc700 1 -- 172.21.15.192:0/2178646934 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f1020017070 con 0x7f1028154920 2020-11-20T12:13:32.001 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.987+0000 7f101e7fc700 1 --2- 172.21.15.192:0/2178646934 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f1004080670 0x7f1004082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:32.001 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.987+0000 7f101e7fc700 1 -- 172.21.15.192:0/2178646934 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f10200a4b60 con 0x7f1028154920 2020-11-20T12:13:32.001 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.987+0000 7f102659c700 1 --2- 172.21.15.192:0/2178646934 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f1004080670 0x7f1004082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:32.002 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.988+0000 7f101e7fc700 1 --2- 172.21.15.192:0/2178646934 >> [v2:172.21.15.192:6826/23242,v1:172.21.15.192:6827/23242] conn(0x7f10040893a0 0x7f100408b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:32.002 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.988+0000 7f101e7fc700 1 -- 172.21.15.192:0/2178646934 --> [v2:172.21.15.192:6826/23242,v1:172.21.15.192:6827/23242] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f100408be20 con 0x7f10040893a0 2020-11-20T12:13:32.002 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.988+0000 7f101e7fc700 1 -- 172.21.15.192:0/2178646934 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10200a9220 con 0x7f1028154920 2020-11-20T12:13:32.002 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.988+0000 7f101ffff700 1 --2- 172.21.15.192:0/2178646934 >> [v2:172.21.15.192:6826/23242,v1:172.21.15.192:6827/23242] conn(0x7f10040893a0 0x7f100408b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:32.002 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.988+0000 7f102659c700 1 --2- 172.21.15.192:0/2178646934 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f1004080670 0x7f1004082b30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f10180096b0 tx=0x7f1018008040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:32.003 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.988+0000 7f101ffff700 1 --2- 172.21.15.192:0/2178646934 >> [v2:172.21.15.192:6826/23242,v1:172.21.15.192:6827/23242] conn(0x7f10040893a0 0x7f100408b7c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:32.003 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:31.989+0000 7f101e7fc700 1 -- 172.21.15.192:0/2178646934 <== osd.0 v2:172.21.15.192:6826/23242 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f100408be20 con 0x7f10040893a0 2020-11-20T12:13:32.005 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.002+0000 7f102ca59700 1 -- 172.21.15.192:0/2178646934 --> [v2:172.21.15.192:6826/23242,v1:172.21.15.192:6827/23242] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f10280699a0 con 0x7f10040893a0 2020-11-20T12:13:32.007 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.002+0000 7f101e7fc700 1 -- 172.21.15.192:0/2178646934 <== osd.0 v2:172.21.15.192:6826/23242 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f10280699a0 con 0x7f10040893a0 2020-11-20T12:13:32.007 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.003+0000 7f102ca59700 1 -- 172.21.15.192:0/2178646934 >> [v2:172.21.15.192:6826/23242,v1:172.21.15.192:6827/23242] conn(0x7f10040893a0 msgr2=0x7f100408b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:32.007 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.003+0000 7f102ca59700 1 --2- 172.21.15.192:0/2178646934 >> [v2:172.21.15.192:6826/23242,v1:172.21.15.192:6827/23242] conn(0x7f10040893a0 0x7f100408b7c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:32.007 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.003+0000 7f102ca59700 1 -- 172.21.15.192:0/2178646934 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f1004080670 msgr2=0x7f1004082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:32.008 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.003+0000 7f102ca59700 1 --2- 172.21.15.192:0/2178646934 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f1004080670 0x7f1004082b30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f10180096b0 tx=0x7f1018008040).stop 2020-11-20T12:13:32.008 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.003+0000 7f102ca59700 1 -- 172.21.15.192:0/2178646934 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1028154920 msgr2=0x7f10280c28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:32.008 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.003+0000 7f102ca59700 1 --2- 172.21.15.192:0/2178646934 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1028154920 0x7f10280c28e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f1028152260 tx=0x7f1020016000).stop 2020-11-20T12:13:32.008 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.003+0000 7f1026d9d700 1 -- 172.21.15.192:0/2178646934 reap_dead start 2020-11-20T12:13:32.008 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.003+0000 7f102ca59700 1 -- 172.21.15.192:0/2178646934 shutdown_connections 2020-11-20T12:13:32.009 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.003+0000 7f102ca59700 1 -- 172.21.15.192:0/2178646934 >> 172.21.15.192:0/2178646934 conn(0x7f1028062100 msgr2=0x7f1028153bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:32.009 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.003+0000 7f102ca59700 1 -- 172.21.15.192:0/2178646934 shutdown_connections 2020-11-20T12:13:32.009 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.003+0000 7f102ca59700 1 -- 172.21.15.192:0/2178646934 wait complete. 2020-11-20T12:13:32.009 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2020-11-20T12:13:32.009 INFO:teuthology.orchestra.run.smithi192.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:13:32.010 INFO:teuthology.orchestra.run.smithi192.stdout:} 2020-11-20T12:13:32.018 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2020-11-20T12:13:32.127 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.123+0000 7f357d096700 1 Processor -- start 2020-11-20T12:13:32.127 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.123+0000 7f357d096700 1 -- start start 2020-11-20T12:13:32.129 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.124+0000 7f357d096700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3578154920 0x7f3578060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:32.129 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.124+0000 7f357d096700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3578064c40 0x7f3578151340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:32.130 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.124+0000 7f357d096700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3578151e80 con 0x7f3578060370 2020-11-20T12:13:32.130 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.124+0000 7f357d096700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3578152120 con 0x7f3578064c40 2020-11-20T12:13:32.130 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.124+0000 7f357d096700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3578064260 con 0x7f3578154920 2020-11-20T12:13:32.130 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.124+0000 7f356ffff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3578154920 0x7f3578060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:32.131 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.124+0000 7f3576d9d700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f3578060370 0x7f35780c2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52416/0 (socket says 172.21.15.192:52416) 2020-11-20T12:13:32.131 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.124+0000 7f3576d9d700 1 -- 172.21.15.192:0/3206978693 learned_addr learned my addr 172.21.15.192:0/3206978693 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T12:13:32.131 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.124+0000 7f357759e700 1 --2- 172.21.15.192:0/3206978693 >> v2:172.21.15.87:3300/0 conn(0x7f3578064c40 0x7f3578151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:32.131 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.125+0000 7f356ffff700 1 -- 172.21.15.192:0/3206978693 >> v2:172.21.15.87:3300/0 conn(0x7f3578064c40 msgr2=0x7f3578151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:32.131 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.125+0000 7f356ffff700 1 --2- 172.21.15.192:0/3206978693 >> v2:172.21.15.87:3300/0 conn(0x7f3578064c40 0x7f3578151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:32.132 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.125+0000 7f356ffff700 1 -- 172.21.15.192:0/3206978693 >> v1:172.21.15.192:6789/0 conn(0x7f3578060370 legacy=0x7f35780c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:32.132 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.125+0000 7f357659c700 1 -- 172.21.15.192:0/3206978693 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1639185214 0 0) 0x7f3578151e80 con 0x7f3578060370 2020-11-20T12:13:32.132 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.125+0000 7f356ffff700 1 -- 172.21.15.192:0/3206978693 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3578064500 con 0x7f3578154920 2020-11-20T12:13:32.132 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.125+0000 7f356ffff700 1 --2- 172.21.15.192:0/3206978693 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3578154920 0x7f3578060750 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f3578060f60 tx=0x7f3560006e30).ready entity=mon.2 client_cookie=e78ec92780391b93 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:32.132 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.125+0000 7f357659c700 1 -- 172.21.15.192:0/3206978693 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3560009840 con 0x7f3578154920 2020-11-20T12:13:32.133 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.125+0000 7f357659c700 1 -- 172.21.15.192:0/3206978693 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3560000e90 con 0x7f3578154920 2020-11-20T12:13:32.133 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.125+0000 7f357659c700 1 -- 172.21.15.192:0/3206978693 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3560009bb0 con 0x7f3578154920 2020-11-20T12:13:32.133 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.125+0000 7f357d096700 1 -- 172.21.15.192:0/3206978693 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3578154920 msgr2=0x7f3578060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:32.133 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.125+0000 7f357d096700 1 --2- 172.21.15.192:0/3206978693 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3578154920 0x7f3578060750 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f3578060f60 tx=0x7f3560006e30).stop 2020-11-20T12:13:32.133 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.125+0000 7f357d096700 1 -- 172.21.15.192:0/3206978693 shutdown_connections 2020-11-20T12:13:32.134 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.125+0000 7f357d096700 1 --2- 172.21.15.192:0/3206978693 >> v2:172.21.15.87:3300/0 conn(0x7f3578064c40 0x7f3578151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:32.134 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.125+0000 7f357d096700 1 --2- 172.21.15.192:0/3206978693 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3578154920 0x7f3578060750 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:32.134 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.125+0000 7f357d096700 1 -- 172.21.15.192:0/3206978693 >> 172.21.15.192:0/3206978693 conn(0x7f3578062100 msgr2=0x7f35780c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:32.134 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.125+0000 7f357d096700 1 -- 172.21.15.192:0/3206978693 shutdown_connections 2020-11-20T12:13:32.134 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.125+0000 7f357d096700 1 -- 172.21.15.192:0/3206978693 wait complete. 2020-11-20T12:13:32.137 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.127+0000 7f357d096700 1 Processor -- start 2020-11-20T12:13:32.137 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.127+0000 7f357d096700 1 -- start start 2020-11-20T12:13:32.137 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.127+0000 7f357d096700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3578060370 0x7f35780b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:32.138 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.127+0000 7f357d096700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3578064c40 0x7f35780c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:32.138 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.127+0000 7f357d096700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3578154920 0x7f357814c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:32.138 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.127+0000 7f357d096700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35780bfbe0 con 0x7f3578060370 2020-11-20T12:13:32.138 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.127+0000 7f357d096700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35780bfe80 con 0x7f3578154920 2020-11-20T12:13:32.138 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.127+0000 7f357d096700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35780c0120 con 0x7f3578064c40 2020-11-20T12:13:32.139 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.127+0000 7f356ffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3578064c40 0x7f35780c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:32.139 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.127+0000 7f356ffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3578064c40 0x7f35780c46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49756/0 (socket says 172.21.15.192:49756) 2020-11-20T12:13:32.139 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.127+0000 7f356ffff700 1 -- 172.21.15.192:0/612490268 learned_addr learned my addr 172.21.15.192:0/612490268 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:32.139 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.128+0000 7f3576d9d700 1 --2- 172.21.15.192:0/612490268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3578060370 0x7f35780b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:32.140 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.128+0000 7f356ffff700 1 -- 172.21.15.192:0/612490268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3578154920 msgr2=0x7f357814c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:32.140 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.128+0000 7f356ffff700 1 --2- 172.21.15.192:0/612490268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3578154920 0x7f357814c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:13:32.140 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.128+0000 7f356ffff700 1 -- 172.21.15.192:0/612490268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3578060370 msgr2=0x7f35780b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:32.140 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.128+0000 7f356ffff700 1 --2- 172.21.15.192:0/612490268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3578060370 0x7f35780b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:32.140 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.128+0000 7f356ffff700 1 -- 172.21.15.192:0/612490268 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35780c03c0 con 0x7f3578064c40 2020-11-20T12:13:32.141 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.128+0000 7f3576d9d700 1 --2- 172.21.15.192:0/612490268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3578060370 0x7f35780b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:13:32.141 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.128+0000 7f356ffff700 1 --2- 172.21.15.192:0/612490268 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3578064c40 0x7f35780c46e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f3560009fd0 tx=0x7f3560015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:32.141 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.128+0000 7f356effd700 1 -- 172.21.15.192:0/612490268 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3560011d70 con 0x7f3578064c40 2020-11-20T12:13:32.141 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.128+0000 7f356effd700 1 -- 172.21.15.192:0/612490268 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356001e460 con 0x7f3578064c40 2020-11-20T12:13:32.141 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.128+0000 7f357d096700 1 -- 172.21.15.192:0/612490268 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35780c0660 con 0x7f3578064c40 2020-11-20T12:13:32.142 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.128+0000 7f356effd700 1 -- 172.21.15.192:0/612490268 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356001e800 con 0x7f3578064c40 2020-11-20T12:13:32.142 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.128+0000 7f357d096700 1 -- 172.21.15.192:0/612490268 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35780b0830 con 0x7f3578064c40 2020-11-20T12:13:32.142 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.129+0000 7f357d096700 1 -- 172.21.15.192:0/612490268 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35780c0ac0 con 0x7f3578064c40 2020-11-20T12:13:32.142 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.129+0000 7f356effd700 1 -- 172.21.15.192:0/612490268 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f3560025030 con 0x7f3578064c40 2020-11-20T12:13:32.142 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.130+0000 7f356effd700 1 --2- 172.21.15.192:0/612490268 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3554080670 0x7f3554082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:32.143 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.130+0000 7f356effd700 1 -- 172.21.15.192:0/612490268 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f35600a4210 con 0x7f3578064c40 2020-11-20T12:13:32.143 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.130+0000 7f3576d9d700 1 --2- 172.21.15.192:0/612490268 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3554080670 0x7f3554082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:32.143 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.130+0000 7f3576d9d700 1 --2- 172.21.15.192:0/612490268 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3554080670 0x7f3554082b30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f3568007fd0 tx=0x7f3568009040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:32.143 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.133+0000 7f356effd700 1 -- 172.21.15.192:0/612490268 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f3560078c20 con 0x7f3578064c40 2020-11-20T12:13:32.275 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.272+0000 7f357d096700 1 -- 172.21.15.192:0/612490268 --> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f35780699a0 con 0x7f3554080670 2020-11-20T12:13:32.276 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.272+0000 7f356effd700 1 -- 172.21.15.192:0/612490268 <== mgr.4106 v2:172.21.15.192:6800/22925 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f35780699a0 con 0x7f3554080670 2020-11-20T12:13:32.277 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.274+0000 7f357d096700 1 -- 172.21.15.192:0/612490268 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3554080670 msgr2=0x7f3554082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:32.277 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.274+0000 7f357d096700 1 --2- 172.21.15.192:0/612490268 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3554080670 0x7f3554082b30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f3568007fd0 tx=0x7f3568009040).stop 2020-11-20T12:13:32.278 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.274+0000 7f357d096700 1 -- 172.21.15.192:0/612490268 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3578064c40 msgr2=0x7f35780c46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:32.278 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.274+0000 7f357d096700 1 --2- 172.21.15.192:0/612490268 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3578064c40 0x7f35780c46e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f3560009fd0 tx=0x7f3560015000).stop 2020-11-20T12:13:32.278 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.274+0000 7f357d096700 1 -- 172.21.15.192:0/612490268 shutdown_connections 2020-11-20T12:13:32.278 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.274+0000 7f357d096700 1 --2- 172.21.15.192:0/612490268 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3554080670 0x7f3554082b30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:32.279 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.274+0000 7f357d096700 1 --2- 172.21.15.192:0/612490268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3578154920 0x7f357814c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:13:32.279 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.274+0000 7f357d096700 1 --2- 172.21.15.192:0/612490268 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3578060370 0x7f35780b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:32.279 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.274+0000 7f357d096700 1 --2- 172.21.15.192:0/612490268 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3578064c40 0x7f35780c46e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:32.279 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.274+0000 7f357d096700 1 -- 172.21.15.192:0/612490268 >> 172.21.15.192:0/612490268 conn(0x7f3578062100 msgr2=0x7f35780c3260 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:32.279 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.274+0000 7f357d096700 1 -- 172.21.15.192:0/612490268 shutdown_connections 2020-11-20T12:13:32.279 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.274+0000 7f357d096700 1 -- 172.21.15.192:0/612490268 wait complete. 2020-11-20T12:13:32.280 INFO:teuthology.orchestra.run.smithi192.stderr:instructed osd(s) 0 to deep-scrub 2020-11-20T12:13:32.288 INFO:tasks.ceph:Scrubbing osd.3 2020-11-20T12:13:32.289 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:13:32.401 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.398+0000 7f2c54935700 1 Processor -- start 2020-11-20T12:13:32.401 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.398+0000 7f2c54935700 1 -- start start 2020-11-20T12:13:32.403 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.399+0000 7f2c54935700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2c50154920 0x7f2c50060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:32.404 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.399+0000 7f2c54935700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2c50064c40 0x7f2c50151340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:32.404 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.399+0000 7f2c54935700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c50151e80 con 0x7f2c50060370 2020-11-20T12:13:32.404 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.399+0000 7f2c54935700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c50152120 con 0x7f2c50154920 2020-11-20T12:13:32.404 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.399+0000 7f2c54935700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c50064260 con 0x7f2c50064c40 2020-11-20T12:13:32.405 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.399+0000 7f2c4dd9b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2c50154920 0x7f2c50060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:32.405 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.399+0000 7f2c4ed9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2c50064c40 0x7f2c50151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:32.405 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.399+0000 7f2c4dd9b700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2c50154920 0x7f2c50060750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.192:59202/0 (socket says 172.21.15.192:59202) 2020-11-20T12:13:32.405 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.399+0000 7f2c4dd9b700 1 -- 172.21.15.192:0/1425764965 learned_addr learned my addr 172.21.15.192:0/1425764965 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:32.405 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.399+0000 7f2c4dd9b700 1 -- 172.21.15.192:0/1425764965 >> v2:172.21.15.146:3300/0 conn(0x7f2c50064c40 msgr2=0x7f2c50151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:32.406 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.399+0000 7f2c4dd9b700 1 --2- 172.21.15.192:0/1425764965 >> v2:172.21.15.146:3300/0 conn(0x7f2c50064c40 0x7f2c50151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:32.406 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.399+0000 7f2c4dd9b700 1 -- 172.21.15.192:0/1425764965 >> v1:172.21.15.146:6789/0 conn(0x7f2c50060370 legacy=0x7f2c500c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:32.406 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.400+0000 7f2c4d59a700 1 -- 172.21.15.192:0/1425764965 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1594536738 0 0) 0x7f2c50151e80 con 0x7f2c50060370 2020-11-20T12:13:32.406 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.400+0000 7f2c4dd9b700 1 -- 172.21.15.192:0/1425764965 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c50064500 con 0x7f2c50154920 2020-11-20T12:13:32.407 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.400+0000 7f2c4ed9d700 1 --2- 172.21.15.192:0/1425764965 >> v2:172.21.15.146:3300/0 conn(0x7f2c50064c40 0x7f2c50151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:13:32.407 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.400+0000 7f2c4dd9b700 1 --2- 172.21.15.192:0/1425764965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c50154920 0x7f2c50060750 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f2c50065700 tx=0x7f2c40006ef0).ready entity=mon.0 client_cookie=e68b532fefdb5a7e server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:32.407 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.400+0000 7f2c4d59a700 1 -- 172.21.15.192:0/1425764965 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4000b8f0 con 0x7f2c50154920 2020-11-20T12:13:32.407 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.400+0000 7f2c4d59a700 1 -- 172.21.15.192:0/1425764965 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c40000e90 con 0x7f2c50154920 2020-11-20T12:13:32.407 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.400+0000 7f2c4d59a700 1 -- 172.21.15.192:0/1425764965 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4000bc60 con 0x7f2c50154920 2020-11-20T12:13:32.408 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.400+0000 7f2c54935700 1 -- 172.21.15.192:0/1425764965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c50154920 msgr2=0x7f2c50060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:32.408 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.400+0000 7f2c54935700 1 --2- 172.21.15.192:0/1425764965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c50154920 0x7f2c50060750 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f2c50065700 tx=0x7f2c40006ef0).stop 2020-11-20T12:13:32.408 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.400+0000 7f2c54935700 1 -- 172.21.15.192:0/1425764965 shutdown_connections 2020-11-20T12:13:32.408 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.400+0000 7f2c54935700 1 --2- 172.21.15.192:0/1425764965 >> v2:172.21.15.146:3300/0 conn(0x7f2c50064c40 0x7f2c50151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:32.408 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.400+0000 7f2c54935700 1 --2- 172.21.15.192:0/1425764965 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c50154920 0x7f2c50060750 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:32.409 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.400+0000 7f2c54935700 1 -- 172.21.15.192:0/1425764965 >> 172.21.15.192:0/1425764965 conn(0x7f2c50062100 msgr2=0x7f2c500c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:32.409 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.400+0000 7f2c54935700 1 -- 172.21.15.192:0/1425764965 shutdown_connections 2020-11-20T12:13:32.409 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.400+0000 7f2c54935700 1 -- 172.21.15.192:0/1425764965 wait complete. 2020-11-20T12:13:32.412 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.401+0000 7f2c54935700 1 Processor -- start 2020-11-20T12:13:32.412 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.401+0000 7f2c54935700 1 -- start start 2020-11-20T12:13:32.412 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.402+0000 7f2c54935700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c50060370 0x7f2c500bf870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:32.412 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.402+0000 7f2c54935700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c50064c40 0x7f2c501612c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:32.413 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.402+0000 7f2c54935700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c50154920 0x7f2c50153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:32.413 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.402+0000 7f2c54935700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c501617b0 con 0x7f2c50060370 2020-11-20T12:13:32.413 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.402+0000 7f2c54935700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c500b06b0 con 0x7f2c50154920 2020-11-20T12:13:32.413 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.402+0000 7f2c54935700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c500b0950 con 0x7f2c50064c40 2020-11-20T12:13:32.413 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.402+0000 7f2c4dd9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c50064c40 0x7f2c501612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:32.414 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.402+0000 7f2c4dd9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c50064c40 0x7f2c501612c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49770/0 (socket says 172.21.15.192:49770) 2020-11-20T12:13:32.414 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.402+0000 7f2c4dd9b700 1 -- 172.21.15.192:0/4193536006 learned_addr learned my addr 172.21.15.192:0/4193536006 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:32.414 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.402+0000 7f2c4ed9d700 1 --2- 172.21.15.192:0/4193536006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c50154920 0x7f2c50153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:32.414 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.402+0000 7f2c4e59c700 1 --2- 172.21.15.192:0/4193536006 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c50060370 0x7f2c500bf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:32.414 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.403+0000 7f2c4dd9b700 1 -- 172.21.15.192:0/4193536006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c50154920 msgr2=0x7f2c50153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:32.415 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.403+0000 7f2c4dd9b700 1 --2- 172.21.15.192:0/4193536006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c50154920 0x7f2c50153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:32.415 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.403+0000 7f2c4dd9b700 1 -- 172.21.15.192:0/4193536006 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c50060370 msgr2=0x7f2c500bf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:32.415 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.403+0000 7f2c4dd9b700 1 --2- 172.21.15.192:0/4193536006 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2c50060370 0x7f2c500bf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:32.415 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.403+0000 7f2c4dd9b700 1 -- 172.21.15.192:0/4193536006 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c50152850 con 0x7f2c50064c40 2020-11-20T12:13:32.415 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.403+0000 7f2c4dd9b700 1 --2- 172.21.15.192:0/4193536006 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c50064c40 0x7f2c501612c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f2c50066280 tx=0x7f2c40016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:32.416 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.403+0000 7f2c3e7fc700 1 -- 172.21.15.192:0/4193536006 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c40009e00 con 0x7f2c50064c40 2020-11-20T12:13:32.416 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.403+0000 7f2c3e7fc700 1 -- 172.21.15.192:0/4193536006 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c40011dc0 con 0x7f2c50064c40 2020-11-20T12:13:32.416 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.403+0000 7f2c54935700 1 -- 172.21.15.192:0/4193536006 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c50152af0 con 0x7f2c50064c40 2020-11-20T12:13:32.416 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.403+0000 7f2c3e7fc700 1 -- 172.21.15.192:0/4193536006 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4001d660 con 0x7f2c50064c40 2020-11-20T12:13:32.416 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.403+0000 7f2c54935700 1 -- 172.21.15.192:0/4193536006 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c500b0340 con 0x7f2c50064c40 2020-11-20T12:13:32.417 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.404+0000 7f2c54935700 1 -- 172.21.15.192:0/4193536006 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2c501526d0 con 0x7f2c50064c40 2020-11-20T12:13:32.417 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.404+0000 7f2c3e7fc700 1 -- 172.21.15.192:0/4193536006 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f2c40017040 con 0x7f2c50064c40 2020-11-20T12:13:32.417 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.405+0000 7f2c3e7fc700 1 --2- 172.21.15.192:0/4193536006 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f2c240806a0 0x7f2c24082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:32.417 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.405+0000 7f2c3e7fc700 1 -- 172.21.15.192:0/4193536006 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f2c400a4680 con 0x7f2c50064c40 2020-11-20T12:13:32.417 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.405+0000 7f2c4e59c700 1 --2- 172.21.15.192:0/4193536006 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f2c240806a0 0x7f2c24082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:32.418 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.405+0000 7f2c3e7fc700 1 --2- 172.21.15.192:0/4193536006 >> [v2:172.21.15.192:6802/23243,v1:172.21.15.192:6803/23243] conn(0x7f2c240893d0 0x7f2c2408b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:32.418 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.405+0000 7f2c3e7fc700 1 -- 172.21.15.192:0/4193536006 --> [v2:172.21.15.192:6802/23243,v1:172.21.15.192:6803/23243] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2c2408be50 con 0x7f2c240893d0 2020-11-20T12:13:32.418 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.405+0000 7f2c3e7fc700 1 -- 172.21.15.192:0/4193536006 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c400a6b60 con 0x7f2c50064c40 2020-11-20T12:13:32.418 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.405+0000 7f2c4ed9d700 1 --2- 172.21.15.192:0/4193536006 >> [v2:172.21.15.192:6802/23243,v1:172.21.15.192:6803/23243] conn(0x7f2c240893d0 0x7f2c2408b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:32.418 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.405+0000 7f2c4e59c700 1 --2- 172.21.15.192:0/4193536006 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f2c240806a0 0x7f2c24082b60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f2c44007fd0 tx=0x7f2c44007bd0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:32.419 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.406+0000 7f2c4ed9d700 1 --2- 172.21.15.192:0/4193536006 >> [v2:172.21.15.192:6802/23243,v1:172.21.15.192:6803/23243] conn(0x7f2c240893d0 0x7f2c2408b7f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:32.419 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.406+0000 7f2c3e7fc700 1 -- 172.21.15.192:0/4193536006 <== osd.3 v2:172.21.15.192:6802/23243 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f2c2408be50 con 0x7f2c240893d0 2020-11-20T12:13:32.423 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.419+0000 7f2c54935700 1 -- 172.21.15.192:0/4193536006 --> [v2:172.21.15.192:6802/23243,v1:172.21.15.192:6803/23243] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2c500c1cd0 con 0x7f2c240893d0 2020-11-20T12:13:32.423 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.419+0000 7f2c3e7fc700 1 -- 172.21.15.192:0/4193536006 <== osd.3 v2:172.21.15.192:6802/23243 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f2c500c1cd0 con 0x7f2c240893d0 2020-11-20T12:13:32.424 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.419+0000 7f2c54935700 1 -- 172.21.15.192:0/4193536006 >> [v2:172.21.15.192:6802/23243,v1:172.21.15.192:6803/23243] conn(0x7f2c240893d0 msgr2=0x7f2c2408b7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:32.424 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.419+0000 7f2c54935700 1 --2- 172.21.15.192:0/4193536006 >> [v2:172.21.15.192:6802/23243,v1:172.21.15.192:6803/23243] conn(0x7f2c240893d0 0x7f2c2408b7f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:32.424 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.420+0000 7f2c54935700 1 -- 172.21.15.192:0/4193536006 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f2c240806a0 msgr2=0x7f2c24082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:32.424 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.420+0000 7f2c54935700 1 --2- 172.21.15.192:0/4193536006 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f2c240806a0 0x7f2c24082b60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f2c44007fd0 tx=0x7f2c44007bd0).stop 2020-11-20T12:13:32.424 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.420+0000 7f2c54935700 1 -- 172.21.15.192:0/4193536006 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c50064c40 msgr2=0x7f2c501612c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:32.425 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.420+0000 7f2c54935700 1 --2- 172.21.15.192:0/4193536006 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c50064c40 0x7f2c501612c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f2c50066280 tx=0x7f2c40016000).stop 2020-11-20T12:13:32.425 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.420+0000 7f2c4ed9d700 1 -- 172.21.15.192:0/4193536006 reap_dead start 2020-11-20T12:13:32.425 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.420+0000 7f2c54935700 1 -- 172.21.15.192:0/4193536006 shutdown_connections 2020-11-20T12:13:32.425 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.420+0000 7f2c54935700 1 -- 172.21.15.192:0/4193536006 >> 172.21.15.192:0/4193536006 conn(0x7f2c50062100 msgr2=0x7f2c500c2340 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:32.425 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.420+0000 7f2c54935700 1 -- 172.21.15.192:0/4193536006 shutdown_connections 2020-11-20T12:13:32.426 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.420+0000 7f2c54935700 1 -- 172.21.15.192:0/4193536006 wait complete. 2020-11-20T12:13:32.426 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2020-11-20T12:13:32.426 INFO:teuthology.orchestra.run.smithi192.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:13:32.426 INFO:teuthology.orchestra.run.smithi192.stdout:} 2020-11-20T12:13:32.434 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2020-11-20T12:13:32.544 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.540+0000 7f7b99f4e700 1 Processor -- start 2020-11-20T12:13:32.544 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.541+0000 7f7b99f4e700 1 -- start start 2020-11-20T12:13:32.546 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.541+0000 7f7b99f4e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7b94154920 0x7f7b94060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:32.547 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.541+0000 7f7b99f4e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b94151e80 con 0x7f7b94064c40 2020-11-20T12:13:32.547 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.541+0000 7f7b99f4e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b94152120 con 0x7f7b94060370 2020-11-20T12:13:32.547 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.541+0000 7f7b99f4e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b94064260 con 0x7f7b94154920 2020-11-20T12:13:32.547 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.542+0000 7f7b937fe700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f7b94060370 0x7f7b940c2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52444/0 (socket says 172.21.15.192:52444) 2020-11-20T12:13:32.547 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.542+0000 7f7b937fe700 1 -- 172.21.15.192:0/1695091267 learned_addr learned my addr 172.21.15.192:0/1695091267 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T12:13:32.548 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.542+0000 7f7b92ffd700 1 --2- 172.21.15.192:0/1695091267 >> v2:172.21.15.87:3300/0 conn(0x7f7b94154920 0x7f7b94060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:32.548 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.542+0000 7f7b927fc700 1 -- 172.21.15.192:0/1695091267 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2844499783 0 0) 0x7f7b94152120 con 0x7f7b94060370 2020-11-20T12:13:32.548 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.542+0000 7f7b927fc700 1 -- 172.21.15.192:0/1695091267 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b80003280 con 0x7f7b94060370 2020-11-20T12:13:32.548 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.542+0000 7f7b927fc700 1 -- 172.21.15.192:0/1695091267 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2475868789 0 0) 0x7f7b94151e80 con 0x7f7b94064c40 2020-11-20T12:13:32.549 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.542+0000 7f7b927fc700 1 -- 172.21.15.192:0/1695091267 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b94152120 con 0x7f7b94064c40 2020-11-20T12:13:32.549 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.542+0000 7f7b92ffd700 1 -- 172.21.15.192:0/1695091267 >> v1:172.21.15.192:6789/0 conn(0x7f7b94060370 legacy=0x7f7b940c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:32.549 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.542+0000 7f7b92ffd700 1 -- 172.21.15.192:0/1695091267 >> v1:172.21.15.146:6789/0 conn(0x7f7b94064c40 legacy=0x7f7b94151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:32.549 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.542+0000 7f7b92ffd700 1 -- 172.21.15.192:0/1695091267 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b94064500 con 0x7f7b94154920 2020-11-20T12:13:32.549 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.542+0000 7f7b92ffd700 1 --2- 172.21.15.192:0/1695091267 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b94154920 0x7f7b94060750 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f7b88006fd0 tx=0x7f7b88006e30).ready entity=mon.0 client_cookie=a0a6f9a1e2047f29 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:32.550 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.542+0000 7f7b927fc700 1 -- 172.21.15.192:0/1695091267 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b880096c0 con 0x7f7b94154920 2020-11-20T12:13:32.550 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.542+0000 7f7b927fc700 1 -- 172.21.15.192:0/1695091267 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b88000e90 con 0x7f7b94154920 2020-11-20T12:13:32.550 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.542+0000 7f7b927fc700 1 -- 172.21.15.192:0/1695091267 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b88009a30 con 0x7f7b94154920 2020-11-20T12:13:32.550 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.543+0000 7f7b99f4e700 1 -- 172.21.15.192:0/1695091267 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b94154920 msgr2=0x7f7b94060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:32.550 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.543+0000 7f7b99f4e700 1 --2- 172.21.15.192:0/1695091267 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b94154920 0x7f7b94060750 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f7b88006fd0 tx=0x7f7b88006e30).stop 2020-11-20T12:13:32.551 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.543+0000 7f7b99f4e700 1 -- 172.21.15.192:0/1695091267 shutdown_connections 2020-11-20T12:13:32.551 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.543+0000 7f7b99f4e700 1 --2- 172.21.15.192:0/1695091267 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b94154920 0x7f7b94060750 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:32.551 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.543+0000 7f7b99f4e700 1 -- 172.21.15.192:0/1695091267 >> 172.21.15.192:0/1695091267 conn(0x7f7b94062100 msgr2=0x7f7b940c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:32.551 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.543+0000 7f7b99f4e700 1 -- 172.21.15.192:0/1695091267 shutdown_connections 2020-11-20T12:13:32.551 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.543+0000 7f7b99f4e700 1 -- 172.21.15.192:0/1695091267 wait complete. 2020-11-20T12:13:32.554 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.544+0000 7f7b99f4e700 1 Processor -- start 2020-11-20T12:13:32.554 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.544+0000 7f7b99f4e700 1 -- start start 2020-11-20T12:13:32.554 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.545+0000 7f7b99f4e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b94060370 0x7f7b940c4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:32.555 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.545+0000 7f7b99f4e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b94064c40 0x7f7b941559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:32.555 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.545+0000 7f7b99f4e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b94154920 0x7f7b9414b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:32.555 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.545+0000 7f7b99f4e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b94067450 con 0x7f7b94060370 2020-11-20T12:13:32.555 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.545+0000 7f7b99f4e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b940676f0 con 0x7f7b94154920 2020-11-20T12:13:32.555 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.545+0000 7f7b99f4e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b94067990 con 0x7f7b94064c40 2020-11-20T12:13:32.556 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.545+0000 7f7b92ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b94064c40 0x7f7b941559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:32.556 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.545+0000 7f7b92ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b94064c40 0x7f7b941559e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49784/0 (socket says 172.21.15.192:49784) 2020-11-20T12:13:32.556 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.545+0000 7f7b92ffd700 1 -- 172.21.15.192:0/3093045296 learned_addr learned my addr 172.21.15.192:0/3093045296 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:32.556 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.545+0000 7f7b93fff700 1 --2- 172.21.15.192:0/3093045296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b94154920 0x7f7b9414b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:32.556 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.545+0000 7f7b937fe700 1 --2- 172.21.15.192:0/3093045296 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b94060370 0x7f7b940c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:32.557 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.545+0000 7f7b92ffd700 1 -- 172.21.15.192:0/3093045296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b94154920 msgr2=0x7f7b9414b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:32.557 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.545+0000 7f7b92ffd700 1 --2- 172.21.15.192:0/3093045296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b94154920 0x7f7b9414b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:32.557 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.545+0000 7f7b92ffd700 1 -- 172.21.15.192:0/3093045296 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b94060370 msgr2=0x7f7b940c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:32.557 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.545+0000 7f7b92ffd700 1 --2- 172.21.15.192:0/3093045296 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b94060370 0x7f7b940c4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:32.557 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.545+0000 7f7b92ffd700 1 -- 172.21.15.192:0/3093045296 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b94067c30 con 0x7f7b94064c40 2020-11-20T12:13:32.558 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.545+0000 7f7b937fe700 1 --2- 172.21.15.192:0/3093045296 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b94060370 0x7f7b940c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:13:32.558 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.545+0000 7f7b92ffd700 1 --2- 172.21.15.192:0/3093045296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b94064c40 0x7f7b941559e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f7b94066280 tx=0x7f7b88015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:32.558 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.545+0000 7f7b737fe700 1 -- 172.21.15.192:0/3093045296 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b88011bc0 con 0x7f7b94064c40 2020-11-20T12:13:32.558 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.545+0000 7f7b737fe700 1 -- 172.21.15.192:0/3093045296 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b88011d20 con 0x7f7b94064c40 2020-11-20T12:13:32.558 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.545+0000 7f7b99f4e700 1 -- 172.21.15.192:0/3093045296 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b94067ed0 con 0x7f7b94064c40 2020-11-20T12:13:32.559 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.545+0000 7f7b737fe700 1 -- 172.21.15.192:0/3093045296 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8801e690 con 0x7f7b94064c40 2020-11-20T12:13:32.559 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.545+0000 7f7b99f4e700 1 -- 172.21.15.192:0/3093045296 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b940c1ca0 con 0x7f7b94064c40 2020-11-20T12:13:32.559 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.546+0000 7f7b99f4e700 1 -- 172.21.15.192:0/3093045296 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b940699a0 con 0x7f7b94064c40 2020-11-20T12:13:32.559 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.547+0000 7f7b737fe700 1 -- 172.21.15.192:0/3093045296 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f7b88025030 con 0x7f7b94064c40 2020-11-20T12:13:32.559 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.547+0000 7f7b737fe700 1 --2- 172.21.15.192:0/3093045296 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f7b6c080670 0x7f7b6c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:32.560 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.548+0000 7f7b937fe700 1 --2- 172.21.15.192:0/3093045296 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f7b6c080670 0x7f7b6c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:32.560 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.548+0000 7f7b737fe700 1 -- 172.21.15.192:0/3093045296 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f7b880a3e40 con 0x7f7b94064c40 2020-11-20T12:13:32.560 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.548+0000 7f7b937fe700 1 --2- 172.21.15.192:0/3093045296 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f7b6c080670 0x7f7b6c082b30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f7b840055e0 tx=0x7f7b84009040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:32.560 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.551+0000 7f7b737fe700 1 -- 172.21.15.192:0/3093045296 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f7b88078850 con 0x7f7b94064c40 2020-11-20T12:13:32.695 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.691+0000 7f7b99f4e700 1 -- 172.21.15.192:0/3093045296 --> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b9405ca80 con 0x7f7b6c080670 2020-11-20T12:13:32.696 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.692+0000 7f7b737fe700 1 -- 172.21.15.192:0/3093045296 <== mgr.4106 v2:172.21.15.192:6800/22925 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7b9405ca80 con 0x7f7b6c080670 2020-11-20T12:13:32.698 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.693+0000 7f7b99f4e700 1 -- 172.21.15.192:0/3093045296 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f7b6c080670 msgr2=0x7f7b6c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:32.698 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.693+0000 7f7b99f4e700 1 --2- 172.21.15.192:0/3093045296 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f7b6c080670 0x7f7b6c082b30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f7b840055e0 tx=0x7f7b84009040).stop 2020-11-20T12:13:32.698 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.693+0000 7f7b99f4e700 1 -- 172.21.15.192:0/3093045296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b94064c40 msgr2=0x7f7b941559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:32.699 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.693+0000 7f7b99f4e700 1 --2- 172.21.15.192:0/3093045296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b94064c40 0x7f7b941559e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f7b94066280 tx=0x7f7b88015000).stop 2020-11-20T12:13:32.699 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.693+0000 7f7b99f4e700 1 -- 172.21.15.192:0/3093045296 shutdown_connections 2020-11-20T12:13:32.700 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.693+0000 7f7b99f4e700 1 --2- 172.21.15.192:0/3093045296 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f7b6c080670 0x7f7b6c082b30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:32.700 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.693+0000 7f7b99f4e700 1 --2- 172.21.15.192:0/3093045296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b94154920 0x7f7b9414b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:32.700 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.693+0000 7f7b99f4e700 1 --2- 172.21.15.192:0/3093045296 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7b94060370 0x7f7b940c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:32.701 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.693+0000 7f7b99f4e700 1 --2- 172.21.15.192:0/3093045296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b94064c40 0x7f7b941559e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:32.701 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.693+0000 7f7b99f4e700 1 -- 172.21.15.192:0/3093045296 >> 172.21.15.192:0/3093045296 conn(0x7f7b94062100 msgr2=0x7f7b9414d600 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:32.702 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.693+0000 7f7b99f4e700 1 -- 172.21.15.192:0/3093045296 shutdown_connections 2020-11-20T12:13:32.702 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.693+0000 7f7b99f4e700 1 -- 172.21.15.192:0/3093045296 wait complete. 2020-11-20T12:13:32.702 INFO:teuthology.orchestra.run.smithi192.stderr:instructed osd(s) 3 to deep-scrub 2020-11-20T12:13:32.708 INFO:tasks.ceph:Scrubbing osd.6 2020-11-20T12:13:32.708 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:13:32.836 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.833+0000 7f2bc8fa1700 1 Processor -- start 2020-11-20T12:13:32.837 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.833+0000 7f2bc8fa1700 1 -- start start 2020-11-20T12:13:32.838 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.834+0000 7f2bc8fa1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2bc4150ce0 0x7f2bc41510c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:32.838 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.834+0000 7f2bc8fa1700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2bc40bbac0 0x7f2bc4064fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:32.839 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.834+0000 7f2bc8fa1700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bc40bc0a0 con 0x7f2bc4151700 2020-11-20T12:13:32.839 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.834+0000 7f2bc8fa1700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bc40bc340 con 0x7f2bc40bbac0 2020-11-20T12:13:32.839 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.834+0000 7f2bc8fa1700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bc4064350 con 0x7f2bc4150ce0 2020-11-20T12:13:32.849 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.834+0000 7f2bc2ffd700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f2bc4151700 0x7f2bc40bf800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52458/0 (socket says 172.21.15.192:52458) 2020-11-20T12:13:32.849 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.834+0000 7f2bc2ffd700 1 -- 172.21.15.192:0/3013607667 learned_addr learned my addr 172.21.15.192:0/3013607667 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T12:13:32.850 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.834+0000 7f2bc3fff700 1 --2- 172.21.15.192:0/3013607667 >> v2:172.21.15.87:3300/0 conn(0x7f2bc40bbac0 0x7f2bc4064fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:32.850 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.834+0000 7f2bc37fe700 1 --2- 172.21.15.192:0/3013607667 >> v2:172.21.15.146:3300/0 conn(0x7f2bc4150ce0 0x7f2bc41510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:32.850 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.834+0000 7f2bc27fc700 1 -- 172.21.15.192:0/3013607667 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 434942841 0 0) 0x7f2bc40bc0a0 con 0x7f2bc4151700 2020-11-20T12:13:32.851 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.834+0000 7f2bc27fc700 1 -- 172.21.15.192:0/3013607667 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ba4003280 con 0x7f2bc4151700 2020-11-20T12:13:32.851 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.835+0000 7f2bc37fe700 1 -- 172.21.15.192:0/3013607667 >> v2:172.21.15.87:3300/0 conn(0x7f2bc40bbac0 msgr2=0x7f2bc4064fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:32.852 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.835+0000 7f2bc37fe700 1 --2- 172.21.15.192:0/3013607667 >> v2:172.21.15.87:3300/0 conn(0x7f2bc40bbac0 0x7f2bc4064fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:32.852 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.835+0000 7f2bc37fe700 1 -- 172.21.15.192:0/3013607667 >> v1:172.21.15.192:6789/0 conn(0x7f2bc4151700 legacy=0x7f2bc40bf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:32.852 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.835+0000 7f2bc37fe700 1 -- 172.21.15.192:0/3013607667 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc40645f0 con 0x7f2bc4150ce0 2020-11-20T12:13:32.853 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.835+0000 7f2bc37fe700 1 --2- 172.21.15.192:0/3013607667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bc4150ce0 0x7f2bc41510c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f2bc405c6e0 tx=0x7f2bb4009220).ready entity=mon.1 client_cookie=94948cd07701c9b8 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:32.853 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.835+0000 7f2bc27fc700 1 -- 172.21.15.192:0/3013607667 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb400b9a0 con 0x7f2bc4150ce0 2020-11-20T12:13:32.854 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.835+0000 7f2bc27fc700 1 -- 172.21.15.192:0/3013607667 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb400bb00 con 0x7f2bc4150ce0 2020-11-20T12:13:32.854 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.835+0000 7f2bc27fc700 1 -- 172.21.15.192:0/3013607667 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb400be80 con 0x7f2bc4150ce0 2020-11-20T12:13:32.854 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.836+0000 7f2bc8fa1700 1 -- 172.21.15.192:0/3013607667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bc4150ce0 msgr2=0x7f2bc41510c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:32.855 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.836+0000 7f2bc8fa1700 1 --2- 172.21.15.192:0/3013607667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bc4150ce0 0x7f2bc41510c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f2bc405c6e0 tx=0x7f2bb4009220).stop 2020-11-20T12:13:32.855 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.836+0000 7f2bc8fa1700 1 -- 172.21.15.192:0/3013607667 shutdown_connections 2020-11-20T12:13:32.856 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.836+0000 7f2bc8fa1700 1 --2- 172.21.15.192:0/3013607667 >> v2:172.21.15.87:3300/0 conn(0x7f2bc40bbac0 0x7f2bc4064fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:32.856 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.836+0000 7f2bc8fa1700 1 --2- 172.21.15.192:0/3013607667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bc4150ce0 0x7f2bc41510c0 secure :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0x7f2bc405c6e0 tx=0x7f2bb4009220).stop 2020-11-20T12:13:32.856 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.836+0000 7f2bc8fa1700 1 -- 172.21.15.192:0/3013607667 >> 172.21.15.192:0/3013607667 conn(0x7f2bc40c3c50 msgr2=0x7f2bc40c4060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:32.857 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.836+0000 7f2bc8fa1700 1 -- 172.21.15.192:0/3013607667 shutdown_connections 2020-11-20T12:13:32.857 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.836+0000 7f2bc8fa1700 1 -- 172.21.15.192:0/3013607667 wait complete. 2020-11-20T12:13:32.858 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.837+0000 7f2bc8fa1700 1 Processor -- start 2020-11-20T12:13:32.858 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.837+0000 7f2bc8fa1700 1 -- start start 2020-11-20T12:13:32.858 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.838+0000 7f2bc8fa1700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bc40bbac0 0x7f2bc413c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:32.859 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.838+0000 7f2bc8fa1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bc4151700 0x7f2bc414e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:32.859 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.838+0000 7f2bc8fa1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bc4142340 0x7f2bc414a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:32.859 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.838+0000 7f2bc8fa1700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc415d480 con 0x7f2bc40bbac0 2020-11-20T12:13:32.860 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.838+0000 7f2bc8fa1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc415d720 con 0x7f2bc4142340 2020-11-20T12:13:32.860 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.838+0000 7f2bc8fa1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc415d9c0 con 0x7f2bc4151700 2020-11-20T12:13:32.861 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.838+0000 7f2bc2ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bc4151700 0x7f2bc414e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:32.861 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.838+0000 7f2bc2ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bc4151700 0x7f2bc414e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49796/0 (socket says 172.21.15.192:49796) 2020-11-20T12:13:32.862 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.838+0000 7f2bc2ffd700 1 -- 172.21.15.192:0/4088207900 learned_addr learned my addr 172.21.15.192:0/4088207900 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:32.862 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.838+0000 7f2bc37fe700 1 --2- 172.21.15.192:0/4088207900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bc40bbac0 0x7f2bc413c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:32.862 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.838+0000 7f2bc3fff700 1 --2- 172.21.15.192:0/4088207900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bc4142340 0x7f2bc414a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:32.863 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.839+0000 7f2bc2ffd700 1 -- 172.21.15.192:0/4088207900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bc4142340 msgr2=0x7f2bc414a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:32.863 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.839+0000 7f2bc2ffd700 1 --2- 172.21.15.192:0/4088207900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bc4142340 0x7f2bc414a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:32.863 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.839+0000 7f2bc2ffd700 1 -- 172.21.15.192:0/4088207900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bc40bbac0 msgr2=0x7f2bc413c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:32.864 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.839+0000 7f2bc2ffd700 1 --2- 172.21.15.192:0/4088207900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bc40bbac0 0x7f2bc413c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:32.864 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.839+0000 7f2bc2ffd700 1 -- 172.21.15.192:0/4088207900 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc415dc60 con 0x7f2bc4151700 2020-11-20T12:13:32.865 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.839+0000 7f2bc3fff700 1 --2- 172.21.15.192:0/4088207900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bc4142340 0x7f2bc414a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:13:32.865 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.839+0000 7f2bc37fe700 1 --2- 172.21.15.192:0/4088207900 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2bc40bbac0 0x7f2bc413c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:13:32.865 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.839+0000 7f2bc2ffd700 1 --2- 172.21.15.192:0/4088207900 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bc4151700 0x7f2bc414e300 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f2bac00c710 tx=0x7f2bac007aa0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:32.866 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.839+0000 7f2bbb7fe700 1 -- 172.21.15.192:0/4088207900 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac0072e0 con 0x7f2bc4151700 2020-11-20T12:13:32.866 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.839+0000 7f2bbb7fe700 1 -- 172.21.15.192:0/4088207900 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bac007440 con 0x7f2bc4151700 2020-11-20T12:13:32.867 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.839+0000 7f2bc8fa1700 1 -- 172.21.15.192:0/4088207900 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bc415df00 con 0x7f2bc4151700 2020-11-20T12:13:32.867 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.839+0000 7f2bbb7fe700 1 -- 172.21.15.192:0/4088207900 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac005840 con 0x7f2bc4151700 2020-11-20T12:13:32.867 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.839+0000 7f2bc8fa1700 1 -- 172.21.15.192:0/4088207900 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bc4142d70 con 0x7f2bc4151700 2020-11-20T12:13:32.868 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.840+0000 7f2bc8fa1700 1 -- 172.21.15.192:0/4088207900 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2bc405ca80 con 0x7f2bc4151700 2020-11-20T12:13:32.868 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.841+0000 7f2bbb7fe700 1 -- 172.21.15.192:0/4088207900 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f2bac010070 con 0x7f2bc4151700 2020-11-20T12:13:32.869 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.842+0000 7f2bbb7fe700 1 --2- 172.21.15.192:0/4088207900 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f2ba0080670 0x7f2ba0082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:32.869 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.842+0000 7f2bbb7fe700 1 -- 172.21.15.192:0/4088207900 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f2bac0a29b0 con 0x7f2bc4151700 2020-11-20T12:13:32.869 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.842+0000 7f2bc37fe700 1 --2- 172.21.15.192:0/4088207900 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f2ba0080670 0x7f2ba0082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:32.870 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.842+0000 7f2bbb7fe700 1 --2- 172.21.15.192:0/4088207900 >> [v2:172.21.15.192:6810/23246,v1:172.21.15.192:6811/23246] conn(0x7f2ba00893a0 0x7f2ba008b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:32.870 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.842+0000 7f2bbb7fe700 1 -- 172.21.15.192:0/4088207900 --> [v2:172.21.15.192:6810/23246,v1:172.21.15.192:6811/23246] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2ba008be20 con 0x7f2ba00893a0 2020-11-20T12:13:32.871 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.842+0000 7f2bbb7fe700 1 -- 172.21.15.192:0/4088207900 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2bac0a2d20 con 0x7f2bc4151700 2020-11-20T12:13:32.871 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.842+0000 7f2bc3fff700 1 --2- 172.21.15.192:0/4088207900 >> [v2:172.21.15.192:6810/23246,v1:172.21.15.192:6811/23246] conn(0x7f2ba00893a0 0x7f2ba008b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:32.871 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.842+0000 7f2bc37fe700 1 --2- 172.21.15.192:0/4088207900 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f2ba0080670 0x7f2ba0082b30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f2bc4065ef0 tx=0x7f2bb4016000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:32.872 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.843+0000 7f2bc3fff700 1 --2- 172.21.15.192:0/4088207900 >> [v2:172.21.15.192:6810/23246,v1:172.21.15.192:6811/23246] conn(0x7f2ba00893a0 0x7f2ba008b7c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:32.872 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.844+0000 7f2bbb7fe700 1 -- 172.21.15.192:0/4088207900 <== osd.6 v2:172.21.15.192:6810/23246 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f2ba008be20 con 0x7f2ba00893a0 2020-11-20T12:13:32.875 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.861+0000 7f2bc8fa1700 1 -- 172.21.15.192:0/4088207900 --> [v2:172.21.15.192:6810/23246,v1:172.21.15.192:6811/23246] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2bc40c4980 con 0x7f2ba00893a0 2020-11-20T12:13:32.875 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.862+0000 7f2bbb7fe700 1 -- 172.21.15.192:0/4088207900 <== osd.6 v2:172.21.15.192:6810/23246 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f2bc40c4980 con 0x7f2ba00893a0 2020-11-20T12:13:32.875 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.862+0000 7f2bc8fa1700 1 -- 172.21.15.192:0/4088207900 >> [v2:172.21.15.192:6810/23246,v1:172.21.15.192:6811/23246] conn(0x7f2ba00893a0 msgr2=0x7f2ba008b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:32.876 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.862+0000 7f2bc8fa1700 1 --2- 172.21.15.192:0/4088207900 >> [v2:172.21.15.192:6810/23246,v1:172.21.15.192:6811/23246] conn(0x7f2ba00893a0 0x7f2ba008b7c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:32.876 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.862+0000 7f2bc8fa1700 1 -- 172.21.15.192:0/4088207900 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f2ba0080670 msgr2=0x7f2ba0082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:32.876 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.862+0000 7f2bc8fa1700 1 --2- 172.21.15.192:0/4088207900 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f2ba0080670 0x7f2ba0082b30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f2bc4065ef0 tx=0x7f2bb4016000).stop 2020-11-20T12:13:32.877 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.862+0000 7f2bc8fa1700 1 -- 172.21.15.192:0/4088207900 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bc4151700 msgr2=0x7f2bc414e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:32.877 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.862+0000 7f2bc8fa1700 1 --2- 172.21.15.192:0/4088207900 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bc4151700 0x7f2bc414e300 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f2bac00c710 tx=0x7f2bac007aa0).stop 2020-11-20T12:13:32.878 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.862+0000 7f2bc3fff700 1 -- 172.21.15.192:0/4088207900 reap_dead start 2020-11-20T12:13:32.878 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.862+0000 7f2bc8fa1700 1 -- 172.21.15.192:0/4088207900 shutdown_connections 2020-11-20T12:13:32.878 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.862+0000 7f2bc8fa1700 1 -- 172.21.15.192:0/4088207900 >> 172.21.15.192:0/4088207900 conn(0x7f2bc40c3c50 msgr2=0x7f2bc40bd390 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:32.879 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.863+0000 7f2bc8fa1700 1 -- 172.21.15.192:0/4088207900 shutdown_connections 2020-11-20T12:13:32.879 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.863+0000 7f2bc8fa1700 1 -- 172.21.15.192:0/4088207900 wait complete. 2020-11-20T12:13:32.880 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2020-11-20T12:13:32.880 INFO:teuthology.orchestra.run.smithi192.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:13:32.881 INFO:teuthology.orchestra.run.smithi192.stdout:} 2020-11-20T12:13:32.882 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2020-11-20T12:13:32.996 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.993+0000 7fc847fbc700 1 Processor -- start 2020-11-20T12:13:32.997 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.993+0000 7fc847fbc700 1 -- start start 2020-11-20T12:13:32.999 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.994+0000 7fc847fbc700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc840060370 0x7fc840060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:32.999 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.994+0000 7fc847fbc700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fc840154920 0x7fc840064c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:32.999 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.994+0000 7fc847fbc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc8400c2340 0x7fc840151340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:33.000 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.994+0000 7fc847fbc700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc840065130 con 0x7fc840154920 2020-11-20T12:13:33.000 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.994+0000 7fc847fbc700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc840151e80 con 0x7fc8400c2340 2020-11-20T12:13:33.000 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.994+0000 7fc847fbc700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc840152120 con 0x7fc840060370 2020-11-20T12:13:33.000 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.994+0000 7fc845d58700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc840060370 0x7fc840060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:33.001 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.994+0000 7fc845d58700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc840060370 0x7fc840060750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49806/0 (socket says 172.21.15.192:49806) 2020-11-20T12:13:33.001 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.994+0000 7fc845d58700 1 -- 172.21.15.192:0/3090823531 learned_addr learned my addr 172.21.15.192:0/3090823531 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:33.001 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.994+0000 7fc846559700 1 --2- 172.21.15.192:0/3090823531 >> v2:172.21.15.146:3300/0 conn(0x7fc8400c2340 0x7fc840151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:33.001 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.994+0000 7fc845557700 1 --2- 172.21.15.192:0/3090823531 >> v2:172.21.15.87:3300/0 conn(0x7fc840154920 0x7fc840064c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:33.001 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.995+0000 7fc845d58700 1 -- 172.21.15.192:0/3090823531 >> v2:172.21.15.146:3300/0 conn(0x7fc8400c2340 msgr2=0x7fc840151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:33.002 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.995+0000 7fc845d58700 1 --2- 172.21.15.192:0/3090823531 >> v2:172.21.15.146:3300/0 conn(0x7fc8400c2340 0x7fc840151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:33.002 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.995+0000 7fc845d58700 1 -- 172.21.15.192:0/3090823531 >> v2:172.21.15.87:3300/0 conn(0x7fc840154920 msgr2=0x7fc840064c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:33.002 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.995+0000 7fc845d58700 1 --2- 172.21.15.192:0/3090823531 >> v2:172.21.15.87:3300/0 conn(0x7fc840154920 0x7fc840064c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:33.002 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.995+0000 7fc845d58700 1 -- 172.21.15.192:0/3090823531 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc840064260 con 0x7fc840060370 2020-11-20T12:13:33.002 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.995+0000 7fc845d58700 1 --2- 172.21.15.192:0/3090823531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc840060370 0x7fc840060750 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fc840065730 tx=0x7fc83c006ef0).ready entity=mon.2 client_cookie=5c09d6eea3d5d318 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:33.003 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.995+0000 7fc844d56700 1 -- 172.21.15.192:0/3090823531 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c00b8c0 con 0x7fc840060370 2020-11-20T12:13:33.003 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.995+0000 7fc844d56700 1 -- 172.21.15.192:0/3090823531 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83c000e90 con 0x7fc840060370 2020-11-20T12:13:33.003 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.995+0000 7fc844d56700 1 -- 172.21.15.192:0/3090823531 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c00bc30 con 0x7fc840060370 2020-11-20T12:13:33.003 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.995+0000 7fc847fbc700 1 -- 172.21.15.192:0/3090823531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc840060370 msgr2=0x7fc840060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:33.003 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.995+0000 7fc847fbc700 1 --2- 172.21.15.192:0/3090823531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc840060370 0x7fc840060750 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fc840065730 tx=0x7fc83c006ef0).stop 2020-11-20T12:13:33.004 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.995+0000 7fc847fbc700 1 -- 172.21.15.192:0/3090823531 shutdown_connections 2020-11-20T12:13:33.004 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.995+0000 7fc847fbc700 1 --2- 172.21.15.192:0/3090823531 >> v2:172.21.15.146:3300/0 conn(0x7fc8400c2340 0x7fc840151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:33.004 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.995+0000 7fc847fbc700 1 --2- 172.21.15.192:0/3090823531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc840060370 0x7fc840060750 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:33.004 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.995+0000 7fc847fbc700 1 --2- 172.21.15.192:0/3090823531 >> v2:172.21.15.87:3300/0 conn(0x7fc840154920 0x7fc840064c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:33.004 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.995+0000 7fc847fbc700 1 -- 172.21.15.192:0/3090823531 >> 172.21.15.192:0/3090823531 conn(0x7fc840062100 msgr2=0x7fc8400c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:33.005 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.995+0000 7fc847fbc700 1 -- 172.21.15.192:0/3090823531 shutdown_connections 2020-11-20T12:13:33.005 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.995+0000 7fc847fbc700 1 -- 172.21.15.192:0/3090823531 wait complete. 2020-11-20T12:13:33.007 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.996+0000 7fc847fbc700 1 Processor -- start 2020-11-20T12:13:33.008 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.997+0000 7fc847fbc700 1 -- start start 2020-11-20T12:13:33.008 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.997+0000 7fc847fbc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc840060370 0x7fc840161a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:33.008 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.997+0000 7fc847fbc700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8400c2340 0x7fc8401645a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:33.008 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.997+0000 7fc847fbc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc840154920 0x7fc840156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:33.009 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.997+0000 7fc847fbc700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc840164a90 con 0x7fc8400c2340 2020-11-20T12:13:33.009 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.997+0000 7fc847fbc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc840155e20 con 0x7fc840154920 2020-11-20T12:13:33.009 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.997+0000 7fc847fbc700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8401560c0 con 0x7fc840060370 2020-11-20T12:13:33.009 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.997+0000 7fc845d58700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc840060370 0x7fc840161a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:33.009 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.997+0000 7fc845d58700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc840060370 0x7fc840161a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49812/0 (socket says 172.21.15.192:49812) 2020-11-20T12:13:33.010 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.997+0000 7fc845d58700 1 -- 172.21.15.192:0/3602590066 learned_addr learned my addr 172.21.15.192:0/3602590066 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:33.010 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.997+0000 7fc846559700 1 --2- 172.21.15.192:0/3602590066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc840154920 0x7fc840156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:33.010 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.998+0000 7fc845d58700 1 -- 172.21.15.192:0/3602590066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc840154920 msgr2=0x7fc840156fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:33.010 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.998+0000 7fc845557700 1 --2- 172.21.15.192:0/3602590066 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8400c2340 0x7fc8401645a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:33.010 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.998+0000 7fc845d58700 1 --2- 172.21.15.192:0/3602590066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc840154920 0x7fc840156fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:33.011 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.998+0000 7fc845d58700 1 -- 172.21.15.192:0/3602590066 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8400c2340 msgr2=0x7fc8401645a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:33.011 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.998+0000 7fc845d58700 1 --2- 172.21.15.192:0/3602590066 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8400c2340 0x7fc8401645a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:33.011 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.998+0000 7fc845d58700 1 -- 172.21.15.192:0/3602590066 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc840156360 con 0x7fc840060370 2020-11-20T12:13:33.011 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.998+0000 7fc845d58700 1 --2- 172.21.15.192:0/3602590066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc840060370 0x7fc840161a90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fc8400c5450 tx=0x7fc83c016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:33.011 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.998+0000 7fc82dffb700 1 -- 172.21.15.192:0/3602590066 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c011df0 con 0x7fc840060370 2020-11-20T12:13:33.012 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.998+0000 7fc82dffb700 1 -- 172.21.15.192:0/3602590066 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83c01d480 con 0x7fc840060370 2020-11-20T12:13:33.012 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.998+0000 7fc847fbc700 1 -- 172.21.15.192:0/3602590066 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc840156600 con 0x7fc840060370 2020-11-20T12:13:33.012 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.998+0000 7fc82dffb700 1 -- 172.21.15.192:0/3602590066 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c01d820 con 0x7fc840060370 2020-11-20T12:13:33.012 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.998+0000 7fc847fbc700 1 -- 172.21.15.192:0/3602590066 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc840156b40 con 0x7fc840060370 2020-11-20T12:13:33.012 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:32.999+0000 7fc847fbc700 1 -- 172.21.15.192:0/3602590066 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8400699a0 con 0x7fc840060370 2020-11-20T12:13:33.013 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.000+0000 7fc82dffb700 1 -- 172.21.15.192:0/3602590066 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fc83c017070 con 0x7fc840060370 2020-11-20T12:13:33.013 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.000+0000 7fc82dffb700 1 --2- 172.21.15.192:0/3602590066 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fc818080670 0x7fc818082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:33.013 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.000+0000 7fc82dffb700 1 -- 172.21.15.192:0/3602590066 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fc83c0a4970 con 0x7fc840060370 2020-11-20T12:13:33.013 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.000+0000 7fc845557700 1 --2- 172.21.15.192:0/3602590066 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fc818080670 0x7fc818082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:33.014 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.001+0000 7fc845557700 1 --2- 172.21.15.192:0/3602590066 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fc818080670 0x7fc818082b30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fc8400c7d40 tx=0x7fc830008040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:33.014 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.004+0000 7fc82dffb700 1 -- 172.21.15.192:0/3602590066 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fc83c079300 con 0x7fc840060370 2020-11-20T12:13:33.147 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.143+0000 7fc847fbc700 1 -- 172.21.15.192:0/3602590066 --> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fc84005ca80 con 0x7fc818080670 2020-11-20T12:13:33.148 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.144+0000 7fc82dffb700 1 -- 172.21.15.192:0/3602590066 <== mgr.4106 v2:172.21.15.192:6800/22925 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc84005ca80 con 0x7fc818080670 2020-11-20T12:13:33.149 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.145+0000 7fc847fbc700 1 -- 172.21.15.192:0/3602590066 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fc818080670 msgr2=0x7fc818082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:33.150 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.145+0000 7fc847fbc700 1 --2- 172.21.15.192:0/3602590066 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fc818080670 0x7fc818082b30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fc8400c7d40 tx=0x7fc830008040).stop 2020-11-20T12:13:33.150 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.145+0000 7fc847fbc700 1 -- 172.21.15.192:0/3602590066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc840060370 msgr2=0x7fc840161a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:33.151 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.145+0000 7fc847fbc700 1 --2- 172.21.15.192:0/3602590066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc840060370 0x7fc840161a90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fc8400c5450 tx=0x7fc83c016000).stop 2020-11-20T12:13:33.151 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.145+0000 7fc847fbc700 1 -- 172.21.15.192:0/3602590066 shutdown_connections 2020-11-20T12:13:33.151 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.145+0000 7fc847fbc700 1 --2- 172.21.15.192:0/3602590066 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fc818080670 0x7fc818082b30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:33.152 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.145+0000 7fc847fbc700 1 --2- 172.21.15.192:0/3602590066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc840154920 0x7fc840156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:33.152 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.145+0000 7fc847fbc700 1 --2- 172.21.15.192:0/3602590066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc840060370 0x7fc840161a90 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:33.152 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.145+0000 7fc847fbc700 1 --2- 172.21.15.192:0/3602590066 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fc8400c2340 0x7fc8401645a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:33.153 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.145+0000 7fc847fbc700 1 -- 172.21.15.192:0/3602590066 >> 172.21.15.192:0/3602590066 conn(0x7fc840062100 msgr2=0x7fc840153e00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:33.153 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.145+0000 7fc847fbc700 1 -- 172.21.15.192:0/3602590066 shutdown_connections 2020-11-20T12:13:33.154 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.146+0000 7fc847fbc700 1 -- 172.21.15.192:0/3602590066 wait complete. 2020-11-20T12:13:33.154 INFO:teuthology.orchestra.run.smithi192.stderr:instructed osd(s) 6 to deep-scrub 2020-11-20T12:13:33.161 INFO:tasks.ceph:Scrubbing osd.9 2020-11-20T12:13:33.161 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:13:33.274 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.270+0000 7fe7bb223700 1 Processor -- start 2020-11-20T12:13:33.274 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.271+0000 7fe7bb223700 1 -- start start 2020-11-20T12:13:33.277 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.271+0000 7fe7bb223700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe7b4060370 0x7fe7b4060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:33.277 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.271+0000 7fe7bb223700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe7b4064c40 0x7fe7b4151340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:33.277 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.271+0000 7fe7bb223700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b4151e80 con 0x7fe7b4154920 2020-11-20T12:13:33.277 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.271+0000 7fe7bb223700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b4152120 con 0x7fe7b4060370 2020-11-20T12:13:33.277 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.271+0000 7fe7bb223700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b4064260 con 0x7fe7b4064c40 2020-11-20T12:13:33.278 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.272+0000 7fe7b97c0700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe7b4064c40 0x7fe7b4151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:33.278 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.272+0000 7fe7b97c0700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe7b4064c40 0x7fe7b4151340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49822/0 (socket says 172.21.15.192:49822) 2020-11-20T12:13:33.278 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.272+0000 7fe7b97c0700 1 -- 172.21.15.192:0/890078192 learned_addr learned my addr 172.21.15.192:0/890078192 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:33.279 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.272+0000 7fe7b8fbf700 1 --2- 172.21.15.192:0/890078192 >> v2:172.21.15.146:3300/0 conn(0x7fe7b4060370 0x7fe7b4060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:33.279 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.272+0000 7fe7b97c0700 1 -- 172.21.15.192:0/890078192 >> v2:172.21.15.146:3300/0 conn(0x7fe7b4060370 msgr2=0x7fe7b4060750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:33.279 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.272+0000 7fe7b97c0700 1 --2- 172.21.15.192:0/890078192 >> v2:172.21.15.146:3300/0 conn(0x7fe7b4060370 0x7fe7b4060750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:33.280 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.272+0000 7fe7b97c0700 1 -- 172.21.15.192:0/890078192 >> v1:172.21.15.87:6789/0 conn(0x7fe7b4154920 legacy=0x7fe7b40c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:33.280 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.272+0000 7fe7b97c0700 1 -- 172.21.15.192:0/890078192 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b4064500 con 0x7fe7b4064c40 2020-11-20T12:13:33.280 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.272+0000 7fe7b8fbf700 1 --2- 172.21.15.192:0/890078192 >> v2:172.21.15.146:3300/0 conn(0x7fe7b4060370 0x7fe7b4060750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:13:33.281 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.272+0000 7fe7b97c0700 1 --2- 172.21.15.192:0/890078192 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7b4064c40 0x7fe7b4151340 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fe7b4065700 tx=0x7fe7ac0092d0).ready entity=mon.2 client_cookie=d5c1ebe885c99675 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:33.282 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.272+0000 7fe7b37fe700 1 -- 172.21.15.192:0/890078192 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac00bc80 con 0x7fe7b4064c40 2020-11-20T12:13:33.282 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.272+0000 7fe7b37fe700 1 -- 172.21.15.192:0/890078192 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ac00bde0 con 0x7fe7b4064c40 2020-11-20T12:13:33.283 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.272+0000 7fe7b37fe700 1 -- 172.21.15.192:0/890078192 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac011610 con 0x7fe7b4064c40 2020-11-20T12:13:33.283 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.273+0000 7fe7bb223700 1 -- 172.21.15.192:0/890078192 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7b4064c40 msgr2=0x7fe7b4151340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:33.283 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.273+0000 7fe7bb223700 1 --2- 172.21.15.192:0/890078192 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7b4064c40 0x7fe7b4151340 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fe7b4065700 tx=0x7fe7ac0092d0).stop 2020-11-20T12:13:33.284 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.273+0000 7fe7bb223700 1 -- 172.21.15.192:0/890078192 shutdown_connections 2020-11-20T12:13:33.284 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.273+0000 7fe7bb223700 1 --2- 172.21.15.192:0/890078192 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7b4064c40 0x7fe7b4151340 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:33.285 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.273+0000 7fe7bb223700 1 --2- 172.21.15.192:0/890078192 >> v2:172.21.15.146:3300/0 conn(0x7fe7b4060370 0x7fe7b4060750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:33.285 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.273+0000 7fe7bb223700 1 -- 172.21.15.192:0/890078192 >> 172.21.15.192:0/890078192 conn(0x7fe7b4062100 msgr2=0x7fe7b40c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:33.285 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.273+0000 7fe7bb223700 1 -- 172.21.15.192:0/890078192 shutdown_connections 2020-11-20T12:13:33.286 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.273+0000 7fe7bb223700 1 -- 172.21.15.192:0/890078192 wait complete. 2020-11-20T12:13:33.286 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.274+0000 7fe7bb223700 1 Processor -- start 2020-11-20T12:13:33.292 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.274+0000 7fe7bb223700 1 -- start start 2020-11-20T12:13:33.293 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.275+0000 7fe7bb223700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7b4060370 0x7fe7b41427f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:33.293 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.275+0000 7fe7bb223700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7b4064c40 0x7fe7b4143110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:33.294 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.275+0000 7fe7bb223700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7b4154920 0x7fe7b414bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:33.294 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.275+0000 7fe7bb223700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b41581f0 con 0x7fe7b4154920 2020-11-20T12:13:33.295 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.275+0000 7fe7bb223700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b4163b20 con 0x7fe7b4060370 2020-11-20T12:13:33.295 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.275+0000 7fe7bb223700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b4163d80 con 0x7fe7b4064c40 2020-11-20T12:13:33.295 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.275+0000 7fe7b3fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7b4064c40 0x7fe7b4143110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:33.296 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.275+0000 7fe7b3fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7b4064c40 0x7fe7b4143110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49826/0 (socket says 172.21.15.192:49826) 2020-11-20T12:13:33.296 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.275+0000 7fe7b3fff700 1 -- 172.21.15.192:0/1622843505 learned_addr learned my addr 172.21.15.192:0/1622843505 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:33.296 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.275+0000 7fe7b97c0700 1 --2- 172.21.15.192:0/1622843505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7b4154920 0x7fe7b414bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:33.296 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.275+0000 7fe7b8fbf700 1 --2- 172.21.15.192:0/1622843505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7b4060370 0x7fe7b41427f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:33.297 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.275+0000 7fe7b3fff700 1 -- 172.21.15.192:0/1622843505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7b4060370 msgr2=0x7fe7b41427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:33.297 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.275+0000 7fe7b3fff700 1 --2- 172.21.15.192:0/1622843505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe7b4060370 0x7fe7b41427f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:33.297 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.275+0000 7fe7b3fff700 1 -- 172.21.15.192:0/1622843505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7b4154920 msgr2=0x7fe7b414bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:33.298 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.275+0000 7fe7b3fff700 1 --2- 172.21.15.192:0/1622843505 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe7b4154920 0x7fe7b414bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:33.298 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.275+0000 7fe7b3fff700 1 -- 172.21.15.192:0/1622843505 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b4164020 con 0x7fe7b4064c40 2020-11-20T12:13:33.298 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.275+0000 7fe7b3fff700 1 --2- 172.21.15.192:0/1622843505 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7b4064c40 0x7fe7b4143110 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fe7a000c710 tx=0x7fe7a0007c20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:33.298 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.275+0000 7fe7b0ff9700 1 -- 172.21.15.192:0/1622843505 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a000e4a0 con 0x7fe7b4064c40 2020-11-20T12:13:33.298 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.275+0000 7fe7b0ff9700 1 -- 172.21.15.192:0/1622843505 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a0001e90 con 0x7fe7b4064c40 2020-11-20T12:13:33.299 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.275+0000 7fe7bb223700 1 -- 172.21.15.192:0/1622843505 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b41642c0 con 0x7fe7b4064c40 2020-11-20T12:13:33.299 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.275+0000 7fe7b0ff9700 1 -- 172.21.15.192:0/1622843505 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a000e830 con 0x7fe7b4064c40 2020-11-20T12:13:33.299 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.275+0000 7fe7bb223700 1 -- 172.21.15.192:0/1622843505 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b4164800 con 0x7fe7b4064c40 2020-11-20T12:13:33.299 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.276+0000 7fe7bb223700 1 -- 172.21.15.192:0/1622843505 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe7b40699a0 con 0x7fe7b4064c40 2020-11-20T12:13:33.299 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.277+0000 7fe7b0ff9700 1 -- 172.21.15.192:0/1622843505 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fe7a0019030 con 0x7fe7b4064c40 2020-11-20T12:13:33.299 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.277+0000 7fe7b0ff9700 1 --2- 172.21.15.192:0/1622843505 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fe78c080670 0x7fe78c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:33.300 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.278+0000 7fe7b0ff9700 1 -- 172.21.15.192:0/1622843505 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fe7a00a25e0 con 0x7fe7b4064c40 2020-11-20T12:13:33.300 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.278+0000 7fe7b8fbf700 1 --2- 172.21.15.192:0/1622843505 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fe78c080670 0x7fe78c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:33.300 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.278+0000 7fe7b0ff9700 1 --2- 172.21.15.192:0/1622843505 >> [v2:172.21.15.192:6818/23254,v1:172.21.15.192:6819/23254] conn(0x7fe78c0893a0 0x7fe78c08b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:33.300 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.278+0000 7fe7b0ff9700 1 -- 172.21.15.192:0/1622843505 --> [v2:172.21.15.192:6818/23254,v1:172.21.15.192:6819/23254] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe78c08be20 con 0x7fe78c0893a0 2020-11-20T12:13:33.300 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.278+0000 7fe7b0ff9700 1 -- 172.21.15.192:0/1622843505 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7a00a28d0 con 0x7fe7b4064c40 2020-11-20T12:13:33.301 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.278+0000 7fe7b97c0700 1 --2- 172.21.15.192:0/1622843505 >> [v2:172.21.15.192:6818/23254,v1:172.21.15.192:6819/23254] conn(0x7fe78c0893a0 0x7fe78c08b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:33.301 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.278+0000 7fe7b8fbf700 1 --2- 172.21.15.192:0/1622843505 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fe78c080670 0x7fe78c082b30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fe7a8006c10 tx=0x7fe7a8008040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:33.301 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.278+0000 7fe7b97c0700 1 --2- 172.21.15.192:0/1622843505 >> [v2:172.21.15.192:6818/23254,v1:172.21.15.192:6819/23254] conn(0x7fe78c0893a0 0x7fe78c08b7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:33.301 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.279+0000 7fe7b0ff9700 1 -- 172.21.15.192:0/1622843505 <== osd.9 v2:172.21.15.192:6818/23254 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7fe78c08be20 con 0x7fe78c0893a0 2020-11-20T12:13:33.303 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.291+0000 7fe7bb223700 1 -- 172.21.15.192:0/1622843505 --> [v2:172.21.15.192:6818/23254,v1:172.21.15.192:6819/23254] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe7b4164990 con 0x7fe78c0893a0 2020-11-20T12:13:33.303 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.292+0000 7fe7b0ff9700 1 -- 172.21.15.192:0/1622843505 <== osd.9 v2:172.21.15.192:6818/23254 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe7ac006d70 con 0x7fe78c0893a0 2020-11-20T12:13:33.303 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.292+0000 7fe7bb223700 1 -- 172.21.15.192:0/1622843505 >> [v2:172.21.15.192:6818/23254,v1:172.21.15.192:6819/23254] conn(0x7fe78c0893a0 msgr2=0x7fe78c08b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:33.304 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.292+0000 7fe7bb223700 1 --2- 172.21.15.192:0/1622843505 >> [v2:172.21.15.192:6818/23254,v1:172.21.15.192:6819/23254] conn(0x7fe78c0893a0 0x7fe78c08b7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:33.304 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.292+0000 7fe7bb223700 1 -- 172.21.15.192:0/1622843505 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fe78c080670 msgr2=0x7fe78c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:33.304 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.292+0000 7fe7bb223700 1 --2- 172.21.15.192:0/1622843505 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fe78c080670 0x7fe78c082b30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fe7a8006c10 tx=0x7fe7a8008040).stop 2020-11-20T12:13:33.304 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.292+0000 7fe7bb223700 1 -- 172.21.15.192:0/1622843505 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7b4064c40 msgr2=0x7fe7b4143110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:33.305 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.292+0000 7fe7bb223700 1 --2- 172.21.15.192:0/1622843505 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7b4064c40 0x7fe7b4143110 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fe7a000c710 tx=0x7fe7a0007c20).stop 2020-11-20T12:13:33.305 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.292+0000 7fe7b97c0700 1 -- 172.21.15.192:0/1622843505 reap_dead start 2020-11-20T12:13:33.305 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.292+0000 7fe7bb223700 1 -- 172.21.15.192:0/1622843505 shutdown_connections 2020-11-20T12:13:33.305 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.292+0000 7fe7bb223700 1 -- 172.21.15.192:0/1622843505 >> 172.21.15.192:0/1622843505 conn(0x7fe7b4062100 msgr2=0x7fe7b40c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:33.305 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.292+0000 7fe7bb223700 1 -- 172.21.15.192:0/1622843505 shutdown_connections 2020-11-20T12:13:33.306 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.292+0000 7fe7bb223700 1 -- 172.21.15.192:0/1622843505 wait complete. 2020-11-20T12:13:33.306 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2020-11-20T12:13:33.306 INFO:teuthology.orchestra.run.smithi192.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:13:33.307 INFO:teuthology.orchestra.run.smithi192.stdout:} 2020-11-20T12:13:33.307 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 9 2020-11-20T12:13:33.418 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.414+0000 7f9a993f3700 1 Processor -- start 2020-11-20T12:13:33.418 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.414+0000 7f9a993f3700 1 -- start start 2020-11-20T12:13:33.423 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.415+0000 7f9a993f3700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9a94060370 0x7f9a94060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:33.423 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.415+0000 7f9a993f3700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a94151e80 con 0x7f9a94154920 2020-11-20T12:13:33.423 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.415+0000 7f9a993f3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a94152120 con 0x7f9a94064c40 2020-11-20T12:13:33.423 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.415+0000 7f9a993f3700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a94064260 con 0x7f9a94060370 2020-11-20T12:13:33.424 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.415+0000 7f9a92ffd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9a94060370 0x7f9a94060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:33.424 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.415+0000 7f9a92ffd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9a94060370 0x7f9a94060750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49834/0 (socket says 172.21.15.192:49834) 2020-11-20T12:13:33.424 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.415+0000 7f9a92ffd700 1 -- 172.21.15.192:0/1316685679 learned_addr learned my addr 172.21.15.192:0/1316685679 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:33.424 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.415+0000 7f9a8bfff700 1 --1- 172.21.15.192:0/1316685679 >> v1:172.21.15.87:6789/0 conn(0x7f9a94154920 0x7f9a940c2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.192:39220/0 (socket says 172.21.15.192:39220) 2020-11-20T12:13:33.425 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.416+0000 7f9a92ffd700 1 -- 172.21.15.192:0/1316685679 >> v1:172.21.15.146:6789/0 conn(0x7f9a94064c40 legacy=0x7f9a94151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:33.425 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.416+0000 7f9a92ffd700 1 -- 172.21.15.192:0/1316685679 >> v1:172.21.15.87:6789/0 conn(0x7f9a94154920 legacy=0x7f9a940c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:33.425 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.416+0000 7f9a92ffd700 1 -- 172.21.15.192:0/1316685679 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a94064500 con 0x7f9a94060370 2020-11-20T12:13:33.425 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.416+0000 7f9a927fc700 1 -- 172.21.15.192:0/1316685679 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3874908057 0 0) 0x7f9a94151e80 con 0x7f9a94154920 2020-11-20T12:13:33.425 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.416+0000 7f9a92ffd700 1 --2- 172.21.15.192:0/1316685679 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a94060370 0x7f9a94060750 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f9a84009a10 tx=0x7f9a84006ef0).ready entity=mon.2 client_cookie=1729a9148390b6d6 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:33.426 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.416+0000 7f9a927fc700 1 -- 172.21.15.192:0/1316685679 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8400b8f0 con 0x7f9a94060370 2020-11-20T12:13:33.426 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.416+0000 7f9a927fc700 1 -- 172.21.15.192:0/1316685679 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a84000e90 con 0x7f9a94060370 2020-11-20T12:13:33.426 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.416+0000 7f9a927fc700 1 -- 172.21.15.192:0/1316685679 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8400bc60 con 0x7f9a94060370 2020-11-20T12:13:33.426 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.416+0000 7f9a993f3700 1 -- 172.21.15.192:0/1316685679 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a94060370 msgr2=0x7f9a94060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:33.426 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.417+0000 7f9a993f3700 1 --2- 172.21.15.192:0/1316685679 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a94060370 0x7f9a94060750 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f9a84009a10 tx=0x7f9a84006ef0).stop 2020-11-20T12:13:33.427 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.417+0000 7f9a993f3700 1 -- 172.21.15.192:0/1316685679 shutdown_connections 2020-11-20T12:13:33.427 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.417+0000 7f9a993f3700 1 --2- 172.21.15.192:0/1316685679 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a94060370 0x7f9a94060750 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:33.427 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.417+0000 7f9a993f3700 1 -- 172.21.15.192:0/1316685679 >> 172.21.15.192:0/1316685679 conn(0x7f9a94062100 msgr2=0x7f9a940c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:33.427 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.417+0000 7f9a993f3700 1 -- 172.21.15.192:0/1316685679 shutdown_connections 2020-11-20T12:13:33.427 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.417+0000 7f9a993f3700 1 -- 172.21.15.192:0/1316685679 wait complete. 2020-11-20T12:13:33.428 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.418+0000 7f9a993f3700 1 Processor -- start 2020-11-20T12:13:33.428 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.418+0000 7f9a993f3700 1 -- start start 2020-11-20T12:13:33.428 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.418+0000 7f9a993f3700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a94060370 0x7f9a941610f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:33.428 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.418+0000 7f9a993f3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a94064c40 0x7f9a940c7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:33.428 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.418+0000 7f9a993f3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a94154920 0x7f9a94158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:33.428 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.418+0000 7f9a993f3700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a94158950 con 0x7f9a94060370 2020-11-20T12:13:33.429 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.418+0000 7f9a993f3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a940b04c0 con 0x7f9a94064c40 2020-11-20T12:13:33.429 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.418+0000 7f9a993f3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a940b0760 con 0x7f9a94154920 2020-11-20T12:13:33.429 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.419+0000 7f9a937fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a94154920 0x7f9a94158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:33.429 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.419+0000 7f9a937fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a94154920 0x7f9a94158460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49844/0 (socket says 172.21.15.192:49844) 2020-11-20T12:13:33.429 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.419+0000 7f9a937fe700 1 -- 172.21.15.192:0/379565941 learned_addr learned my addr 172.21.15.192:0/379565941 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:33.430 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.419+0000 7f9a8bfff700 1 --2- 172.21.15.192:0/379565941 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a94064c40 0x7f9a940c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:33.430 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.419+0000 7f9a92ffd700 1 --2- 172.21.15.192:0/379565941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a94060370 0x7f9a941610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:33.430 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.419+0000 7f9a937fe700 1 -- 172.21.15.192:0/379565941 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a94064c40 msgr2=0x7f9a940c7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:33.431 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.419+0000 7f9a937fe700 1 --2- 172.21.15.192:0/379565941 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a94064c40 0x7f9a940c7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:33.431 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.419+0000 7f9a937fe700 1 -- 172.21.15.192:0/379565941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a94060370 msgr2=0x7f9a941610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:33.431 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.419+0000 7f9a937fe700 1 --2- 172.21.15.192:0/379565941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a94060370 0x7f9a941610f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:33.432 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.419+0000 7f9a937fe700 1 -- 172.21.15.192:0/379565941 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a94160710 con 0x7f9a94154920 2020-11-20T12:13:33.432 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.419+0000 7f9a92ffd700 1 --2- 172.21.15.192:0/379565941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a94060370 0x7f9a941610f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:13:33.433 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.419+0000 7f9a937fe700 1 --2- 172.21.15.192:0/379565941 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a94154920 0x7f9a94158460 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f9a8c00ca90 tx=0x7f9a8c00cda0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:33.433 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.419+0000 7f9a8affd700 1 -- 172.21.15.192:0/379565941 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c003120 con 0x7f9a94154920 2020-11-20T12:13:33.433 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.419+0000 7f9a8affd700 1 -- 172.21.15.192:0/379565941 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8c00a870 con 0x7f9a94154920 2020-11-20T12:13:33.434 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.419+0000 7f9a993f3700 1 -- 172.21.15.192:0/379565941 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a941609b0 con 0x7f9a94154920 2020-11-20T12:13:33.434 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.419+0000 7f9a8affd700 1 -- 172.21.15.192:0/379565941 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c00abf0 con 0x7f9a94154920 2020-11-20T12:13:33.435 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.419+0000 7f9a993f3700 1 -- 172.21.15.192:0/379565941 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a940b0a00 con 0x7f9a94154920 2020-11-20T12:13:33.435 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.420+0000 7f9a993f3700 1 -- 172.21.15.192:0/379565941 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a940699a0 con 0x7f9a94154920 2020-11-20T12:13:33.437 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.421+0000 7f9a8affd700 1 -- 172.21.15.192:0/379565941 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f9a8c019030 con 0x7f9a94154920 2020-11-20T12:13:33.437 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.421+0000 7f9a8affd700 1 --2- 172.21.15.192:0/379565941 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f9a70080670 0x7f9a70082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:33.438 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.421+0000 7f9a8affd700 1 -- 172.21.15.192:0/379565941 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f9a8c0a2250 con 0x7f9a94154920 2020-11-20T12:13:33.438 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.421+0000 7f9a92ffd700 1 --2- 172.21.15.192:0/379565941 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f9a70080670 0x7f9a70082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:33.438 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.422+0000 7f9a92ffd700 1 --2- 172.21.15.192:0/379565941 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f9a70080670 0x7f9a70082b30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f9a84006f30 tx=0x7f9a84016000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:33.439 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.425+0000 7f9a8affd700 1 -- 172.21.15.192:0/379565941 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f9a8c076c60 con 0x7f9a94154920 2020-11-20T12:13:33.571 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.568+0000 7f9a993f3700 1 -- 172.21.15.192:0/379565941 --> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "9", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a9405ca80 con 0x7f9a70080670 2020-11-20T12:13:33.572 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.568+0000 7f9a8affd700 1 -- 172.21.15.192:0/379565941 <== mgr.4106 v2:172.21.15.192:6800/22925 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 9 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9a9405ca80 con 0x7f9a70080670 2020-11-20T12:13:33.573 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.570+0000 7f9a993f3700 1 -- 172.21.15.192:0/379565941 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f9a70080670 msgr2=0x7f9a70082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:33.574 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.570+0000 7f9a993f3700 1 --2- 172.21.15.192:0/379565941 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f9a70080670 0x7f9a70082b30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f9a84006f30 tx=0x7f9a84016000).stop 2020-11-20T12:13:33.574 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.570+0000 7f9a993f3700 1 -- 172.21.15.192:0/379565941 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a94154920 msgr2=0x7f9a94158460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:33.574 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.570+0000 7f9a993f3700 1 --2- 172.21.15.192:0/379565941 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a94154920 0x7f9a94158460 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f9a8c00ca90 tx=0x7f9a8c00cda0).stop 2020-11-20T12:13:33.574 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.570+0000 7f9a993f3700 1 -- 172.21.15.192:0/379565941 shutdown_connections 2020-11-20T12:13:33.574 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.570+0000 7f9a993f3700 1 --2- 172.21.15.192:0/379565941 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f9a70080670 0x7f9a70082b30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:33.575 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.570+0000 7f9a993f3700 1 --2- 172.21.15.192:0/379565941 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a94154920 0x7f9a94158460 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:33.575 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.570+0000 7f9a993f3700 1 --2- 172.21.15.192:0/379565941 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f9a94060370 0x7f9a941610f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:33.575 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.570+0000 7f9a993f3700 1 --2- 172.21.15.192:0/379565941 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a94064c40 0x7f9a940c7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:33.575 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.570+0000 7f9a993f3700 1 -- 172.21.15.192:0/379565941 >> 172.21.15.192:0/379565941 conn(0x7f9a94062100 msgr2=0x7f9a940c2340 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:33.575 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.570+0000 7f9a993f3700 1 -- 172.21.15.192:0/379565941 shutdown_connections 2020-11-20T12:13:33.576 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.570+0000 7f9a993f3700 1 -- 172.21.15.192:0/379565941 wait complete. 2020-11-20T12:13:33.576 INFO:teuthology.orchestra.run.smithi192.stderr:instructed osd(s) 9 to deep-scrub 2020-11-20T12:13:33.585 INFO:tasks.ceph:Scrubbing osd.1 2020-11-20T12:13:33.586 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:13:33.698 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.695+0000 7fcbc3886700 1 Processor -- start 2020-11-20T12:13:33.699 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.695+0000 7fcbc3886700 1 -- start start 2020-11-20T12:13:33.710 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.696+0000 7fcbc3886700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fcbbc060370 0x7fcbbc060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:33.710 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.696+0000 7fcbc3886700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbbc151e80 con 0x7fcbbc154920 2020-11-20T12:13:33.711 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.696+0000 7fcbc3886700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbbc152120 con 0x7fcbbc064c40 2020-11-20T12:13:33.711 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.696+0000 7fcbc3886700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbbc064260 con 0x7fcbbc060370 2020-11-20T12:13:33.711 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.696+0000 7fcbc1e23700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fcbbc064c40 0x7fcbbc151340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52516/0 (socket says 172.21.15.192:52516) 2020-11-20T12:13:33.712 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.696+0000 7fcbc1e23700 1 -- 172.21.15.192:0/3648849570 learned_addr learned my addr 172.21.15.192:0/3648849570 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T12:13:33.712 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.696+0000 7fcbc1622700 1 --2- 172.21.15.192:0/3648849570 >> v2:172.21.15.87:3300/0 conn(0x7fcbbc060370 0x7fcbbc060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:33.712 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.696+0000 7fcbabfff700 1 -- 172.21.15.192:0/3648849570 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 896582240 0 0) 0x7fcbbc152120 con 0x7fcbbc064c40 2020-11-20T12:13:33.713 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.697+0000 7fcbabfff700 1 -- 172.21.15.192:0/3648849570 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcba4003280 con 0x7fcbbc064c40 2020-11-20T12:13:33.713 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.697+0000 7fcbabfff700 1 -- 172.21.15.192:0/3648849570 <== mon.2 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2818507083 0 0) 0x7fcba4003280 con 0x7fcbbc064c40 2020-11-20T12:13:33.714 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.697+0000 7fcbabfff700 1 -- 172.21.15.192:0/3648849570 >> v2:172.21.15.87:3300/0 conn(0x7fcbbc060370 msgr2=0x7fcbbc060750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:33.714 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.697+0000 7fcbabfff700 1 --2- 172.21.15.192:0/3648849570 >> v2:172.21.15.87:3300/0 conn(0x7fcbbc060370 0x7fcbbc060750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:33.714 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.697+0000 7fcbabfff700 1 -- 172.21.15.192:0/3648849570 >> v1:172.21.15.146:6789/0 conn(0x7fcbbc154920 legacy=0x7fcbbc0c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:33.715 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.697+0000 7fcbabfff700 1 -- 172.21.15.192:0/3648849570 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbbc064500 con 0x7fcbbc064c40 2020-11-20T12:13:33.715 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.697+0000 7fcbabfff700 1 -- 172.21.15.192:0/3648849570 <== mon.2 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3985397220 0 0) 0x7fcbb40018a0 con 0x7fcbbc064c40 2020-11-20T12:13:33.716 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.697+0000 7fcbabfff700 1 -- 172.21.15.192:0/3648849570 >> v1:172.21.15.192:6789/0 conn(0x7fcbbc064c40 legacy=0x7fcbbc151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:33.716 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.697+0000 7fcbabfff700 1 --2- 172.21.15.192:0/3648849570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcba40037c0 0x7fcba4003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:33.716 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.697+0000 7fcbabfff700 1 --2- 172.21.15.192:0/3648849570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcba4004520 0x7fcba40049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:33.717 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.697+0000 7fcbabfff700 1 --2- 172.21.15.192:0/3648849570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcba4004e90 0x7fcba400b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:33.717 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.697+0000 7fcbabfff700 1 -- 172.21.15.192:0/3648849570 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbbc064260 con 0x7fcba4004e90 2020-11-20T12:13:33.718 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.697+0000 7fcbabfff700 1 -- 172.21.15.192:0/3648849570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba4005340 con 0x7fcba4004520 2020-11-20T12:13:33.718 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.697+0000 7fcbabfff700 1 -- 172.21.15.192:0/3648849570 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba400bc60 con 0x7fcba40037c0 2020-11-20T12:13:33.718 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.697+0000 7fcbc1622700 1 --2- 172.21.15.192:0/3648849570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcba40037c0 0x7fcba4003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:33.719 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.697+0000 7fcbc1e23700 1 --2- 172.21.15.192:0/3648849570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcba4004e90 0x7fcba400b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:33.719 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.697+0000 7fcbc0e21700 1 --2- 172.21.15.192:0/3648849570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcba4004520 0x7fcba40049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:33.720 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.697+0000 7fcbc1622700 1 -- 172.21.15.192:0/3648849570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcba4004520 msgr2=0x7fcba40049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:33.720 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.697+0000 7fcbc1622700 1 --2- 172.21.15.192:0/3648849570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcba4004520 0x7fcba40049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:33.720 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.697+0000 7fcbc1622700 1 -- 172.21.15.192:0/3648849570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcba4004e90 msgr2=0x7fcba400b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:33.721 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.697+0000 7fcbc1622700 1 --2- 172.21.15.192:0/3648849570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcba4004e90 0x7fcba400b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:33.721 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.697+0000 7fcbc1622700 1 -- 172.21.15.192:0/3648849570 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba4003280 con 0x7fcba40037c0 2020-11-20T12:13:33.721 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.697+0000 7fcbc0e21700 1 --2- 172.21.15.192:0/3648849570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcba4004520 0x7fcba40049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:13:33.722 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.697+0000 7fcbc1e23700 1 --2- 172.21.15.192:0/3648849570 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcba4004e90 0x7fcba400b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:13:33.722 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.697+0000 7fcbc1e23700 1 -- 172.21.15.192:0/3648849570 reap_dead start 2020-11-20T12:13:33.723 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.697+0000 7fcbc1622700 1 --2- 172.21.15.192:0/3648849570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcba40037c0 0x7fcba4003be0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7fcbb800bc40 tx=0x7fcbb8006e30).ready entity=mon.2 client_cookie=901149e67dd2af73 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:33.723 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.697+0000 7fcbabfff700 1 -- 172.21.15.192:0/3648849570 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb800b350 con 0x7fcba40037c0 2020-11-20T12:13:33.723 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.697+0000 7fcbabfff700 1 -- 172.21.15.192:0/3648849570 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb800eab0 con 0x7fcba40037c0 2020-11-20T12:13:33.724 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.697+0000 7fcbabfff700 1 -- 172.21.15.192:0/3648849570 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb800ee30 con 0x7fcba40037c0 2020-11-20T12:13:33.724 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.698+0000 7fcbc3886700 1 -- 172.21.15.192:0/3648849570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcba40037c0 msgr2=0x7fcba4003be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:33.724 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.698+0000 7fcbc3886700 1 --2- 172.21.15.192:0/3648849570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcba40037c0 0x7fcba4003be0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7fcbb800bc40 tx=0x7fcbb8006e30).stop 2020-11-20T12:13:33.725 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.698+0000 7fcbc3886700 1 -- 172.21.15.192:0/3648849570 shutdown_connections 2020-11-20T12:13:33.725 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.698+0000 7fcbc3886700 1 --2- 172.21.15.192:0/3648849570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcba40037c0 0x7fcba4003be0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:33.726 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.698+0000 7fcbc3886700 1 -- 172.21.15.192:0/3648849570 >> 172.21.15.192:0/3648849570 conn(0x7fcbbc062100 msgr2=0x7fcbbc0c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:33.726 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.698+0000 7fcbc3886700 1 -- 172.21.15.192:0/3648849570 shutdown_connections 2020-11-20T12:13:33.726 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.698+0000 7fcbc3886700 1 -- 172.21.15.192:0/3648849570 wait complete. 2020-11-20T12:13:33.727 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.699+0000 7fcbc3886700 1 Processor -- start 2020-11-20T12:13:33.727 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.699+0000 7fcbc3886700 1 -- start start 2020-11-20T12:13:33.727 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.700+0000 7fcbc3886700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcba40037c0 0x7fcbbc0b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:33.728 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.700+0000 7fcbc3886700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbbc161020 0x7fcbbc14d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:33.728 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.700+0000 7fcbc3886700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbbc14db70 0x7fcbbc14b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:33.729 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.700+0000 7fcbc3886700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbbc0c82d0 con 0x7fcbbc14db70 2020-11-20T12:13:33.729 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.700+0000 7fcbc3886700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbbc163d10 con 0x7fcbbc161020 2020-11-20T12:13:33.729 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.700+0000 7fcbc3886700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbbc163fb0 con 0x7fcba40037c0 2020-11-20T12:13:33.730 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.700+0000 7fcbc1622700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcba40037c0 0x7fcbbc0b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:33.730 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.700+0000 7fcbc1622700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcba40037c0 0x7fcbbc0b0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49860/0 (socket says 172.21.15.192:49860) 2020-11-20T12:13:33.730 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.700+0000 7fcbc1622700 1 -- 172.21.15.192:0/1914209571 learned_addr learned my addr 172.21.15.192:0/1914209571 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:33.731 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.700+0000 7fcbc0e21700 1 --2- 172.21.15.192:0/1914209571 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbbc161020 0x7fcbbc14d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:33.731 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.700+0000 7fcbc1622700 1 -- 172.21.15.192:0/1914209571 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbbc161020 msgr2=0x7fcbbc14d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:33.731 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.700+0000 7fcbc1e23700 1 --2- 172.21.15.192:0/1914209571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbbc14db70 0x7fcbbc14b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:33.732 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.700+0000 7fcbc1622700 1 --2- 172.21.15.192:0/1914209571 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbbc161020 0x7fcbbc14d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:33.732 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.700+0000 7fcbc1622700 1 -- 172.21.15.192:0/1914209571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbbc14db70 msgr2=0x7fcbbc14b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:33.733 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.700+0000 7fcbc1622700 1 --2- 172.21.15.192:0/1914209571 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fcbbc14db70 0x7fcbbc14b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:33.733 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.700+0000 7fcbc1622700 1 -- 172.21.15.192:0/1914209571 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbbc164250 con 0x7fcba40037c0 2020-11-20T12:13:33.734 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.700+0000 7fcbc1622700 1 --2- 172.21.15.192:0/1914209571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcba40037c0 0x7fcbbc0b0340 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fcba4005500 tx=0x7fcbb8019000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:33.734 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.701+0000 7fcba97fa700 1 -- 172.21.15.192:0/1914209571 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb8012ea0 con 0x7fcba40037c0 2020-11-20T12:13:33.734 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.701+0000 7fcba97fa700 1 -- 172.21.15.192:0/1914209571 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb8000e90 con 0x7fcba40037c0 2020-11-20T12:13:33.735 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.701+0000 7fcbc3886700 1 -- 172.21.15.192:0/1914209571 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbbc1644f0 con 0x7fcba40037c0 2020-11-20T12:13:33.735 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.701+0000 7fcba97fa700 1 -- 172.21.15.192:0/1914209571 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb8024640 con 0x7fcba40037c0 2020-11-20T12:13:33.735 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.701+0000 7fcbc3886700 1 -- 172.21.15.192:0/1914209571 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbbc1541e0 con 0x7fcba40037c0 2020-11-20T12:13:33.736 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.701+0000 7fcbc3886700 1 -- 172.21.15.192:0/1914209571 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcbbc0699a0 con 0x7fcba40037c0 2020-11-20T12:13:33.736 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.702+0000 7fcba97fa700 1 -- 172.21.15.192:0/1914209571 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fcbb802c3f0 con 0x7fcba40037c0 2020-11-20T12:13:33.737 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.703+0000 7fcba97fa700 1 --2- 172.21.15.192:0/1914209571 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fcb94080670 0x7fcb94082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:33.737 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.703+0000 7fcba97fa700 1 -- 172.21.15.192:0/1914209571 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fcbb80a41b0 con 0x7fcba40037c0 2020-11-20T12:13:33.737 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.703+0000 7fcbc0e21700 1 --2- 172.21.15.192:0/1914209571 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fcb94080670 0x7fcb94082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:33.738 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.703+0000 7fcba97fa700 1 --2- 172.21.15.192:0/1914209571 >> [v2:172.21.15.146:6800/22856,v1:172.21.15.146:6801/22856] conn(0x7fcb940893a0 0x7fcb9408b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:33.738 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.703+0000 7fcba97fa700 1 -- 172.21.15.192:0/1914209571 --> [v2:172.21.15.146:6800/22856,v1:172.21.15.146:6801/22856] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcb9408be20 con 0x7fcb940893a0 2020-11-20T12:13:33.738 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.703+0000 7fcba97fa700 1 -- 172.21.15.192:0/1914209571 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcbb80a6790 con 0x7fcba40037c0 2020-11-20T12:13:33.739 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.703+0000 7fcbc0e21700 1 --2- 172.21.15.192:0/1914209571 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fcb94080670 0x7fcb94082b30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fcbac0079b0 tx=0x7fcbac009040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:33.739 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.703+0000 7fcbc1e23700 1 --2- 172.21.15.192:0/1914209571 >> [v2:172.21.15.146:6800/22856,v1:172.21.15.146:6801/22856] conn(0x7fcb940893a0 0x7fcb9408b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:33.740 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.704+0000 7fcbc1e23700 1 --2- 172.21.15.192:0/1914209571 >> [v2:172.21.15.146:6800/22856,v1:172.21.15.146:6801/22856] conn(0x7fcb940893a0 0x7fcb9408b7c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:33.740 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.704+0000 7fcba97fa700 1 -- 172.21.15.192:0/1914209571 <== osd.1 v2:172.21.15.146:6800/22856 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7fcb9408be20 con 0x7fcb940893a0 2020-11-20T12:13:33.744 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.717+0000 7fcbc3886700 1 -- 172.21.15.192:0/1914209571 --> [v2:172.21.15.146:6800/22856,v1:172.21.15.146:6801/22856] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcbbc05ca80 con 0x7fcb940893a0 2020-11-20T12:13:33.744 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.718+0000 7fcba97fa700 1 -- 172.21.15.192:0/1914209571 <== osd.1 v2:172.21.15.146:6800/22856 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fcbbc05ca80 con 0x7fcb940893a0 2020-11-20T12:13:33.744 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.718+0000 7fcbc3886700 1 -- 172.21.15.192:0/1914209571 >> [v2:172.21.15.146:6800/22856,v1:172.21.15.146:6801/22856] conn(0x7fcb940893a0 msgr2=0x7fcb9408b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:33.745 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.718+0000 7fcbc3886700 1 --2- 172.21.15.192:0/1914209571 >> [v2:172.21.15.146:6800/22856,v1:172.21.15.146:6801/22856] conn(0x7fcb940893a0 0x7fcb9408b7c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:33.745 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.718+0000 7fcbc3886700 1 -- 172.21.15.192:0/1914209571 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fcb94080670 msgr2=0x7fcb94082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:33.746 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.718+0000 7fcbc3886700 1 --2- 172.21.15.192:0/1914209571 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fcb94080670 0x7fcb94082b30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fcbac0079b0 tx=0x7fcbac009040).stop 2020-11-20T12:13:33.746 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.718+0000 7fcbc3886700 1 -- 172.21.15.192:0/1914209571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcba40037c0 msgr2=0x7fcbbc0b0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:33.746 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.718+0000 7fcbc3886700 1 --2- 172.21.15.192:0/1914209571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcba40037c0 0x7fcbbc0b0340 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fcba4005500 tx=0x7fcbb8019000).stop 2020-11-20T12:13:33.747 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.718+0000 7fcbc1e23700 1 -- 172.21.15.192:0/1914209571 reap_dead start 2020-11-20T12:13:33.747 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.718+0000 7fcbc3886700 1 -- 172.21.15.192:0/1914209571 shutdown_connections 2020-11-20T12:13:33.747 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.718+0000 7fcbc3886700 1 -- 172.21.15.192:0/1914209571 >> 172.21.15.192:0/1914209571 conn(0x7fcbbc062100 msgr2=0x7fcbbc0c2340 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:33.748 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.718+0000 7fcbc3886700 1 -- 172.21.15.192:0/1914209571 shutdown_connections 2020-11-20T12:13:33.748 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.718+0000 7fcbc3886700 1 -- 172.21.15.192:0/1914209571 wait complete. 2020-11-20T12:13:33.749 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2020-11-20T12:13:33.749 INFO:teuthology.orchestra.run.smithi192.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:13:33.749 INFO:teuthology.orchestra.run.smithi192.stdout:} 2020-11-20T12:13:33.750 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2020-11-20T12:13:33.861 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.857+0000 7f3aa6bd9700 1 Processor -- start 2020-11-20T12:13:33.861 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.857+0000 7f3aa6bd9700 1 -- start start 2020-11-20T12:13:33.864 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.858+0000 7f3aa6bd9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3aa0060370 0x7f3aa0060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:33.865 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.858+0000 7f3aa6bd9700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3aa0064c40 0x7f3aa0151340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:33.865 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.858+0000 7f3aa6bd9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aa0151e80 con 0x7f3aa0154920 2020-11-20T12:13:33.865 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.858+0000 7f3aa6bd9700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aa0152120 con 0x7f3aa0064c40 2020-11-20T12:13:33.865 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.858+0000 7f3aa6bd9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aa0064260 con 0x7f3aa0060370 2020-11-20T12:13:33.866 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.858+0000 7f3aa5176700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3aa0064c40 0x7f3aa0151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:33.866 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.858+0000 7f3aa4975700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3aa0060370 0x7f3aa0060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:33.866 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.859+0000 7f3aa5176700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3aa0064c40 0x7f3aa0151340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.87:3300/0 says I am v2:172.21.15.192:59312/0 (socket says 172.21.15.192:59312) 2020-11-20T12:13:33.868 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.859+0000 7f3aa4975700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3aa0060370 0x7f3aa0060750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.192:53960/0 (socket says 172.21.15.192:53960) 2020-11-20T12:13:33.868 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.859+0000 7f3aa5176700 1 -- 172.21.15.192:0/1485356792 learned_addr learned my addr 172.21.15.192:0/1485356792 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:33.869 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.859+0000 7f3aa5176700 1 -- 172.21.15.192:0/1485356792 >> v2:172.21.15.146:3300/0 conn(0x7f3aa0060370 msgr2=0x7f3aa0060750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:33.869 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.859+0000 7f3aa5176700 1 --2- 172.21.15.192:0/1485356792 >> v2:172.21.15.146:3300/0 conn(0x7f3aa0060370 0x7f3aa0060750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:33.869 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.859+0000 7f3aa5176700 1 -- 172.21.15.192:0/1485356792 >> v1:172.21.15.146:6789/0 conn(0x7f3aa0154920 legacy=0x7f3aa00c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:33.870 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.859+0000 7f3aa5176700 1 -- 172.21.15.192:0/1485356792 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa0064500 con 0x7f3aa0064c40 2020-11-20T12:13:33.870 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.859+0000 7f3aa5176700 1 --2- 172.21.15.192:0/1485356792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3aa0064c40 0x7f3aa0151340 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f3aa00c5450 tx=0x7f3a980092d0).ready entity=mon.0 client_cookie=d3e064f11287ea7c server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:33.871 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.859+0000 7f3a9f7fe700 1 -- 172.21.15.192:0/1485356792 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9800bc80 con 0x7f3aa0064c40 2020-11-20T12:13:33.871 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.859+0000 7f3a9f7fe700 1 -- 172.21.15.192:0/1485356792 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9800bde0 con 0x7f3aa0064c40 2020-11-20T12:13:33.871 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.859+0000 7f3a9f7fe700 1 -- 172.21.15.192:0/1485356792 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a98011610 con 0x7f3aa0064c40 2020-11-20T12:13:33.872 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.860+0000 7f3aa6bd9700 1 -- 172.21.15.192:0/1485356792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3aa0064c40 msgr2=0x7f3aa0151340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:33.872 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.860+0000 7f3aa6bd9700 1 --2- 172.21.15.192:0/1485356792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3aa0064c40 0x7f3aa0151340 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f3aa00c5450 tx=0x7f3a980092d0).stop 2020-11-20T12:13:33.873 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.860+0000 7f3aa6bd9700 1 -- 172.21.15.192:0/1485356792 shutdown_connections 2020-11-20T12:13:33.873 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.860+0000 7f3aa6bd9700 1 --2- 172.21.15.192:0/1485356792 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3aa0064c40 0x7f3aa0151340 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:33.873 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.860+0000 7f3aa6bd9700 1 --2- 172.21.15.192:0/1485356792 >> v2:172.21.15.146:3300/0 conn(0x7f3aa0060370 0x7f3aa0060750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:33.874 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.860+0000 7f3aa6bd9700 1 -- 172.21.15.192:0/1485356792 >> 172.21.15.192:0/1485356792 conn(0x7f3aa0062100 msgr2=0x7f3aa00c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:33.874 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.860+0000 7f3aa6bd9700 1 -- 172.21.15.192:0/1485356792 shutdown_connections 2020-11-20T12:13:33.874 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.860+0000 7f3aa6bd9700 1 -- 172.21.15.192:0/1485356792 wait complete. 2020-11-20T12:13:33.875 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.861+0000 7f3aa6bd9700 1 Processor -- start 2020-11-20T12:13:33.875 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.861+0000 7f3aa6bd9700 1 -- start start 2020-11-20T12:13:33.878 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.862+0000 7f3aa6bd9700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3aa0060370 0x7f3aa00b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:33.879 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.862+0000 7f3aa6bd9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3aa0064c40 0x7f3aa0161200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:33.879 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.862+0000 7f3aa6bd9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3aa0154920 0x7f3aa00bfb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:33.879 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.862+0000 7f3aa6bd9700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa01616f0 con 0x7f3aa0060370 2020-11-20T12:13:33.879 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.862+0000 7f3aa6bd9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa00b0a00 con 0x7f3aa0064c40 2020-11-20T12:13:33.880 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.862+0000 7f3aa6bd9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa0152690 con 0x7f3aa0154920 2020-11-20T12:13:33.880 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.862+0000 7f3aa5176700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3aa0154920 0x7f3aa00bfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:33.880 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.862+0000 7f3aa5176700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3aa0154920 0x7f3aa00bfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49880/0 (socket says 172.21.15.192:49880) 2020-11-20T12:13:33.880 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.862+0000 7f3aa5176700 1 -- 172.21.15.192:0/1847070069 learned_addr learned my addr 172.21.15.192:0/1847070069 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:33.880 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.862+0000 7f3aa4975700 1 --2- 172.21.15.192:0/1847070069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3aa0060370 0x7f3aa00b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:33.881 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.862+0000 7f3a9ffff700 1 --2- 172.21.15.192:0/1847070069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3aa0064c40 0x7f3aa0161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:33.881 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.862+0000 7f3aa5176700 1 -- 172.21.15.192:0/1847070069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3aa0064c40 msgr2=0x7f3aa0161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:33.881 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.862+0000 7f3aa5176700 1 --2- 172.21.15.192:0/1847070069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3aa0064c40 0x7f3aa0161200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:33.881 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.862+0000 7f3aa5176700 1 -- 172.21.15.192:0/1847070069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3aa0060370 msgr2=0x7f3aa00b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:33.881 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.862+0000 7f3aa5176700 1 --2- 172.21.15.192:0/1847070069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3aa0060370 0x7f3aa00b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:33.882 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.862+0000 7f3aa5176700 1 -- 172.21.15.192:0/1847070069 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa0152930 con 0x7f3aa0154920 2020-11-20T12:13:33.882 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.862+0000 7f3aa5176700 1 --2- 172.21.15.192:0/1847070069 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3aa0154920 0x7f3aa00bfb70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f3a98009310 tx=0x7f3a98016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:33.882 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.862+0000 7f3a9cff9700 1 -- 172.21.15.192:0/1847070069 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9801b5e0 con 0x7f3aa0154920 2020-11-20T12:13:33.882 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.862+0000 7f3a9cff9700 1 -- 172.21.15.192:0/1847070069 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9801b740 con 0x7f3aa0154920 2020-11-20T12:13:33.882 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.862+0000 7f3aa6bd9700 1 -- 172.21.15.192:0/1847070069 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aa0152bd0 con 0x7f3aa0154920 2020-11-20T12:13:33.883 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.863+0000 7f3a9cff9700 1 -- 172.21.15.192:0/1847070069 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9801bac0 con 0x7f3aa0154920 2020-11-20T12:13:33.883 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.863+0000 7f3aa6bd9700 1 -- 172.21.15.192:0/1847070069 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aa0153310 con 0x7f3aa0154920 2020-11-20T12:13:33.883 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.863+0000 7f3aa6bd9700 1 -- 172.21.15.192:0/1847070069 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aa00699a0 con 0x7f3aa0154920 2020-11-20T12:13:33.883 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.864+0000 7f3a9cff9700 1 -- 172.21.15.192:0/1847070069 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f3a98017070 con 0x7f3aa0154920 2020-11-20T12:13:33.883 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.864+0000 7f3a9cff9700 1 --2- 172.21.15.192:0/1847070069 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3a78080670 0x7f3a78082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:33.884 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.864+0000 7f3a9cff9700 1 -- 172.21.15.192:0/1847070069 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f3a980a4ab0 con 0x7f3aa0154920 2020-11-20T12:13:33.884 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.865+0000 7f3aa4975700 1 --2- 172.21.15.192:0/1847070069 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3a78080670 0x7f3a78082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:33.884 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.865+0000 7f3aa4975700 1 --2- 172.21.15.192:0/1847070069 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3a78080670 0x7f3a78082b30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f3a94006fd0 tx=0x7f3a94006e30).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:33.884 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:33.868+0000 7f3a9cff9700 1 -- 172.21.15.192:0/1847070069 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f3a980794c0 con 0x7f3aa0154920 2020-11-20T12:13:34.011 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.007+0000 7f3aa6bd9700 1 -- 172.21.15.192:0/1847070069 --> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f3aa01535c0 con 0x7f3a78080670 2020-11-20T12:13:34.011 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.007+0000 7f3a9cff9700 1 -- 172.21.15.192:0/1847070069 <== mgr.4106 v2:172.21.15.192:6800/22925 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3aa01535c0 con 0x7f3a78080670 2020-11-20T12:13:34.013 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.009+0000 7f3aa6bd9700 1 -- 172.21.15.192:0/1847070069 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3a78080670 msgr2=0x7f3a78082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:34.013 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.009+0000 7f3aa6bd9700 1 --2- 172.21.15.192:0/1847070069 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3a78080670 0x7f3a78082b30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f3a94006fd0 tx=0x7f3a94006e30).stop 2020-11-20T12:13:34.013 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.009+0000 7f3aa6bd9700 1 -- 172.21.15.192:0/1847070069 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3aa0154920 msgr2=0x7f3aa00bfb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:34.013 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.009+0000 7f3aa6bd9700 1 --2- 172.21.15.192:0/1847070069 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3aa0154920 0x7f3aa00bfb70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f3a98009310 tx=0x7f3a98016000).stop 2020-11-20T12:13:34.014 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.009+0000 7f3aa6bd9700 1 -- 172.21.15.192:0/1847070069 shutdown_connections 2020-11-20T12:13:34.014 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.009+0000 7f3aa6bd9700 1 --2- 172.21.15.192:0/1847070069 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3a78080670 0x7f3a78082b30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:34.014 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.009+0000 7f3aa6bd9700 1 --2- 172.21.15.192:0/1847070069 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3aa0154920 0x7f3aa00bfb70 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:34.014 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.009+0000 7f3aa6bd9700 1 --2- 172.21.15.192:0/1847070069 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3aa0060370 0x7f3aa00b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:34.014 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.009+0000 7f3aa6bd9700 1 --2- 172.21.15.192:0/1847070069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3aa0064c40 0x7f3aa0161200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:34.015 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.009+0000 7f3aa6bd9700 1 -- 172.21.15.192:0/1847070069 >> 172.21.15.192:0/1847070069 conn(0x7f3aa0062100 msgr2=0x7f3aa00c58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:34.015 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.009+0000 7f3aa6bd9700 1 -- 172.21.15.192:0/1847070069 shutdown_connections 2020-11-20T12:13:34.015 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.009+0000 7f3aa6bd9700 1 -- 172.21.15.192:0/1847070069 wait complete. 2020-11-20T12:13:34.015 INFO:teuthology.orchestra.run.smithi192.stderr:instructed osd(s) 1 to deep-scrub 2020-11-20T12:13:34.024 INFO:tasks.ceph:Scrubbing osd.4 2020-11-20T12:13:34.024 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:13:34.137 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.133+0000 7f3964d99700 1 Processor -- start 2020-11-20T12:13:34.137 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.133+0000 7f3964d99700 1 -- start start 2020-11-20T12:13:34.141 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.134+0000 7f3964d99700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f39600bf160 0x7f39600bf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:34.141 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.134+0000 7f3964d99700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3960152680 con 0x7f3960151be0 2020-11-20T12:13:34.141 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.134+0000 7f3964d99700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3960064730 con 0x7f39601537d0 2020-11-20T12:13:34.141 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.134+0000 7f3964d99700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39601528b0 con 0x7f39600bf160 2020-11-20T12:13:34.142 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.134+0000 7f395ed9d700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f39601537d0 0x7f3960153c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52556/0 (socket says 172.21.15.192:52556) 2020-11-20T12:13:34.142 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.134+0000 7f395ed9d700 1 -- 172.21.15.192:0/3210377521 learned_addr learned my addr 172.21.15.192:0/3210377521 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T12:13:34.142 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.135+0000 7f395e59c700 1 --2- 172.21.15.192:0/3210377521 >> v2:172.21.15.146:3300/0 conn(0x7f39600bf160 0x7f39600bf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:34.142 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.135+0000 7f395dd9b700 1 -- 172.21.15.192:0/3210377521 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4142218377 0 0) 0x7f3960064730 con 0x7f39601537d0 2020-11-20T12:13:34.142 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.135+0000 7f395dd9b700 1 -- 172.21.15.192:0/3210377521 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3940003280 con 0x7f39601537d0 2020-11-20T12:13:34.143 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.135+0000 7f395dd9b700 1 -- 172.21.15.192:0/3210377521 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3721937673 0 0) 0x7f3960152680 con 0x7f3960151be0 2020-11-20T12:13:34.143 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.135+0000 7f395dd9b700 1 -- 172.21.15.192:0/3210377521 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3960064730 con 0x7f3960151be0 2020-11-20T12:13:34.143 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.135+0000 7f395dd9b700 1 -- 172.21.15.192:0/3210377521 <== mon.2 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3227745814 0 0) 0x7f3940003280 con 0x7f39601537d0 2020-11-20T12:13:34.143 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.135+0000 7f395dd9b700 1 -- 172.21.15.192:0/3210377521 >> v2:172.21.15.146:3300/0 conn(0x7f39600bf160 msgr2=0x7f39600bf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:34.143 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.135+0000 7f395dd9b700 1 --2- 172.21.15.192:0/3210377521 >> v2:172.21.15.146:3300/0 conn(0x7f39600bf160 0x7f39600bf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:34.144 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.135+0000 7f395dd9b700 1 -- 172.21.15.192:0/3210377521 >> v1:172.21.15.87:6789/0 conn(0x7f3960151be0 legacy=0x7f3960062740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:34.144 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.135+0000 7f395dd9b700 1 -- 172.21.15.192:0/3210377521 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3960152b50 con 0x7f39601537d0 2020-11-20T12:13:34.144 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.135+0000 7f395dd9b700 1 -- 172.21.15.192:0/3210377521 <== mon.2 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3985397220 0 0) 0x7f39580018a0 con 0x7f39601537d0 2020-11-20T12:13:34.144 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.135+0000 7f395dd9b700 1 -- 172.21.15.192:0/3210377521 >> v1:172.21.15.192:6789/0 conn(0x7f39601537d0 legacy=0x7f3960153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:34.144 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.135+0000 7f395dd9b700 1 --2- 172.21.15.192:0/3210377521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3940003950 0x7f3940003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:34.145 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.135+0000 7f395dd9b700 1 --2- 172.21.15.192:0/3210377521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3940004520 0x7f39400049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:34.145 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.135+0000 7f395dd9b700 1 --2- 172.21.15.192:0/3210377521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3940004e90 0x7f394000b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:34.145 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.135+0000 7f395dd9b700 1 -- 172.21.15.192:0/3210377521 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39601528b0 con 0x7f3940004e90 2020-11-20T12:13:34.145 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.135+0000 7f395dd9b700 1 -- 172.21.15.192:0/3210377521 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394000bc60 con 0x7f3940003950 2020-11-20T12:13:34.146 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.135+0000 7f395dd9b700 1 -- 172.21.15.192:0/3210377521 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394000bda0 con 0x7f3940004520 2020-11-20T12:13:34.146 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.135+0000 7f3957fff700 1 --2- 172.21.15.192:0/3210377521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3940004520 0x7f39400049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:34.146 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.135+0000 7f395e59c700 1 --2- 172.21.15.192:0/3210377521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3940003950 0x7f3940003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:34.146 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.135+0000 7f395ed9d700 1 --2- 172.21.15.192:0/3210377521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3940004e90 0x7f394000b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:34.146 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.135+0000 7f3957fff700 1 -- 172.21.15.192:0/3210377521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3940003950 msgr2=0x7f3940003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:34.147 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.135+0000 7f3957fff700 1 --2- 172.21.15.192:0/3210377521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3940003950 0x7f3940003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:34.147 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.135+0000 7f3957fff700 1 -- 172.21.15.192:0/3210377521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3940004e90 msgr2=0x7f394000b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:34.147 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.135+0000 7f3957fff700 1 --2- 172.21.15.192:0/3210377521 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3940004e90 0x7f394000b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:34.147 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.135+0000 7f395ed9d700 1 -- 172.21.15.192:0/3210377521 reap_dead start 2020-11-20T12:13:34.147 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.135+0000 7f3957fff700 1 -- 172.21.15.192:0/3210377521 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3940003280 con 0x7f3940004520 2020-11-20T12:13:34.148 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.136+0000 7f3957fff700 1 --2- 172.21.15.192:0/3210377521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3940004520 0x7f39400049a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f3948001ac0 tx=0x7f3948007bd0).ready entity=mon.2 client_cookie=c4a4786e812eb5a3 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:34.148 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.136+0000 7f395dd9b700 1 -- 172.21.15.192:0/3210377521 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3948007020 con 0x7f3940004520 2020-11-20T12:13:34.148 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.136+0000 7f395dd9b700 1 -- 172.21.15.192:0/3210377521 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3948007180 con 0x7f3940004520 2020-11-20T12:13:34.148 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.136+0000 7f395dd9b700 1 -- 172.21.15.192:0/3210377521 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394800c650 con 0x7f3940004520 2020-11-20T12:13:34.148 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.136+0000 7f3964d99700 1 -- 172.21.15.192:0/3210377521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3940004520 msgr2=0x7f39400049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:34.149 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.136+0000 7f3964d99700 1 --2- 172.21.15.192:0/3210377521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3940004520 0x7f39400049a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f3948001ac0 tx=0x7f3948007bd0).stop 2020-11-20T12:13:34.149 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.136+0000 7f3964d99700 1 -- 172.21.15.192:0/3210377521 shutdown_connections 2020-11-20T12:13:34.149 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.136+0000 7f3964d99700 1 --2- 172.21.15.192:0/3210377521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3940004520 0x7f39400049a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:34.149 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.136+0000 7f3964d99700 1 -- 172.21.15.192:0/3210377521 >> 172.21.15.192:0/3210377521 conn(0x7f39600601b0 msgr2=0x7f39600605c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:34.150 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.136+0000 7f3964d99700 1 -- 172.21.15.192:0/3210377521 shutdown_connections 2020-11-20T12:13:34.150 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.136+0000 7f3964d99700 1 -- 172.21.15.192:0/3210377521 wait complete. 2020-11-20T12:13:34.150 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.137+0000 7f3964d99700 1 Processor -- start 2020-11-20T12:13:34.150 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.137+0000 7f3964d99700 1 -- start start 2020-11-20T12:13:34.153 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.138+0000 7f3964d99700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3940004520 0x7f39601615c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:34.153 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.138+0000 7f3964d99700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39601636c0 0x7f3960160a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:34.154 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.138+0000 7f3964d99700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f396014ac50 0x7f3960110af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:34.154 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.138+0000 7f3964d99700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3960163ea0 con 0x7f39601636c0 2020-11-20T12:13:34.154 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.138+0000 7f3964d99700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3960164140 con 0x7f3940004520 2020-11-20T12:13:34.154 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.138+0000 7f3964d99700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39601643e0 con 0x7f396014ac50 2020-11-20T12:13:34.154 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.138+0000 7f395ed9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f396014ac50 0x7f3960110af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:34.155 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.138+0000 7f395ed9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f396014ac50 0x7f3960110af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49900/0 (socket says 172.21.15.192:49900) 2020-11-20T12:13:34.155 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.138+0000 7f395ed9d700 1 -- 172.21.15.192:0/1169138515 learned_addr learned my addr 172.21.15.192:0/1169138515 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:34.155 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.138+0000 7f395e59c700 1 --2- 172.21.15.192:0/1169138515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3940004520 0x7f39601615c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:34.155 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.138+0000 7f3957fff700 1 --2- 172.21.15.192:0/1169138515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39601636c0 0x7f3960160a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:34.155 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.138+0000 7f395ed9d700 1 -- 172.21.15.192:0/1169138515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3940004520 msgr2=0x7f39601615c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:34.156 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.138+0000 7f395ed9d700 1 --2- 172.21.15.192:0/1169138515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3940004520 0x7f39601615c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:34.156 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.138+0000 7f395ed9d700 1 -- 172.21.15.192:0/1169138515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39601636c0 msgr2=0x7f3960160a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:34.156 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.138+0000 7f395ed9d700 1 --2- 172.21.15.192:0/1169138515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39601636c0 0x7f3960160a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:34.156 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.138+0000 7f395ed9d700 1 -- 172.21.15.192:0/1169138515 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39601602e0 con 0x7f396014ac50 2020-11-20T12:13:34.157 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.138+0000 7f3957fff700 1 --2- 172.21.15.192:0/1169138515 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f39601636c0 0x7f3960160a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:13:34.157 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.139+0000 7f395ed9d700 1 --2- 172.21.15.192:0/1169138515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f396014ac50 0x7f3960110af0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f396014ed30 tx=0x7f3960152ce0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:34.157 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.139+0000 7f39567fc700 1 -- 172.21.15.192:0/1169138515 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3958007860 con 0x7f396014ac50 2020-11-20T12:13:34.157 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.139+0000 7f39567fc700 1 -- 172.21.15.192:0/1169138515 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395800fc30 con 0x7f396014ac50 2020-11-20T12:13:34.157 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.139+0000 7f3964d99700 1 -- 172.21.15.192:0/1169138515 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3960160580 con 0x7f396014ac50 2020-11-20T12:13:34.158 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.139+0000 7f39567fc700 1 -- 172.21.15.192:0/1169138515 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3958012350 con 0x7f396014ac50 2020-11-20T12:13:34.158 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.139+0000 7f3964d99700 1 -- 172.21.15.192:0/1169138515 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3960160f10 con 0x7f396014ac50 2020-11-20T12:13:34.158 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.139+0000 7f3964d99700 1 -- 172.21.15.192:0/1169138515 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f39601645a0 con 0x7f396014ac50 2020-11-20T12:13:34.158 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.140+0000 7f39567fc700 1 -- 172.21.15.192:0/1169138515 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f395801b030 con 0x7f396014ac50 2020-11-20T12:13:34.158 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.141+0000 7f39567fc700 1 --2- 172.21.15.192:0/1169138515 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f393c0806a0 0x7f393c082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:34.159 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.141+0000 7f39567fc700 1 -- 172.21.15.192:0/1169138515 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f39580a2c80 con 0x7f396014ac50 2020-11-20T12:13:34.159 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.141+0000 7f395e59c700 1 --2- 172.21.15.192:0/1169138515 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f393c0806a0 0x7f393c082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:34.159 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.141+0000 7f39567fc700 1 --2- 172.21.15.192:0/1169138515 >> [v2:172.21.15.146:6808/22857,v1:172.21.15.146:6809/22857] conn(0x7f393c089260 0x7f393c08b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:34.159 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.141+0000 7f39567fc700 1 -- 172.21.15.192:0/1169138515 --> [v2:172.21.15.146:6808/22857,v1:172.21.15.146:6809/22857] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f393c08bce0 con 0x7f393c089260 2020-11-20T12:13:34.159 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.141+0000 7f39567fc700 1 -- 172.21.15.192:0/1169138515 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39580a2ff0 con 0x7f396014ac50 2020-11-20T12:13:34.160 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.141+0000 7f395e59c700 1 --2- 172.21.15.192:0/1169138515 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f393c0806a0 0x7f393c082b60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f3950006fd0 tx=0x7f3950008040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:34.160 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.141+0000 7f3957fff700 1 --2- 172.21.15.192:0/1169138515 >> [v2:172.21.15.146:6808/22857,v1:172.21.15.146:6809/22857] conn(0x7f393c089260 0x7f393c08b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:34.160 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.142+0000 7f3957fff700 1 --2- 172.21.15.192:0/1169138515 >> [v2:172.21.15.146:6808/22857,v1:172.21.15.146:6809/22857] conn(0x7f393c089260 0x7f393c08b680 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:34.160 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.143+0000 7f39567fc700 1 -- 172.21.15.192:0/1169138515 <== osd.4 v2:172.21.15.146:6808/22857 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f393c08bce0 con 0x7f393c089260 2020-11-20T12:13:34.162 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.155+0000 7f3964d99700 1 -- 172.21.15.192:0/1169138515 --> [v2:172.21.15.146:6808/22857,v1:172.21.15.146:6809/22857] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f396014b390 con 0x7f393c089260 2020-11-20T12:13:34.162 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.156+0000 7f39567fc700 1 -- 172.21.15.192:0/1169138515 <== osd.4 v2:172.21.15.146:6808/22857 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f396014b390 con 0x7f393c089260 2020-11-20T12:13:34.162 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.156+0000 7f3964d99700 1 -- 172.21.15.192:0/1169138515 >> [v2:172.21.15.146:6808/22857,v1:172.21.15.146:6809/22857] conn(0x7f393c089260 msgr2=0x7f393c08b680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:34.163 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.156+0000 7f3964d99700 1 --2- 172.21.15.192:0/1169138515 >> [v2:172.21.15.146:6808/22857,v1:172.21.15.146:6809/22857] conn(0x7f393c089260 0x7f393c08b680 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:34.163 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.156+0000 7f3964d99700 1 -- 172.21.15.192:0/1169138515 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f393c0806a0 msgr2=0x7f393c082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:34.163 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.156+0000 7f3964d99700 1 --2- 172.21.15.192:0/1169138515 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f393c0806a0 0x7f393c082b60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f3950006fd0 tx=0x7f3950008040).stop 2020-11-20T12:13:34.163 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.156+0000 7f3964d99700 1 -- 172.21.15.192:0/1169138515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f396014ac50 msgr2=0x7f3960110af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:34.163 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.156+0000 7f3964d99700 1 --2- 172.21.15.192:0/1169138515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f396014ac50 0x7f3960110af0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f396014ed30 tx=0x7f3960152ce0).stop 2020-11-20T12:13:34.164 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.156+0000 7f395ed9d700 1 -- 172.21.15.192:0/1169138515 reap_dead start 2020-11-20T12:13:34.164 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.156+0000 7f3964d99700 1 -- 172.21.15.192:0/1169138515 shutdown_connections 2020-11-20T12:13:34.164 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.156+0000 7f3964d99700 1 -- 172.21.15.192:0/1169138515 >> 172.21.15.192:0/1169138515 conn(0x7f39600601b0 msgr2=0x7f3960060590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:34.164 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.156+0000 7f3964d99700 1 -- 172.21.15.192:0/1169138515 shutdown_connections 2020-11-20T12:13:34.164 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.156+0000 7f3964d99700 1 -- 172.21.15.192:0/1169138515 wait complete. 2020-11-20T12:13:34.165 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2020-11-20T12:13:34.165 INFO:teuthology.orchestra.run.smithi192.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:13:34.165 INFO:teuthology.orchestra.run.smithi192.stdout:} 2020-11-20T12:13:34.171 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2020-11-20T12:13:34.280 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.277+0000 7fa7970e4700 1 Processor -- start 2020-11-20T12:13:34.281 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.277+0000 7fa7970e4700 1 -- start start 2020-11-20T12:13:34.282 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.278+0000 7fa7970e4700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fa790060370 0x7fa790060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:34.282 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.278+0000 7fa7970e4700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa790154920 0x7fa790064c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:34.282 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.278+0000 7fa7970e4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa7900c2340 0x7fa790151340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:34.282 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.278+0000 7fa7970e4700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa790065130 con 0x7fa790060370 2020-11-20T12:13:34.282 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.278+0000 7fa7970e4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa790151e80 con 0x7fa7900c2340 2020-11-20T12:13:34.283 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.278+0000 7fa7970e4700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa790152120 con 0x7fa790154920 2020-11-20T12:13:34.287 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.278+0000 7fa78ffff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa790154920 0x7fa790064c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:34.287 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.278+0000 7fa78ffff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa790154920 0x7fa790064c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49906/0 (socket says 172.21.15.192:49906) 2020-11-20T12:13:34.287 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.278+0000 7fa78ffff700 1 -- 172.21.15.192:0/617123329 learned_addr learned my addr 172.21.15.192:0/617123329 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:34.287 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.278+0000 7fa794e80700 1 --2- 172.21.15.192:0/617123329 >> v2:172.21.15.87:3300/0 conn(0x7fa790060370 0x7fa790060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:34.288 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.278+0000 7fa795681700 1 --2- 172.21.15.192:0/617123329 >> v2:172.21.15.146:3300/0 conn(0x7fa7900c2340 0x7fa790151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:34.288 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.278+0000 7fa78ffff700 1 -- 172.21.15.192:0/617123329 >> v2:172.21.15.146:3300/0 conn(0x7fa7900c2340 msgr2=0x7fa790151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:34.288 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.278+0000 7fa78ffff700 1 --2- 172.21.15.192:0/617123329 >> v2:172.21.15.146:3300/0 conn(0x7fa7900c2340 0x7fa790151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:34.288 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.278+0000 7fa78ffff700 1 -- 172.21.15.192:0/617123329 >> v2:172.21.15.87:3300/0 conn(0x7fa790060370 msgr2=0x7fa790060750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:34.288 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.278+0000 7fa78ffff700 1 --2- 172.21.15.192:0/617123329 >> v2:172.21.15.87:3300/0 conn(0x7fa790060370 0x7fa790060750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:34.289 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.278+0000 7fa78ffff700 1 -- 172.21.15.192:0/617123329 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa790064260 con 0x7fa790154920 2020-11-20T12:13:34.289 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.279+0000 7fa78ffff700 1 --2- 172.21.15.192:0/617123329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa790154920 0x7fa790064c40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fa790065730 tx=0x7fa784006ef0).ready entity=mon.2 client_cookie=ec802cf27410da53 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:34.289 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.279+0000 7fa78f7fe700 1 -- 172.21.15.192:0/617123329 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78400b8c0 con 0x7fa790154920 2020-11-20T12:13:34.290 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.279+0000 7fa78f7fe700 1 -- 172.21.15.192:0/617123329 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa784000e90 con 0x7fa790154920 2020-11-20T12:13:34.290 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.279+0000 7fa78f7fe700 1 -- 172.21.15.192:0/617123329 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78400bc30 con 0x7fa790154920 2020-11-20T12:13:34.290 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.279+0000 7fa7970e4700 1 -- 172.21.15.192:0/617123329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa790154920 msgr2=0x7fa790064c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:34.290 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.279+0000 7fa7970e4700 1 --2- 172.21.15.192:0/617123329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa790154920 0x7fa790064c40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fa790065730 tx=0x7fa784006ef0).stop 2020-11-20T12:13:34.290 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.279+0000 7fa7970e4700 1 -- 172.21.15.192:0/617123329 shutdown_connections 2020-11-20T12:13:34.291 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.279+0000 7fa7970e4700 1 --2- 172.21.15.192:0/617123329 >> v2:172.21.15.146:3300/0 conn(0x7fa7900c2340 0x7fa790151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:34.291 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.279+0000 7fa7970e4700 1 --2- 172.21.15.192:0/617123329 >> v2:172.21.15.87:3300/0 conn(0x7fa790060370 0x7fa790060750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:34.291 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.279+0000 7fa7970e4700 1 --2- 172.21.15.192:0/617123329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa790154920 0x7fa790064c40 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:34.291 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.279+0000 7fa7970e4700 1 -- 172.21.15.192:0/617123329 >> 172.21.15.192:0/617123329 conn(0x7fa790062100 msgr2=0x7fa7900c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:34.291 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.279+0000 7fa7970e4700 1 -- 172.21.15.192:0/617123329 shutdown_connections 2020-11-20T12:13:34.291 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.279+0000 7fa7970e4700 1 -- 172.21.15.192:0/617123329 wait complete. 2020-11-20T12:13:34.292 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.280+0000 7fa7970e4700 1 Processor -- start 2020-11-20T12:13:34.292 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.281+0000 7fa7970e4700 1 -- start start 2020-11-20T12:13:34.292 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.281+0000 7fa7970e4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa790060370 0x7fa7900bf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:34.292 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.281+0000 7fa7970e4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7900c2340 0x7fa79014ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:34.292 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.281+0000 7fa7970e4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa790154920 0x7fa790067a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:34.293 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.281+0000 7fa7970e4700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7900b0aa0 con 0x7fa790060370 2020-11-20T12:13:34.293 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.281+0000 7fa7970e4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7900b04c0 con 0x7fa7900c2340 2020-11-20T12:13:34.294 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.281+0000 7fa7970e4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa790160720 con 0x7fa790154920 2020-11-20T12:13:34.294 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.281+0000 7fa795681700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa790154920 0x7fa790067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:34.294 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.281+0000 7fa795681700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa790154920 0x7fa790067a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49916/0 (socket says 172.21.15.192:49916) 2020-11-20T12:13:34.294 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.281+0000 7fa795681700 1 -- 172.21.15.192:0/2715797985 learned_addr learned my addr 172.21.15.192:0/2715797985 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:34.295 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.282+0000 7fa78ffff700 1 --2- 172.21.15.192:0/2715797985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7900c2340 0x7fa79014ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:34.295 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.282+0000 7fa794e80700 1 --2- 172.21.15.192:0/2715797985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa790060370 0x7fa7900bf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:34.295 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.282+0000 7fa795681700 1 -- 172.21.15.192:0/2715797985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7900c2340 msgr2=0x7fa79014ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:34.296 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.282+0000 7fa795681700 1 --2- 172.21.15.192:0/2715797985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7900c2340 0x7fa79014ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:34.296 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.282+0000 7fa795681700 1 -- 172.21.15.192:0/2715797985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa790060370 msgr2=0x7fa7900bf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:34.297 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.282+0000 7fa795681700 1 --2- 172.21.15.192:0/2715797985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa790060370 0x7fa7900bf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:34.297 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.282+0000 7fa795681700 1 -- 172.21.15.192:0/2715797985 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa790160980 con 0x7fa790154920 2020-11-20T12:13:34.297 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.282+0000 7fa795681700 1 --2- 172.21.15.192:0/2715797985 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa790154920 0x7fa790067a90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fa78800db90 tx=0x7fa788008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:34.297 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.282+0000 7fa78cff9700 1 -- 172.21.15.192:0/2715797985 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa788017070 con 0x7fa790154920 2020-11-20T12:13:34.298 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.282+0000 7fa78cff9700 1 -- 172.21.15.192:0/2715797985 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78800b940 con 0x7fa790154920 2020-11-20T12:13:34.298 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.282+0000 7fa7970e4700 1 -- 172.21.15.192:0/2715797985 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa790160c20 con 0x7fa790154920 2020-11-20T12:13:34.298 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.282+0000 7fa78cff9700 1 -- 172.21.15.192:0/2715797985 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78800bce0 con 0x7fa790154920 2020-11-20T12:13:34.298 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.282+0000 7fa7970e4700 1 -- 172.21.15.192:0/2715797985 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7900b0720 con 0x7fa790154920 2020-11-20T12:13:34.298 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.283+0000 7fa7970e4700 1 -- 172.21.15.192:0/2715797985 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7900699a0 con 0x7fa790154920 2020-11-20T12:13:34.299 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.284+0000 7fa78cff9700 1 -- 172.21.15.192:0/2715797985 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fa788013690 con 0x7fa790154920 2020-11-20T12:13:34.300 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.284+0000 7fa78cff9700 1 --2- 172.21.15.192:0/2715797985 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fa76c080670 0x7fa76c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:34.300 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.284+0000 7fa78cff9700 1 -- 172.21.15.192:0/2715797985 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fa7880a2ca0 con 0x7fa790154920 2020-11-20T12:13:34.300 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.284+0000 7fa794e80700 1 --2- 172.21.15.192:0/2715797985 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fa76c080670 0x7fa76c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:34.300 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.285+0000 7fa794e80700 1 --2- 172.21.15.192:0/2715797985 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fa76c080670 0x7fa76c082b30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fa78000d930 tx=0x7fa780008040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:34.301 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.288+0000 7fa78cff9700 1 -- 172.21.15.192:0/2715797985 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fa788077630 con 0x7fa790154920 2020-11-20T12:13:34.432 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.429+0000 7fa7970e4700 1 -- 172.21.15.192:0/2715797985 --> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fa79005ca80 con 0x7fa76c080670 2020-11-20T12:13:34.433 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.429+0000 7fa78cff9700 1 -- 172.21.15.192:0/2715797985 <== mgr.4106 v2:172.21.15.192:6800/22925 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa79005ca80 con 0x7fa76c080670 2020-11-20T12:13:34.434 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.431+0000 7fa7970e4700 1 -- 172.21.15.192:0/2715797985 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fa76c080670 msgr2=0x7fa76c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:34.434 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.431+0000 7fa7970e4700 1 --2- 172.21.15.192:0/2715797985 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fa76c080670 0x7fa76c082b30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fa78000d930 tx=0x7fa780008040).stop 2020-11-20T12:13:34.435 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.431+0000 7fa7970e4700 1 -- 172.21.15.192:0/2715797985 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa790154920 msgr2=0x7fa790067a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:34.435 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.431+0000 7fa7970e4700 1 --2- 172.21.15.192:0/2715797985 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa790154920 0x7fa790067a90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fa78800db90 tx=0x7fa788008040).stop 2020-11-20T12:13:34.435 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.431+0000 7fa7970e4700 1 -- 172.21.15.192:0/2715797985 shutdown_connections 2020-11-20T12:13:34.435 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.431+0000 7fa7970e4700 1 --2- 172.21.15.192:0/2715797985 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fa76c080670 0x7fa76c082b30 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:34.436 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.431+0000 7fa7970e4700 1 --2- 172.21.15.192:0/2715797985 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa790154920 0x7fa790067a90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:34.436 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.431+0000 7fa7970e4700 1 --2- 172.21.15.192:0/2715797985 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fa790060370 0x7fa7900bf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:34.436 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.431+0000 7fa7970e4700 1 --2- 172.21.15.192:0/2715797985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7900c2340 0x7fa79014ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:34.436 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.431+0000 7fa7970e4700 1 -- 172.21.15.192:0/2715797985 >> 172.21.15.192:0/2715797985 conn(0x7fa790062100 msgr2=0x7fa79014df40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:34.436 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.431+0000 7fa7970e4700 1 -- 172.21.15.192:0/2715797985 shutdown_connections 2020-11-20T12:13:34.437 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.431+0000 7fa7970e4700 1 -- 172.21.15.192:0/2715797985 wait complete. 2020-11-20T12:13:34.437 INFO:teuthology.orchestra.run.smithi192.stderr:instructed osd(s) 4 to deep-scrub 2020-11-20T12:13:34.445 INFO:tasks.ceph:Scrubbing osd.7 2020-11-20T12:13:34.446 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:13:34.562 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.559+0000 7f6197075700 1 Processor -- start 2020-11-20T12:13:34.562 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.559+0000 7f6197075700 1 -- start start 2020-11-20T12:13:34.567 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.560+0000 7f6197075700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f61900bb8a0 0x7f61900bbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:34.567 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.560+0000 7f6197075700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6190067d10 0x7f61900bcef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:34.567 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.560+0000 7f6197075700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f619014d940 con 0x7f61900bcab0 2020-11-20T12:13:34.568 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.560+0000 7f6197075700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f619014dbe0 con 0x7f61900bb8a0 2020-11-20T12:13:34.568 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.560+0000 7f6197075700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f619014de80 con 0x7f6190067d10 2020-11-20T12:13:34.568 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.560+0000 7f6196874700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6190067d10 0x7f61900bcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:34.568 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.560+0000 7f6195872700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f61900bcab0 0x7f6190067600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52588/0 (socket says 172.21.15.192:52588) 2020-11-20T12:13:34.569 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.560+0000 7f6195872700 1 -- 172.21.15.192:0/818579958 learned_addr learned my addr 172.21.15.192:0/818579958 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T12:13:34.569 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.560+0000 7f6196073700 1 --2- 172.21.15.192:0/818579958 >> v2:172.21.15.87:3300/0 conn(0x7f61900bb8a0 0x7f61900bbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:34.569 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.560+0000 7f6196874700 1 -- 172.21.15.192:0/818579958 >> v2:172.21.15.87:3300/0 conn(0x7f61900bb8a0 msgr2=0x7f61900bbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:34.569 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.560+0000 7f6196874700 1 --2- 172.21.15.192:0/818579958 >> v2:172.21.15.87:3300/0 conn(0x7f61900bb8a0 0x7f61900bbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:34.569 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.560+0000 7f6196874700 1 -- 172.21.15.192:0/818579958 >> v1:172.21.15.192:6789/0 conn(0x7f61900bcab0 legacy=0x7f6190067600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:34.570 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.560+0000 7f6195071700 1 -- 172.21.15.192:0/818579958 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 114532054 0 0) 0x7f619014d940 con 0x7f61900bcab0 2020-11-20T12:13:34.570 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.560+0000 7f6196874700 1 -- 172.21.15.192:0/818579958 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f619014e120 con 0x7f6190067d10 2020-11-20T12:13:34.570 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.560+0000 7f6196874700 1 --2- 172.21.15.192:0/818579958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6190067d10 0x7f61900bcef0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f61900628d0 tx=0x7f6188009220).ready entity=mon.2 client_cookie=9cdf2ec48d74c067 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:34.570 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.560+0000 7f6195071700 1 -- 172.21.15.192:0/818579958 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618800ba90 con 0x7f6190067d10 2020-11-20T12:13:34.570 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.560+0000 7f6195071700 1 -- 172.21.15.192:0/818579958 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618800bbf0 con 0x7f6190067d10 2020-11-20T12:13:34.571 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.560+0000 7f6195071700 1 -- 172.21.15.192:0/818579958 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6188011400 con 0x7f6190067d10 2020-11-20T12:13:34.571 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.561+0000 7f6197075700 1 -- 172.21.15.192:0/818579958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6190067d10 msgr2=0x7f61900bcef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:34.571 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.561+0000 7f6197075700 1 --2- 172.21.15.192:0/818579958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6190067d10 0x7f61900bcef0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f61900628d0 tx=0x7f6188009220).stop 2020-11-20T12:13:34.571 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.561+0000 7f6197075700 1 -- 172.21.15.192:0/818579958 shutdown_connections 2020-11-20T12:13:34.571 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.561+0000 7f6197075700 1 --2- 172.21.15.192:0/818579958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6190067d10 0x7f61900bcef0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:34.572 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.561+0000 7f6197075700 1 --2- 172.21.15.192:0/818579958 >> v2:172.21.15.87:3300/0 conn(0x7f61900bb8a0 0x7f61900bbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:34.572 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.561+0000 7f6197075700 1 -- 172.21.15.192:0/818579958 >> 172.21.15.192:0/818579958 conn(0x7f61900c33e0 msgr2=0x7f61900c37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:34.572 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.561+0000 7f6197075700 1 -- 172.21.15.192:0/818579958 shutdown_connections 2020-11-20T12:13:34.572 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.561+0000 7f6197075700 1 -- 172.21.15.192:0/818579958 wait complete. 2020-11-20T12:13:34.572 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.562+0000 7f6197075700 1 Processor -- start 2020-11-20T12:13:34.573 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.562+0000 7f6197075700 1 -- start start 2020-11-20T12:13:34.573 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.563+0000 7f6197075700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6190067d10 0x7f6190149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:34.573 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.563+0000 7f6197075700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61900bb8a0 0x7f6190151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:34.573 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.563+0000 7f6197075700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61900bcab0 0x7f6190151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:34.574 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.563+0000 7f6197075700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6190160050 con 0x7f61900bb8a0 2020-11-20T12:13:34.574 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.563+0000 7f6197075700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6190160280 con 0x7f61900bcab0 2020-11-20T12:13:34.574 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.563+0000 7f6197075700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6190160520 con 0x7f6190067d10 2020-11-20T12:13:34.574 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.563+0000 7f6196073700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6190067d10 0x7f6190149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:34.574 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.563+0000 7f6196073700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6190067d10 0x7f6190149190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49926/0 (socket says 172.21.15.192:49926) 2020-11-20T12:13:34.575 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.563+0000 7f6196073700 1 -- 172.21.15.192:0/180641133 learned_addr learned my addr 172.21.15.192:0/180641133 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:34.575 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.563+0000 7f6196073700 1 -- 172.21.15.192:0/180641133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61900bcab0 msgr2=0x7f6190151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:34.575 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.563+0000 7f6196073700 1 --2- 172.21.15.192:0/180641133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61900bcab0 0x7f6190151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:13:34.575 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.563+0000 7f6196073700 1 -- 172.21.15.192:0/180641133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61900bb8a0 msgr2=0x7f6190151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:34.576 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.563+0000 7f6196073700 1 --2- 172.21.15.192:0/180641133 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f61900bb8a0 0x7f6190151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:13:34.576 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.563+0000 7f6196073700 1 -- 172.21.15.192:0/180641133 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61901607c0 con 0x7f6190067d10 2020-11-20T12:13:34.576 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.563+0000 7f6196073700 1 --2- 172.21.15.192:0/180641133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6190067d10 0x7f6190149190 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f618c00eb20 tx=0x7f618c006e30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:34.576 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.563+0000 7f617e7fc700 1 -- 172.21.15.192:0/180641133 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c00c920 con 0x7f6190067d10 2020-11-20T12:13:34.576 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.563+0000 7f617e7fc700 1 -- 172.21.15.192:0/180641133 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618c00ca80 con 0x7f6190067d10 2020-11-20T12:13:34.577 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.563+0000 7f6197075700 1 -- 172.21.15.192:0/180641133 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6190160a60 con 0x7f6190067d10 2020-11-20T12:13:34.577 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.563+0000 7f617e7fc700 1 -- 172.21.15.192:0/180641133 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c00ce00 con 0x7f6190067d10 2020-11-20T12:13:34.577 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.563+0000 7f6197075700 1 -- 172.21.15.192:0/180641133 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6190149680 con 0x7f6190067d10 2020-11-20T12:13:34.580 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.564+0000 7f6197075700 1 -- 172.21.15.192:0/180641133 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f61900beb30 con 0x7f6190067d10 2020-11-20T12:13:34.581 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.565+0000 7f617e7fc700 1 -- 172.21.15.192:0/180641133 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f618c012600 con 0x7f6190067d10 2020-11-20T12:13:34.581 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.565+0000 7f617e7fc700 1 --2- 172.21.15.192:0/180641133 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f6168080670 0x7f6168082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:34.582 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.566+0000 7f617e7fc700 1 -- 172.21.15.192:0/180641133 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f618c0a3950 con 0x7f6190067d10 2020-11-20T12:13:34.582 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.566+0000 7f6195872700 1 --2- 172.21.15.192:0/180641133 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f6168080670 0x7f6168082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:34.583 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.566+0000 7f617e7fc700 1 --2- 172.21.15.192:0/180641133 >> [v2:172.21.15.146:6816/22858,v1:172.21.15.146:6818/22858] conn(0x7f61680893a0 0x7f616808b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:34.583 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.566+0000 7f617e7fc700 1 -- 172.21.15.192:0/180641133 --> [v2:172.21.15.146:6816/22858,v1:172.21.15.146:6818/22858] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f616808be20 con 0x7f61680893a0 2020-11-20T12:13:34.583 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.566+0000 7f617e7fc700 1 -- 172.21.15.192:0/180641133 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f618c0a3cc0 con 0x7f6190067d10 2020-11-20T12:13:34.584 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.566+0000 7f6195872700 1 --2- 172.21.15.192:0/180641133 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f6168080670 0x7f6168082b30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f61800011e0 tx=0x7f61800076e0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:34.584 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.566+0000 7f6196874700 1 --2- 172.21.15.192:0/180641133 >> [v2:172.21.15.146:6816/22858,v1:172.21.15.146:6818/22858] conn(0x7f61680893a0 0x7f616808b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:34.585 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.566+0000 7f6196874700 1 --2- 172.21.15.192:0/180641133 >> [v2:172.21.15.146:6816/22858,v1:172.21.15.146:6818/22858] conn(0x7f61680893a0 0x7f616808b7c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:34.585 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.567+0000 7f617e7fc700 1 -- 172.21.15.192:0/180641133 <== osd.7 v2:172.21.15.146:6816/22858 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f616808be20 con 0x7f61680893a0 2020-11-20T12:13:34.588 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.580+0000 7f6197075700 1 -- 172.21.15.192:0/180641133 --> [v2:172.21.15.146:6816/22858,v1:172.21.15.146:6818/22858] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f61900ba030 con 0x7f61680893a0 2020-11-20T12:13:34.588 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.580+0000 7f617e7fc700 1 -- 172.21.15.192:0/180641133 <== osd.7 v2:172.21.15.146:6816/22858 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f61900ba030 con 0x7f61680893a0 2020-11-20T12:13:34.589 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.580+0000 7f6197075700 1 -- 172.21.15.192:0/180641133 >> [v2:172.21.15.146:6816/22858,v1:172.21.15.146:6818/22858] conn(0x7f61680893a0 msgr2=0x7f616808b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:34.589 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.580+0000 7f6197075700 1 --2- 172.21.15.192:0/180641133 >> [v2:172.21.15.146:6816/22858,v1:172.21.15.146:6818/22858] conn(0x7f61680893a0 0x7f616808b7c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:34.590 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.580+0000 7f6197075700 1 -- 172.21.15.192:0/180641133 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f6168080670 msgr2=0x7f6168082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:34.590 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.580+0000 7f6197075700 1 --2- 172.21.15.192:0/180641133 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f6168080670 0x7f6168082b30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f61800011e0 tx=0x7f61800076e0).stop 2020-11-20T12:13:34.590 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.581+0000 7f6197075700 1 -- 172.21.15.192:0/180641133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6190067d10 msgr2=0x7f6190149190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:34.591 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.581+0000 7f6197075700 1 --2- 172.21.15.192:0/180641133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6190067d10 0x7f6190149190 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f618c00eb20 tx=0x7f618c006e30).stop 2020-11-20T12:13:34.591 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.581+0000 7f6196874700 1 -- 172.21.15.192:0/180641133 reap_dead start 2020-11-20T12:13:34.592 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.581+0000 7f6197075700 1 -- 172.21.15.192:0/180641133 shutdown_connections 2020-11-20T12:13:34.592 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.581+0000 7f6197075700 1 -- 172.21.15.192:0/180641133 >> 172.21.15.192:0/180641133 conn(0x7f61900c33e0 msgr2=0x7f6190061630 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:34.592 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.581+0000 7f6197075700 1 -- 172.21.15.192:0/180641133 shutdown_connections 2020-11-20T12:13:34.593 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.581+0000 7f6197075700 1 -- 172.21.15.192:0/180641133 wait complete. 2020-11-20T12:13:34.593 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2020-11-20T12:13:34.594 INFO:teuthology.orchestra.run.smithi192.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:13:34.594 INFO:teuthology.orchestra.run.smithi192.stdout:} 2020-11-20T12:13:34.596 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2020-11-20T12:13:34.710 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.707+0000 7f2d71d1e700 1 Processor -- start 2020-11-20T12:13:34.711 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.707+0000 7f2d71d1e700 1 -- start start 2020-11-20T12:13:34.712 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.708+0000 7f2d71d1e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2d6c063b70 0x7f2d6c155470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:34.713 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.708+0000 7f2d71d1e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f2d6c14e370 0x7f2d6c14e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:34.713 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.708+0000 7f2d71d1e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d6c1516c0 con 0x7f2d6c063790 2020-11-20T12:13:34.713 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.708+0000 7f2d71d1e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d6c063030 con 0x7f2d6c14e370 2020-11-20T12:13:34.713 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.708+0000 7f2d71d1e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d6c155960 con 0x7f2d6c063b70 2020-11-20T12:13:34.714 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.708+0000 7f2d6bfff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2d6c063b70 0x7f2d6c155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:34.714 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.708+0000 7f2d70d1c700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f2d6c063790 0x7f2d6c0c5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52604/0 (socket says 172.21.15.192:52604) 2020-11-20T12:13:34.714 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.708+0000 7f2d70d1c700 1 -- 172.21.15.192:0/3903641370 learned_addr learned my addr 172.21.15.192:0/3903641370 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T12:13:34.714 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.708+0000 7f2d6bfff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2d6c063b70 0x7f2d6c155470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49938/0 (socket says 172.21.15.192:49938) 2020-11-20T12:13:34.714 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.708+0000 7f2d7151d700 1 --2- 172.21.15.192:0/3903641370 >> v2:172.21.15.87:3300/0 conn(0x7f2d6c14e370 0x7f2d6c14e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:34.715 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.708+0000 7f2d6bfff700 1 -- 172.21.15.192:0/3903641370 >> v2:172.21.15.87:3300/0 conn(0x7f2d6c14e370 msgr2=0x7f2d6c14e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:34.715 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.708+0000 7f2d6bfff700 1 --2- 172.21.15.192:0/3903641370 >> v2:172.21.15.87:3300/0 conn(0x7f2d6c14e370 0x7f2d6c14e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:34.715 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.708+0000 7f2d6bfff700 1 -- 172.21.15.192:0/3903641370 >> v1:172.21.15.192:6789/0 conn(0x7f2d6c063790 legacy=0x7f2d6c0c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:34.715 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.708+0000 7f2d6bfff700 1 -- 172.21.15.192:0/3903641370 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6c151960 con 0x7f2d6c063b70 2020-11-20T12:13:34.715 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.708+0000 7f2d6b7fe700 1 -- 172.21.15.192:0/3903641370 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 333240644 0 0) 0x7f2d6c1516c0 con 0x7f2d6c063790 2020-11-20T12:13:34.716 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.708+0000 7f2d7151d700 1 --2- 172.21.15.192:0/3903641370 >> v2:172.21.15.87:3300/0 conn(0x7f2d6c14e370 0x7f2d6c14e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:13:34.716 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.708+0000 7f2d6bfff700 1 --2- 172.21.15.192:0/3903641370 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d6c063b70 0x7f2d6c155470 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f2d6c0801f0 tx=0x7f2d58006e30).ready entity=mon.2 client_cookie=9be0f370ab9b9d1a server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:34.716 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.708+0000 7f2d6b7fe700 1 -- 172.21.15.192:0/3903641370 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d580097b0 con 0x7f2d6c063b70 2020-11-20T12:13:34.716 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.708+0000 7f2d6b7fe700 1 -- 172.21.15.192:0/3903641370 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d58000e90 con 0x7f2d6c063b70 2020-11-20T12:13:34.716 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.708+0000 7f2d6b7fe700 1 -- 172.21.15.192:0/3903641370 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d58009b20 con 0x7f2d6c063b70 2020-11-20T12:13:34.717 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.709+0000 7f2d71d1e700 1 -- 172.21.15.192:0/3903641370 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d6c063b70 msgr2=0x7f2d6c155470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:34.717 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.709+0000 7f2d71d1e700 1 --2- 172.21.15.192:0/3903641370 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d6c063b70 0x7f2d6c155470 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f2d6c0801f0 tx=0x7f2d58006e30).stop 2020-11-20T12:13:34.717 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.709+0000 7f2d71d1e700 1 -- 172.21.15.192:0/3903641370 shutdown_connections 2020-11-20T12:13:34.717 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.709+0000 7f2d71d1e700 1 --2- 172.21.15.192:0/3903641370 >> v2:172.21.15.87:3300/0 conn(0x7f2d6c14e370 0x7f2d6c14e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:34.717 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.709+0000 7f2d71d1e700 1 --2- 172.21.15.192:0/3903641370 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d6c063b70 0x7f2d6c155470 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:34.718 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.709+0000 7f2d71d1e700 1 -- 172.21.15.192:0/3903641370 >> 172.21.15.192:0/3903641370 conn(0x7f2d6c060c40 msgr2=0x7f2d6c0c5830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:34.718 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.709+0000 7f2d71d1e700 1 -- 172.21.15.192:0/3903641370 shutdown_connections 2020-11-20T12:13:34.718 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.709+0000 7f2d71d1e700 1 -- 172.21.15.192:0/3903641370 wait complete. 2020-11-20T12:13:34.720 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.710+0000 7f2d71d1e700 1 Processor -- start 2020-11-20T12:13:34.721 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.710+0000 7f2d71d1e700 1 -- start start 2020-11-20T12:13:34.721 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.711+0000 7f2d71d1e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d6c063790 0x7f2d6c164690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:34.721 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.711+0000 7f2d71d1e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d6c063b70 0x7f2d6c155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:34.721 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.711+0000 7f2d71d1e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d6c14e370 0x7f2d6c161090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:34.721 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.711+0000 7f2d71d1e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c164b80 con 0x7f2d6c063790 2020-11-20T12:13:34.722 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.711+0000 7f2d71d1e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c160720 con 0x7f2d6c063b70 2020-11-20T12:13:34.722 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.711+0000 7f2d71d1e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c0be640 con 0x7f2d6c14e370 2020-11-20T12:13:34.722 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.711+0000 7f2d7151d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d6c14e370 0x7f2d6c161090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:34.722 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.711+0000 7f2d7151d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d6c14e370 0x7f2d6c161090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49946/0 (socket says 172.21.15.192:49946) 2020-11-20T12:13:34.722 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.711+0000 7f2d7151d700 1 -- 172.21.15.192:0/3964029225 learned_addr learned my addr 172.21.15.192:0/3964029225 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:34.723 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.711+0000 7f2d70d1c700 1 --2- 172.21.15.192:0/3964029225 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d6c063790 0x7f2d6c164690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:34.723 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.711+0000 7f2d6bfff700 1 --2- 172.21.15.192:0/3964029225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d6c063b70 0x7f2d6c155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:34.723 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.711+0000 7f2d7151d700 1 -- 172.21.15.192:0/3964029225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d6c063b70 msgr2=0x7f2d6c155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:34.723 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.711+0000 7f2d7151d700 1 --2- 172.21.15.192:0/3964029225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d6c063b70 0x7f2d6c155e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:34.723 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.711+0000 7f2d7151d700 1 -- 172.21.15.192:0/3964029225 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d6c063790 msgr2=0x7f2d6c164690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:34.724 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.711+0000 7f2d7151d700 1 --2- 172.21.15.192:0/3964029225 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d6c063790 0x7f2d6c164690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:34.724 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.711+0000 7f2d7151d700 1 -- 172.21.15.192:0/3964029225 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6c156300 con 0x7f2d6c14e370 2020-11-20T12:13:34.724 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.712+0000 7f2d7151d700 1 --2- 172.21.15.192:0/3964029225 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d6c14e370 0x7f2d6c161090 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f2d6400ec20 tx=0x7f2d64008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:34.724 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.712+0000 7f2d68ff9700 1 -- 172.21.15.192:0/3964029225 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6400c760 con 0x7f2d6c14e370 2020-11-20T12:13:34.724 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.712+0000 7f2d68ff9700 1 -- 172.21.15.192:0/3964029225 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6400c8c0 con 0x7f2d6c14e370 2020-11-20T12:13:34.725 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.712+0000 7f2d68ff9700 1 -- 172.21.15.192:0/3964029225 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6400cc40 con 0x7f2d6c14e370 2020-11-20T12:13:34.725 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.712+0000 7f2d71d1e700 1 -- 172.21.15.192:0/3964029225 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d6c0be8a0 con 0x7f2d6c14e370 2020-11-20T12:13:34.725 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.712+0000 7f2d71d1e700 1 -- 172.21.15.192:0/3964029225 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d6c0bede0 con 0x7f2d6c14e370 2020-11-20T12:13:34.725 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.713+0000 7f2d71d1e700 1 -- 172.21.15.192:0/3964029225 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d6c0c5e50 con 0x7f2d6c14e370 2020-11-20T12:13:34.725 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.713+0000 7f2d68ff9700 1 -- 172.21.15.192:0/3964029225 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f2d64013430 con 0x7f2d6c14e370 2020-11-20T12:13:34.726 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.714+0000 7f2d68ff9700 1 --2- 172.21.15.192:0/3964029225 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f2d44080670 0x7f2d44082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:34.726 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.714+0000 7f2d70d1c700 1 --2- 172.21.15.192:0/3964029225 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f2d44080670 0x7f2d44082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:34.726 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.714+0000 7f2d68ff9700 1 -- 172.21.15.192:0/3964029225 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f2d640a2700 con 0x7f2d6c14e370 2020-11-20T12:13:34.726 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.714+0000 7f2d70d1c700 1 --2- 172.21.15.192:0/3964029225 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f2d44080670 0x7f2d44082b30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f2d600011e0 tx=0x7f2d60009040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:34.727 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.718+0000 7f2d68ff9700 1 -- 172.21.15.192:0/3964029225 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f2d640770b0 con 0x7f2d6c14e370 2020-11-20T12:13:34.864 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.860+0000 7f2d71d1e700 1 -- 172.21.15.192:0/3964029225 --> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d6c05c700 con 0x7f2d44080670 2020-11-20T12:13:34.864 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.861+0000 7f2d68ff9700 1 -- 172.21.15.192:0/3964029225 <== mgr.4106 v2:172.21.15.192:6800/22925 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2d6c05c700 con 0x7f2d44080670 2020-11-20T12:13:34.866 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.862+0000 7f2d71d1e700 1 -- 172.21.15.192:0/3964029225 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f2d44080670 msgr2=0x7f2d44082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:34.866 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.862+0000 7f2d71d1e700 1 --2- 172.21.15.192:0/3964029225 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f2d44080670 0x7f2d44082b30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f2d600011e0 tx=0x7f2d60009040).stop 2020-11-20T12:13:34.866 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.862+0000 7f2d71d1e700 1 -- 172.21.15.192:0/3964029225 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d6c14e370 msgr2=0x7f2d6c161090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:34.867 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.862+0000 7f2d71d1e700 1 --2- 172.21.15.192:0/3964029225 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d6c14e370 0x7f2d6c161090 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f2d6400ec20 tx=0x7f2d64008040).stop 2020-11-20T12:13:34.867 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.862+0000 7f2d71d1e700 1 -- 172.21.15.192:0/3964029225 shutdown_connections 2020-11-20T12:13:34.867 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.862+0000 7f2d71d1e700 1 --2- 172.21.15.192:0/3964029225 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f2d44080670 0x7f2d44082b30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:34.867 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.863+0000 7f2d71d1e700 1 --2- 172.21.15.192:0/3964029225 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d6c14e370 0x7f2d6c161090 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:34.867 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.863+0000 7f2d71d1e700 1 --2- 172.21.15.192:0/3964029225 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f2d6c063790 0x7f2d6c164690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:34.868 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.863+0000 7f2d71d1e700 1 --2- 172.21.15.192:0/3964029225 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d6c063b70 0x7f2d6c155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:34.868 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.863+0000 7f2d71d1e700 1 -- 172.21.15.192:0/3964029225 >> 172.21.15.192:0/3964029225 conn(0x7f2d6c060c40 msgr2=0x7f2d6c0c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:34.868 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.863+0000 7f2d71d1e700 1 -- 172.21.15.192:0/3964029225 shutdown_connections 2020-11-20T12:13:34.868 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.863+0000 7f2d71d1e700 1 -- 172.21.15.192:0/3964029225 wait complete. 2020-11-20T12:13:34.869 INFO:teuthology.orchestra.run.smithi192.stderr:instructed osd(s) 7 to deep-scrub 2020-11-20T12:13:34.877 INFO:tasks.ceph:Scrubbing osd.10 2020-11-20T12:13:34.878 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:13:34.991 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.988+0000 7f90574ce700 1 Processor -- start 2020-11-20T12:13:34.992 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.988+0000 7f90574ce700 1 -- start start 2020-11-20T12:13:34.993 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.989+0000 7f90574ce700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f90500bf540 0x7f9050151be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:34.993 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.989+0000 7f90574ce700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9050152680 con 0x7f90501537d0 2020-11-20T12:13:34.993 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.989+0000 7f90574ce700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9050064730 con 0x7f90500bf160 2020-11-20T12:13:34.994 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.989+0000 7f90574ce700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90501520d0 con 0x7f90500bf540 2020-11-20T12:13:34.994 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.989+0000 7f9054a69700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f90500bf540 0x7f9050151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:34.994 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.989+0000 7f905526a700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f90500bf160 0x7f9050062740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52618/0 (socket says 172.21.15.192:52618) 2020-11-20T12:13:34.994 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.989+0000 7f905526a700 1 -- 172.21.15.192:0/2571025746 learned_addr learned my addr 172.21.15.192:0/2571025746 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T12:13:34.994 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.990+0000 7f9054a69700 1 -- 172.21.15.192:0/2571025746 >> v1:172.21.15.192:6789/0 conn(0x7f90500bf160 legacy=0x7f9050062740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:34.995 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.990+0000 7f9054a69700 1 -- 172.21.15.192:0/2571025746 >> v1:172.21.15.146:6789/0 conn(0x7f90501537d0 legacy=0x7f9050153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:34.995 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.990+0000 7f9054a69700 1 -- 172.21.15.192:0/2571025746 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90501528b0 con 0x7f90500bf540 2020-11-20T12:13:34.995 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.990+0000 7f9054a69700 1 --2- 172.21.15.192:0/2571025746 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90500bf540 0x7f9050151be0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f904000ba30 tx=0x7f9040006e30).ready entity=mon.2 client_cookie=369a5ed8c7293109 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:34.995 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.990+0000 7f903ffff700 1 -- 172.21.15.192:0/2571025746 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90400097f0 con 0x7f90500bf540 2020-11-20T12:13:34.995 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.990+0000 7f903ffff700 1 -- 172.21.15.192:0/2571025746 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9040000e90 con 0x7f90500bf540 2020-11-20T12:13:34.996 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.990+0000 7f903ffff700 1 -- 172.21.15.192:0/2571025746 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9040009b60 con 0x7f90500bf540 2020-11-20T12:13:34.999 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.990+0000 7f90574ce700 1 -- 172.21.15.192:0/2571025746 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90500bf540 msgr2=0x7f9050151be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:34.999 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.990+0000 7f90574ce700 1 --2- 172.21.15.192:0/2571025746 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90500bf540 0x7f9050151be0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f904000ba30 tx=0x7f9040006e30).stop 2020-11-20T12:13:34.999 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.990+0000 7f90574ce700 1 -- 172.21.15.192:0/2571025746 shutdown_connections 2020-11-20T12:13:35.000 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.990+0000 7f90574ce700 1 --2- 172.21.15.192:0/2571025746 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90500bf540 0x7f9050151be0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:35.000 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.990+0000 7f90574ce700 1 -- 172.21.15.192:0/2571025746 >> 172.21.15.192:0/2571025746 conn(0x7f90500601b0 msgr2=0x7f90500605c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:35.000 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.990+0000 7f90574ce700 1 -- 172.21.15.192:0/2571025746 shutdown_connections 2020-11-20T12:13:35.000 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.990+0000 7f90574ce700 1 -- 172.21.15.192:0/2571025746 wait complete. 2020-11-20T12:13:35.000 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.991+0000 7f90574ce700 1 Processor -- start 2020-11-20T12:13:35.001 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.992+0000 7f90574ce700 1 -- start start 2020-11-20T12:13:35.001 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.992+0000 7f90574ce700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90500bf160 0x7f905014f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:35.001 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.992+0000 7f90574ce700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90500bf540 0x7f9050160700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:35.001 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.992+0000 7f90574ce700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90501537d0 0x7f90501564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:35.001 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.992+0000 7f90574ce700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90501569b0 con 0x7f90501537d0 2020-11-20T12:13:35.002 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.992+0000 7f90574ce700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9050110350 con 0x7f90500bf540 2020-11-20T12:13:35.002 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.992+0000 7f90574ce700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9050110540 con 0x7f90500bf160 2020-11-20T12:13:35.002 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.992+0000 7f905526a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90500bf160 0x7f905014f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:35.002 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.993+0000 7f905526a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90500bf160 0x7f905014f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49956/0 (socket says 172.21.15.192:49956) 2020-11-20T12:13:35.002 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.993+0000 7f905526a700 1 -- 172.21.15.192:0/4056206648 learned_addr learned my addr 172.21.15.192:0/4056206648 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:35.003 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.993+0000 7f9054a69700 1 --2- 172.21.15.192:0/4056206648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90500bf540 0x7f9050160700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:35.003 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.993+0000 7f9055a6b700 1 --2- 172.21.15.192:0/4056206648 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90501537d0 0x7f90501564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:35.003 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.993+0000 7f905526a700 1 -- 172.21.15.192:0/4056206648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90500bf540 msgr2=0x7f9050160700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:35.003 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.993+0000 7f905526a700 1 --2- 172.21.15.192:0/4056206648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90500bf540 0x7f9050160700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:35.003 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.993+0000 7f905526a700 1 -- 172.21.15.192:0/4056206648 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90501537d0 msgr2=0x7f90501564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:35.004 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.993+0000 7f905526a700 1 --2- 172.21.15.192:0/4056206648 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90501537d0 0x7f90501564c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:35.004 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.993+0000 7f905526a700 1 -- 172.21.15.192:0/4056206648 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90501107e0 con 0x7f90500bf160 2020-11-20T12:13:35.004 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.993+0000 7f9054a69700 1 --2- 172.21.15.192:0/4056206648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f90500bf540 0x7f9050160700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:13:35.004 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.993+0000 7f9055a6b700 1 --2- 172.21.15.192:0/4056206648 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f90501537d0 0x7f90501564c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:13:35.004 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.993+0000 7f905526a700 1 --2- 172.21.15.192:0/4056206648 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90500bf160 0x7f905014f840 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f904c00c660 tx=0x7f904c007ab0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:35.004 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.993+0000 7f903d7fa700 1 -- 172.21.15.192:0/4056206648 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c007320 con 0x7f90500bf160 2020-11-20T12:13:35.005 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.993+0000 7f903d7fa700 1 -- 172.21.15.192:0/4056206648 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904c005500 con 0x7f90500bf160 2020-11-20T12:13:35.005 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.993+0000 7f90574ce700 1 -- 172.21.15.192:0/4056206648 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9050110a80 con 0x7f90500bf160 2020-11-20T12:13:35.005 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.993+0000 7f903d7fa700 1 -- 172.21.15.192:0/4056206648 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c0058a0 con 0x7f90500bf160 2020-11-20T12:13:35.005 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.993+0000 7f90574ce700 1 -- 172.21.15.192:0/4056206648 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9050164060 con 0x7f90500bf160 2020-11-20T12:13:35.005 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.994+0000 7f90574ce700 1 -- 172.21.15.192:0/4056206648 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9050110c80 con 0x7f90500bf160 2020-11-20T12:13:35.006 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.995+0000 7f903d7fa700 1 -- 172.21.15.192:0/4056206648 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f904c010030 con 0x7f90500bf160 2020-11-20T12:13:35.006 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.995+0000 7f903d7fa700 1 --2- 172.21.15.192:0/4056206648 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f9028080670 0x7f9028082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:35.006 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.995+0000 7f903d7fa700 1 -- 172.21.15.192:0/4056206648 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f904c0a2fe0 con 0x7f90500bf160 2020-11-20T12:13:35.006 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.995+0000 7f9054a69700 1 --2- 172.21.15.192:0/4056206648 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f9028080670 0x7f9028082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:35.006 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.995+0000 7f903d7fa700 1 --2- 172.21.15.192:0/4056206648 >> [v2:172.21.15.146:6817/22859,v1:172.21.15.146:6819/22859] conn(0x7f90280893a0 0x7f902808b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:35.007 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.995+0000 7f903d7fa700 1 -- 172.21.15.192:0/4056206648 --> [v2:172.21.15.146:6817/22859,v1:172.21.15.146:6819/22859] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f902808be20 con 0x7f90280893a0 2020-11-20T12:13:35.007 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.995+0000 7f903d7fa700 1 -- 172.21.15.192:0/4056206648 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f904c0a3350 con 0x7f90500bf160 2020-11-20T12:13:35.007 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.995+0000 7f9054a69700 1 --2- 172.21.15.192:0/4056206648 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f9028080670 0x7f9028082b30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f9040006e70 tx=0x7f9040015000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:35.007 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.996+0000 7f9055a6b700 1 --2- 172.21.15.192:0/4056206648 >> [v2:172.21.15.146:6817/22859,v1:172.21.15.146:6819/22859] conn(0x7f90280893a0 0x7f902808b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:35.007 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.996+0000 7f9055a6b700 1 --2- 172.21.15.192:0/4056206648 >> [v2:172.21.15.146:6817/22859,v1:172.21.15.146:6819/22859] conn(0x7f90280893a0 0x7f902808b7c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:35.008 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:34.997+0000 7f903d7fa700 1 -- 172.21.15.192:0/4056206648 <== osd.10 v2:172.21.15.146:6817/22859 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f902808be20 con 0x7f90280893a0 2020-11-20T12:13:35.015 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.010+0000 7f90574ce700 1 -- 172.21.15.192:0/4056206648 --> [v2:172.21.15.146:6817/22859,v1:172.21.15.146:6819/22859] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f905014f650 con 0x7f90280893a0 2020-11-20T12:13:35.015 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.011+0000 7f903d7fa700 1 -- 172.21.15.192:0/4056206648 <== osd.10 v2:172.21.15.146:6817/22859 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f905014f650 con 0x7f90280893a0 2020-11-20T12:13:35.016 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.011+0000 7f90574ce700 1 -- 172.21.15.192:0/4056206648 >> [v2:172.21.15.146:6817/22859,v1:172.21.15.146:6819/22859] conn(0x7f90280893a0 msgr2=0x7f902808b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:35.016 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.011+0000 7f90574ce700 1 --2- 172.21.15.192:0/4056206648 >> [v2:172.21.15.146:6817/22859,v1:172.21.15.146:6819/22859] conn(0x7f90280893a0 0x7f902808b7c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:35.016 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.011+0000 7f90574ce700 1 -- 172.21.15.192:0/4056206648 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f9028080670 msgr2=0x7f9028082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:35.016 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.011+0000 7f90574ce700 1 --2- 172.21.15.192:0/4056206648 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f9028080670 0x7f9028082b30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f9040006e70 tx=0x7f9040015000).stop 2020-11-20T12:13:35.016 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.011+0000 7f90574ce700 1 -- 172.21.15.192:0/4056206648 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90500bf160 msgr2=0x7f905014f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:35.017 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.011+0000 7f90574ce700 1 --2- 172.21.15.192:0/4056206648 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90500bf160 0x7f905014f840 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f904c00c660 tx=0x7f904c007ab0).stop 2020-11-20T12:13:35.017 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.011+0000 7f9055a6b700 1 -- 172.21.15.192:0/4056206648 reap_dead start 2020-11-20T12:13:35.017 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.011+0000 7f90574ce700 1 -- 172.21.15.192:0/4056206648 shutdown_connections 2020-11-20T12:13:35.017 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.011+0000 7f90574ce700 1 -- 172.21.15.192:0/4056206648 >> 172.21.15.192:0/4056206648 conn(0x7f90500601b0 msgr2=0x7f905014dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:35.018 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.011+0000 7f90574ce700 1 -- 172.21.15.192:0/4056206648 shutdown_connections 2020-11-20T12:13:35.018 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.011+0000 7f90574ce700 1 -- 172.21.15.192:0/4056206648 wait complete. 2020-11-20T12:13:35.018 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2020-11-20T12:13:35.018 INFO:teuthology.orchestra.run.smithi192.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:13:35.018 INFO:teuthology.orchestra.run.smithi192.stdout:} 2020-11-20T12:13:35.026 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 10 2020-11-20T12:13:35.142 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.138+0000 7fd83169f700 1 Processor -- start 2020-11-20T12:13:35.142 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.138+0000 7fd83169f700 1 -- start start 2020-11-20T12:13:35.144 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.139+0000 7fd83169f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd82c1519d0 0x7fd82c060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:35.144 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.139+0000 7fd83169f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd82c0bd970 con 0x7fd82c0bce00 2020-11-20T12:13:35.145 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.139+0000 7fd83169f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd82c14dc50 con 0x7fd82c060370 2020-11-20T12:13:35.145 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.139+0000 7fd83169f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd82c14def0 con 0x7fd82c1519d0 2020-11-20T12:13:35.145 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.139+0000 7fd82affd700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fd82c060370 0x7fd82c0bbb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52634/0 (socket says 172.21.15.192:52634) 2020-11-20T12:13:35.145 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.139+0000 7fd82affd700 1 -- 172.21.15.192:0/409162936 learned_addr learned my addr 172.21.15.192:0/409162936 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T12:13:35.145 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.139+0000 7fd82a7fc700 1 --2- 172.21.15.192:0/409162936 >> v2:172.21.15.146:3300/0 conn(0x7fd82c1519d0 0x7fd82c060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:35.146 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.140+0000 7fd829ffb700 1 -- 172.21.15.192:0/409162936 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2601628266 0 0) 0x7fd82c14dc50 con 0x7fd82c060370 2020-11-20T12:13:35.146 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.140+0000 7fd829ffb700 1 -- 172.21.15.192:0/409162936 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd818003280 con 0x7fd82c060370 2020-11-20T12:13:35.146 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.140+0000 7fd82a7fc700 1 -- 172.21.15.192:0/409162936 >> v1:172.21.15.192:6789/0 conn(0x7fd82c060370 legacy=0x7fd82c0bbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:35.146 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.140+0000 7fd829ffb700 1 -- 172.21.15.192:0/409162936 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3556967185 0 0) 0x7fd82c0bd970 con 0x7fd82c0bce00 2020-11-20T12:13:35.146 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.140+0000 7fd82a7fc700 1 -- 172.21.15.192:0/409162936 >> v1:172.21.15.146:6789/0 conn(0x7fd82c0bce00 legacy=0x7fd82c0bd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:35.147 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.140+0000 7fd82a7fc700 1 -- 172.21.15.192:0/409162936 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82c14e190 con 0x7fd82c1519d0 2020-11-20T12:13:35.147 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.140+0000 7fd82a7fc700 1 --2- 172.21.15.192:0/409162936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd82c1519d0 0x7fd82c060750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fd82000ca90 tx=0x7fd820006ec0).ready entity=mon.1 client_cookie=e6bc7a652520cf02 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:35.147 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.140+0000 7fd829ffb700 1 -- 172.21.15.192:0/409162936 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd820014070 con 0x7fd82c1519d0 2020-11-20T12:13:35.147 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.140+0000 7fd829ffb700 1 -- 172.21.15.192:0/409162936 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd820000e90 con 0x7fd82c1519d0 2020-11-20T12:13:35.147 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.140+0000 7fd829ffb700 1 -- 172.21.15.192:0/409162936 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82000a8d0 con 0x7fd82c1519d0 2020-11-20T12:13:35.148 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.140+0000 7fd83169f700 1 -- 172.21.15.192:0/409162936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd82c1519d0 msgr2=0x7fd82c060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:35.148 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.140+0000 7fd83169f700 1 --2- 172.21.15.192:0/409162936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd82c1519d0 0x7fd82c060750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fd82000ca90 tx=0x7fd820006ec0).stop 2020-11-20T12:13:35.148 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.141+0000 7fd83169f700 1 -- 172.21.15.192:0/409162936 shutdown_connections 2020-11-20T12:13:35.148 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.141+0000 7fd83169f700 1 --2- 172.21.15.192:0/409162936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd82c1519d0 0x7fd82c060750 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:35.148 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.141+0000 7fd83169f700 1 -- 172.21.15.192:0/409162936 >> 172.21.15.192:0/409162936 conn(0x7fd82c062100 msgr2=0x7fd82c0c3590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:35.149 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.141+0000 7fd83169f700 1 -- 172.21.15.192:0/409162936 shutdown_connections 2020-11-20T12:13:35.149 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.141+0000 7fd83169f700 1 -- 172.21.15.192:0/409162936 wait complete. 2020-11-20T12:13:35.151 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.142+0000 7fd83169f700 1 Processor -- start 2020-11-20T12:13:35.152 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.142+0000 7fd83169f700 1 -- start start 2020-11-20T12:13:35.152 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.142+0000 7fd83169f700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd82c060370 0x7fd82c0c17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:35.152 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.142+0000 7fd83169f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd82c0bce00 0x7fd82c14bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:35.152 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.143+0000 7fd83169f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd82c1519d0 0x7fd82c147aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:35.152 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.143+0000 7fd83169f700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c160410 con 0x7fd82c060370 2020-11-20T12:13:35.153 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.143+0000 7fd83169f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c0abfd0 con 0x7fd82c0bce00 2020-11-20T12:13:35.153 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.143+0000 7fd83169f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c0ac270 con 0x7fd82c1519d0 2020-11-20T12:13:35.153 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.143+0000 7fd82b7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd82c1519d0 0x7fd82c147aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:35.153 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.143+0000 7fd82b7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd82c1519d0 0x7fd82c147aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49976/0 (socket says 172.21.15.192:49976) 2020-11-20T12:13:35.153 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.143+0000 7fd82b7fe700 1 -- 172.21.15.192:0/3238558352 learned_addr learned my addr 172.21.15.192:0/3238558352 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:35.154 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.143+0000 7fd82a7fc700 1 --2- 172.21.15.192:0/3238558352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd82c0bce00 0x7fd82c14bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:35.154 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.143+0000 7fd82affd700 1 --2- 172.21.15.192:0/3238558352 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd82c060370 0x7fd82c0c17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:35.154 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.143+0000 7fd82b7fe700 1 -- 172.21.15.192:0/3238558352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd82c0bce00 msgr2=0x7fd82c14bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:35.154 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.143+0000 7fd82b7fe700 1 --2- 172.21.15.192:0/3238558352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd82c0bce00 0x7fd82c14bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:35.154 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.143+0000 7fd82b7fe700 1 -- 172.21.15.192:0/3238558352 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd82c060370 msgr2=0x7fd82c0c17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:35.155 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.143+0000 7fd82b7fe700 1 --2- 172.21.15.192:0/3238558352 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd82c060370 0x7fd82c0c17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:35.155 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.143+0000 7fd82b7fe700 1 -- 172.21.15.192:0/3238558352 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82c147600 con 0x7fd82c1519d0 2020-11-20T12:13:35.155 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.143+0000 7fd82b7fe700 1 --2- 172.21.15.192:0/3238558352 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd82c1519d0 0x7fd82c147aa0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fd82400cae0 tx=0x7fd824007da0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:35.155 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.143+0000 7fd812ffd700 1 -- 172.21.15.192:0/3238558352 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82400a7f0 con 0x7fd82c1519d0 2020-11-20T12:13:35.155 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.143+0000 7fd812ffd700 1 -- 172.21.15.192:0/3238558352 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82400a970 con 0x7fd82c1519d0 2020-11-20T12:13:35.156 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.143+0000 7fd83169f700 1 -- 172.21.15.192:0/3238558352 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd82c160670 con 0x7fd82c1519d0 2020-11-20T12:13:35.156 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.143+0000 7fd812ffd700 1 -- 172.21.15.192:0/3238558352 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82400ad30 con 0x7fd82c1519d0 2020-11-20T12:13:35.156 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.143+0000 7fd83169f700 1 -- 172.21.15.192:0/3238558352 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd82c147250 con 0x7fd82c1519d0 2020-11-20T12:13:35.156 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.144+0000 7fd83169f700 1 -- 172.21.15.192:0/3238558352 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd82c0699a0 con 0x7fd82c1519d0 2020-11-20T12:13:35.156 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.145+0000 7fd812ffd700 1 -- 172.21.15.192:0/3238558352 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fd824019030 con 0x7fd82c1519d0 2020-11-20T12:13:35.157 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.145+0000 7fd812ffd700 1 --2- 172.21.15.192:0/3238558352 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fd808080670 0x7fd808082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:35.157 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.145+0000 7fd812ffd700 1 -- 172.21.15.192:0/3238558352 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fd8240a26b0 con 0x7fd82c1519d0 2020-11-20T12:13:35.157 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.146+0000 7fd82affd700 1 --2- 172.21.15.192:0/3238558352 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fd808080670 0x7fd808082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:35.157 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.146+0000 7fd82affd700 1 --2- 172.21.15.192:0/3238558352 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fd808080670 0x7fd808082b30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fd81c0011e0 tx=0x7fd81c0018d0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:35.158 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.149+0000 7fd812ffd700 1 -- 172.21.15.192:0/3238558352 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fd8240770c0 con 0x7fd82c1519d0 2020-11-20T12:13:35.295 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.291+0000 7fd83169f700 1 -- 172.21.15.192:0/3238558352 --> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "10", "target": ["mon-mgr", ""]}) v1 -- 0x7fd82c147790 con 0x7fd808080670 2020-11-20T12:13:35.295 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.292+0000 7fd812ffd700 1 -- 172.21.15.192:0/3238558352 <== mgr.4106 v2:172.21.15.192:6800/22925 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 10 to deep-scrub) v1 ==== 42+0+0 (secure 0 0 0) 0x7fd82c147790 con 0x7fd808080670 2020-11-20T12:13:35.297 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.293+0000 7fd83169f700 1 -- 172.21.15.192:0/3238558352 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fd808080670 msgr2=0x7fd808082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:35.297 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.293+0000 7fd83169f700 1 --2- 172.21.15.192:0/3238558352 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fd808080670 0x7fd808082b30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fd81c0011e0 tx=0x7fd81c0018d0).stop 2020-11-20T12:13:35.297 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.293+0000 7fd83169f700 1 -- 172.21.15.192:0/3238558352 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd82c1519d0 msgr2=0x7fd82c147aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:35.297 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.293+0000 7fd83169f700 1 --2- 172.21.15.192:0/3238558352 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd82c1519d0 0x7fd82c147aa0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fd82400cae0 tx=0x7fd824007da0).stop 2020-11-20T12:13:35.298 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.293+0000 7fd83169f700 1 -- 172.21.15.192:0/3238558352 shutdown_connections 2020-11-20T12:13:35.298 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.293+0000 7fd83169f700 1 --2- 172.21.15.192:0/3238558352 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fd808080670 0x7fd808082b30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:35.298 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.293+0000 7fd83169f700 1 --2- 172.21.15.192:0/3238558352 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd82c1519d0 0x7fd82c147aa0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:35.298 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.293+0000 7fd83169f700 1 --2- 172.21.15.192:0/3238558352 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd82c060370 0x7fd82c0c17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:35.298 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.293+0000 7fd83169f700 1 --2- 172.21.15.192:0/3238558352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd82c0bce00 0x7fd82c14bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:35.299 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.293+0000 7fd83169f700 1 -- 172.21.15.192:0/3238558352 >> 172.21.15.192:0/3238558352 conn(0x7fd82c062100 msgr2=0x7fd82c151280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:35.299 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.293+0000 7fd83169f700 1 -- 172.21.15.192:0/3238558352 shutdown_connections 2020-11-20T12:13:35.299 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.293+0000 7fd83169f700 1 -- 172.21.15.192:0/3238558352 wait complete. 2020-11-20T12:13:35.299 INFO:teuthology.orchestra.run.smithi192.stderr:instructed osd(s) 10 to deep-scrub 2020-11-20T12:13:35.308 INFO:tasks.ceph:Scrubbing osd.2 2020-11-20T12:13:35.308 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:13:35.421 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.418+0000 7fd6003f5700 1 Processor -- start 2020-11-20T12:13:35.422 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.418+0000 7fd6003f5700 1 -- start start 2020-11-20T12:13:35.429 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.419+0000 7fd6003f5700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fd5f8154920 0x7fd5f8060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:35.429 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.419+0000 7fd6003f5700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f8151e80 con 0x7fd5f8060370 2020-11-20T12:13:35.429 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.419+0000 7fd6003f5700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f8152120 con 0x7fd5f8064c40 2020-11-20T12:13:35.430 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.419+0000 7fd6003f5700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5f8064260 con 0x7fd5f8154920 2020-11-20T12:13:35.430 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.419+0000 7fd5fe992700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fd5f8064c40 0x7fd5f8151340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52652/0 (socket says 172.21.15.192:52652) 2020-11-20T12:13:35.430 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.419+0000 7fd5fe992700 1 -- 172.21.15.192:0/2494940931 learned_addr learned my addr 172.21.15.192:0/2494940931 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T12:13:35.430 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.419+0000 7fd5fd990700 1 --2- 172.21.15.192:0/2494940931 >> v2:172.21.15.87:3300/0 conn(0x7fd5f8154920 0x7fd5f8060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:35.430 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.419+0000 7fd5fd18f700 1 -- 172.21.15.192:0/2494940931 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2186728823 0 0) 0x7fd5f8152120 con 0x7fd5f8064c40 2020-11-20T12:13:35.431 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.419+0000 7fd5fd18f700 1 -- 172.21.15.192:0/2494940931 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5e0003280 con 0x7fd5f8064c40 2020-11-20T12:13:35.431 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.420+0000 7fd5fd990700 1 -- 172.21.15.192:0/2494940931 >> v1:172.21.15.192:6789/0 conn(0x7fd5f8064c40 legacy=0x7fd5f8151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:35.431 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.420+0000 7fd5fd18f700 1 -- 172.21.15.192:0/2494940931 <== mon.2 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2234851493 0 0) 0x7fd5e0003280 con 0x7fd5f8064c40 2020-11-20T12:13:35.431 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.420+0000 7fd5fd990700 1 -- 172.21.15.192:0/2494940931 >> v1:172.21.15.87:6789/0 conn(0x7fd5f8060370 legacy=0x7fd5f80c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:35.431 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.420+0000 7fd5fd990700 1 -- 172.21.15.192:0/2494940931 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f8064500 con 0x7fd5f8154920 2020-11-20T12:13:35.432 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.420+0000 7fd5fd990700 1 --2- 172.21.15.192:0/2494940931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5f8154920 0x7fd5f8060750 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fd5e8006fd0 tx=0x7fd5e8006e30).ready entity=mon.0 client_cookie=95e3665031192a10 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:35.432 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.420+0000 7fd5fd18f700 1 -- 172.21.15.192:0/2494940931 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e800bec0 con 0x7fd5f8154920 2020-11-20T12:13:35.432 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.420+0000 7fd5fd18f700 1 -- 172.21.15.192:0/2494940931 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e8000e90 con 0x7fd5f8154920 2020-11-20T12:13:35.432 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.420+0000 7fd5fd18f700 1 -- 172.21.15.192:0/2494940931 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e80098f0 con 0x7fd5f8154920 2020-11-20T12:13:35.432 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.420+0000 7fd6003f5700 1 -- 172.21.15.192:0/2494940931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5f8154920 msgr2=0x7fd5f8060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:35.433 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.420+0000 7fd6003f5700 1 --2- 172.21.15.192:0/2494940931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5f8154920 0x7fd5f8060750 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fd5e8006fd0 tx=0x7fd5e8006e30).stop 2020-11-20T12:13:35.433 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.421+0000 7fd6003f5700 1 -- 172.21.15.192:0/2494940931 shutdown_connections 2020-11-20T12:13:35.433 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.421+0000 7fd6003f5700 1 --2- 172.21.15.192:0/2494940931 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5f8154920 0x7fd5f8060750 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:35.433 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.421+0000 7fd6003f5700 1 -- 172.21.15.192:0/2494940931 >> 172.21.15.192:0/2494940931 conn(0x7fd5f8062100 msgr2=0x7fd5f80c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:35.434 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.421+0000 7fd6003f5700 1 -- 172.21.15.192:0/2494940931 shutdown_connections 2020-11-20T12:13:35.434 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.421+0000 7fd6003f5700 1 -- 172.21.15.192:0/2494940931 wait complete. 2020-11-20T12:13:35.434 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.422+0000 7fd6003f5700 1 Processor -- start 2020-11-20T12:13:35.434 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.422+0000 7fd6003f5700 1 -- start start 2020-11-20T12:13:35.435 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.422+0000 7fd6003f5700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5f8060370 0x7fd5f80b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:35.435 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.422+0000 7fd6003f5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5f8064c40 0x7fd5f8161200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:35.435 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.422+0000 7fd6003f5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5f8154920 0x7fd5f80c0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:35.435 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.422+0000 7fd6003f5700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f8152f00 con 0x7fd5f8060370 2020-11-20T12:13:35.435 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.422+0000 7fd6003f5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f81616f0 con 0x7fd5f8154920 2020-11-20T12:13:35.436 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.422+0000 7fd6003f5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f80b0bc0 con 0x7fd5f8064c40 2020-11-20T12:13:35.436 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.423+0000 7fd5fd990700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5f8064c40 0x7fd5f8161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:35.436 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.423+0000 7fd5fd990700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5f8064c40 0x7fd5f8161200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49988/0 (socket says 172.21.15.192:49988) 2020-11-20T12:13:35.436 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.423+0000 7fd5fd990700 1 -- 172.21.15.192:0/3777456386 learned_addr learned my addr 172.21.15.192:0/3777456386 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:35.437 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.423+0000 7fd5fe191700 1 --2- 172.21.15.192:0/3777456386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5f8060370 0x7fd5f80b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:35.437 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.423+0000 7fd5fe992700 1 --2- 172.21.15.192:0/3777456386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5f8154920 0x7fd5f80c0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:35.437 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.423+0000 7fd5fd990700 1 -- 172.21.15.192:0/3777456386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5f8154920 msgr2=0x7fd5f80c0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:35.437 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.423+0000 7fd5fd990700 1 --2- 172.21.15.192:0/3777456386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5f8154920 0x7fd5f80c0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:35.438 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.423+0000 7fd5fd990700 1 -- 172.21.15.192:0/3777456386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5f8060370 msgr2=0x7fd5f80b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:35.438 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.423+0000 7fd5fd990700 1 --2- 172.21.15.192:0/3777456386 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fd5f8060370 0x7fd5f80b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:35.438 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.423+0000 7fd5fd990700 1 -- 172.21.15.192:0/3777456386 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f80b0920 con 0x7fd5f8064c40 2020-11-20T12:13:35.438 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.423+0000 7fd5fd990700 1 --2- 172.21.15.192:0/3777456386 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5f8064c40 0x7fd5f8161200 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fd5e8006bc0 tx=0x7fd5e8015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:35.438 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.423+0000 7fd5e67fc700 1 -- 172.21.15.192:0/3777456386 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8011a70 con 0x7fd5f8064c40 2020-11-20T12:13:35.439 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.423+0000 7fd5e67fc700 1 -- 172.21.15.192:0/3777456386 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e8011bd0 con 0x7fd5f8064c40 2020-11-20T12:13:35.439 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.423+0000 7fd5e67fc700 1 -- 172.21.15.192:0/3777456386 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e801e460 con 0x7fd5f8064c40 2020-11-20T12:13:35.439 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.423+0000 7fd6003f5700 1 -- 172.21.15.192:0/3777456386 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f80bf7b0 con 0x7fd5f8064c40 2020-11-20T12:13:35.439 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.423+0000 7fd6003f5700 1 -- 172.21.15.192:0/3777456386 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f80bfcf0 con 0x7fd5f8064c40 2020-11-20T12:13:35.439 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.424+0000 7fd6003f5700 1 -- 172.21.15.192:0/3777456386 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd5f80699a0 con 0x7fd5f8064c40 2020-11-20T12:13:35.440 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.425+0000 7fd5e67fc700 1 -- 172.21.15.192:0/3777456386 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fd5e802e070 con 0x7fd5f8064c40 2020-11-20T12:13:35.440 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.425+0000 7fd5e67fc700 1 --2- 172.21.15.192:0/3777456386 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fd5d0080670 0x7fd5d0082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:35.440 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.425+0000 7fd5e67fc700 1 -- 172.21.15.192:0/3777456386 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fd5e80a4710 con 0x7fd5f8064c40 2020-11-20T12:13:35.440 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.425+0000 7fd5fe191700 1 --2- 172.21.15.192:0/3777456386 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fd5d0080670 0x7fd5d0082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:35.440 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.425+0000 7fd5e67fc700 1 --2- 172.21.15.192:0/3777456386 >> [v2:172.21.15.87:6815/23326,v1:172.21.15.87:6817/23326] conn(0x7fd5d00893a0 0x7fd5d008b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:35.441 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.425+0000 7fd5e67fc700 1 -- 172.21.15.192:0/3777456386 --> [v2:172.21.15.87:6815/23326,v1:172.21.15.87:6817/23326] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd5d008be20 con 0x7fd5d00893a0 2020-11-20T12:13:35.441 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.425+0000 7fd5e67fc700 1 -- 172.21.15.192:0/3777456386 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5e80a4a80 con 0x7fd5f8064c40 2020-11-20T12:13:35.441 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.426+0000 7fd5fe191700 1 --2- 172.21.15.192:0/3777456386 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fd5d0080670 0x7fd5d0082b30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fd5f4000f60 tx=0x7fd5f4007bb0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:35.441 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.426+0000 7fd5fe992700 1 --2- 172.21.15.192:0/3777456386 >> [v2:172.21.15.87:6815/23326,v1:172.21.15.87:6817/23326] conn(0x7fd5d00893a0 0x7fd5d008b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:35.442 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.426+0000 7fd5fe992700 1 --2- 172.21.15.192:0/3777456386 >> [v2:172.21.15.87:6815/23326,v1:172.21.15.87:6817/23326] conn(0x7fd5d00893a0 0x7fd5d008b7c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:35.442 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.427+0000 7fd5e67fc700 1 -- 172.21.15.192:0/3777456386 <== osd.2 v2:172.21.15.87:6815/23326 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7fd5d008be20 con 0x7fd5d00893a0 2020-11-20T12:13:35.443 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.440+0000 7fd6003f5700 1 -- 172.21.15.192:0/3777456386 --> [v2:172.21.15.87:6815/23326,v1:172.21.15.87:6817/23326] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd5f805ca80 con 0x7fd5d00893a0 2020-11-20T12:13:35.443 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.440+0000 7fd5e67fc700 1 -- 172.21.15.192:0/3777456386 <== osd.2 v2:172.21.15.87:6815/23326 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd5f805ca80 con 0x7fd5d00893a0 2020-11-20T12:13:35.444 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2020-11-20T12:13:35.444 INFO:teuthology.orchestra.run.smithi192.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:13:35.444 INFO:teuthology.orchestra.run.smithi192.stdout:} 2020-11-20T12:13:35.446 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.440+0000 7fd6003f5700 1 -- 172.21.15.192:0/3777456386 >> [v2:172.21.15.87:6815/23326,v1:172.21.15.87:6817/23326] conn(0x7fd5d00893a0 msgr2=0x7fd5d008b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:35.446 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.440+0000 7fd6003f5700 1 --2- 172.21.15.192:0/3777456386 >> [v2:172.21.15.87:6815/23326,v1:172.21.15.87:6817/23326] conn(0x7fd5d00893a0 0x7fd5d008b7c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:35.446 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.441+0000 7fd6003f5700 1 -- 172.21.15.192:0/3777456386 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fd5d0080670 msgr2=0x7fd5d0082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:35.446 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.441+0000 7fd6003f5700 1 --2- 172.21.15.192:0/3777456386 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fd5d0080670 0x7fd5d0082b30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fd5f4000f60 tx=0x7fd5f4007bb0).stop 2020-11-20T12:13:35.446 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.441+0000 7fd6003f5700 1 -- 172.21.15.192:0/3777456386 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5f8064c40 msgr2=0x7fd5f8161200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:35.447 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.441+0000 7fd6003f5700 1 --2- 172.21.15.192:0/3777456386 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5f8064c40 0x7fd5f8161200 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fd5e8006bc0 tx=0x7fd5e8015000).stop 2020-11-20T12:13:35.447 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.441+0000 7fd5fe992700 1 -- 172.21.15.192:0/3777456386 reap_dead start 2020-11-20T12:13:35.447 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.441+0000 7fd6003f5700 1 -- 172.21.15.192:0/3777456386 shutdown_connections 2020-11-20T12:13:35.447 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.441+0000 7fd6003f5700 1 -- 172.21.15.192:0/3777456386 >> 172.21.15.192:0/3777456386 conn(0x7fd5f8062100 msgr2=0x7fd5f8154e00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:35.448 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.441+0000 7fd6003f5700 1 -- 172.21.15.192:0/3777456386 shutdown_connections 2020-11-20T12:13:35.448 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.441+0000 7fd6003f5700 1 -- 172.21.15.192:0/3777456386 wait complete. 2020-11-20T12:13:35.455 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2020-11-20T12:13:35.567 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.564+0000 7f3282ccb700 1 Processor -- start 2020-11-20T12:13:35.568 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.564+0000 7f3282ccb700 1 -- start start 2020-11-20T12:13:35.573 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.565+0000 7f3282ccb700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f327c151be0 0x7f327c153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:35.574 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.565+0000 7f3282ccb700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f327c152680 con 0x7f327c0bf540 2020-11-20T12:13:35.574 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.565+0000 7f3282ccb700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f327c064730 con 0x7f327c0bf160 2020-11-20T12:13:35.574 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.565+0000 7f3282ccb700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f327c1528b0 con 0x7f327c151be0 2020-11-20T12:13:35.574 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.565+0000 7f3280a67700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f327c0bf160 0x7f327c062740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52664/0 (socket says 172.21.15.192:52664) 2020-11-20T12:13:35.575 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.565+0000 7f3280a67700 1 -- 172.21.15.192:0/1762981825 learned_addr learned my addr 172.21.15.192:0/1762981825 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T12:13:35.575 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.565+0000 7f3281268700 1 --2- 172.21.15.192:0/1762981825 >> v2:172.21.15.146:3300/0 conn(0x7f327c151be0 0x7f327c153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:35.575 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.565+0000 7f327b7fe700 1 -- 172.21.15.192:0/1762981825 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3155576283 0 0) 0x7f327c064730 con 0x7f327c0bf160 2020-11-20T12:13:35.575 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.565+0000 7f327b7fe700 1 -- 172.21.15.192:0/1762981825 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3260003280 con 0x7f327c0bf160 2020-11-20T12:13:35.575 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.565+0000 7f3281268700 1 -- 172.21.15.192:0/1762981825 >> v1:172.21.15.192:6789/0 conn(0x7f327c0bf160 legacy=0x7f327c062740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:35.576 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.565+0000 7f327b7fe700 1 -- 172.21.15.192:0/1762981825 <== mon.2 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2468562908 0 0) 0x7f3260003280 con 0x7f327c0bf160 2020-11-20T12:13:35.576 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.565+0000 7f3281268700 1 -- 172.21.15.192:0/1762981825 >> v1:172.21.15.146:6789/0 conn(0x7f327c0bf540 legacy=0x7f327c1537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:35.576 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.565+0000 7f3281268700 1 -- 172.21.15.192:0/1762981825 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327c152b50 con 0x7f327c151be0 2020-11-20T12:13:35.576 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.566+0000 7f3281268700 1 --2- 172.21.15.192:0/1762981825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f327c151be0 0x7f327c153ee0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f3274009cc0 tx=0x7f3274009220).ready entity=mon.1 client_cookie=57352e2cec01c00f server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:35.577 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.566+0000 7f327b7fe700 1 -- 172.21.15.192:0/1762981825 <== mon.1 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32700016a0 con 0x7f327c151be0 2020-11-20T12:13:35.577 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.566+0000 7f327b7fe700 1 -- 172.21.15.192:0/1762981825 <== mon.1 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327400b700 con 0x7f327c151be0 2020-11-20T12:13:35.577 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.566+0000 7f327b7fe700 1 -- 172.21.15.192:0/1762981825 <== mon.1 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327400ba80 con 0x7f327c151be0 2020-11-20T12:13:35.577 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.566+0000 7f3282ccb700 1 -- 172.21.15.192:0/1762981825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f327c151be0 msgr2=0x7f327c153ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:35.578 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.566+0000 7f3282ccb700 1 --2- 172.21.15.192:0/1762981825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f327c151be0 0x7f327c153ee0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f3274009cc0 tx=0x7f3274009220).stop 2020-11-20T12:13:35.578 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.566+0000 7f3282ccb700 1 -- 172.21.15.192:0/1762981825 shutdown_connections 2020-11-20T12:13:35.578 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.566+0000 7f3282ccb700 1 --2- 172.21.15.192:0/1762981825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f327c151be0 0x7f327c153ee0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:35.578 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.566+0000 7f3282ccb700 1 -- 172.21.15.192:0/1762981825 >> 172.21.15.192:0/1762981825 conn(0x7f327c0601b0 msgr2=0x7f327c0605c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:35.579 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.566+0000 7f3282ccb700 1 -- 172.21.15.192:0/1762981825 shutdown_connections 2020-11-20T12:13:35.579 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.566+0000 7f3282ccb700 1 -- 172.21.15.192:0/1762981825 wait complete. 2020-11-20T12:13:35.579 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.567+0000 7f3282ccb700 1 Processor -- start 2020-11-20T12:13:35.580 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.568+0000 7f3282ccb700 1 -- start start 2020-11-20T12:13:35.580 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.568+0000 7f3282ccb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f327c0bf160 0x7f327c151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:35.580 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.568+0000 7f3282ccb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f327c0bf540 0x7f327c14fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:35.580 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.568+0000 7f3282ccb700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f327c151be0 0x7f327c14ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:35.580 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.568+0000 7f3282ccb700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327c14d960 con 0x7f327c151be0 2020-11-20T12:13:35.581 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.568+0000 7f3282ccb700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327c160dc0 con 0x7f327c0bf160 2020-11-20T12:13:35.581 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.568+0000 7f3282ccb700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327c161060 con 0x7f327c0bf540 2020-11-20T12:13:35.581 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.568+0000 7f327bfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f327c0bf540 0x7f327c14fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:35.581 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.568+0000 7f327bfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f327c0bf540 0x7f327c14fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50004/0 (socket says 172.21.15.192:50004) 2020-11-20T12:13:35.582 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.568+0000 7f327bfff700 1 -- 172.21.15.192:0/1221988750 learned_addr learned my addr 172.21.15.192:0/1221988750 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:35.582 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.569+0000 7f3280a67700 1 --2- 172.21.15.192:0/1221988750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f327c0bf160 0x7f327c151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:35.582 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.569+0000 7f3281268700 1 --2- 172.21.15.192:0/1221988750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f327c151be0 0x7f327c14ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:35.582 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.569+0000 7f327bfff700 1 -- 172.21.15.192:0/1221988750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f327c0bf160 msgr2=0x7f327c151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:35.583 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.569+0000 7f327bfff700 1 --2- 172.21.15.192:0/1221988750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f327c0bf160 0x7f327c151560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:35.583 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.569+0000 7f327bfff700 1 -- 172.21.15.192:0/1221988750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f327c151be0 msgr2=0x7f327c14ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:35.583 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.569+0000 7f327bfff700 1 --2- 172.21.15.192:0/1221988750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f327c151be0 0x7f327c14ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:35.583 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.569+0000 7f327bfff700 1 -- 172.21.15.192:0/1221988750 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327c112e30 con 0x7f327c0bf540 2020-11-20T12:13:35.584 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.569+0000 7f3281268700 1 --2- 172.21.15.192:0/1221988750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f327c151be0 0x7f327c14ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:13:35.584 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.569+0000 7f327bfff700 1 --2- 172.21.15.192:0/1221988750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f327c0bf540 0x7f327c14fae0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f326800c880 tx=0x7f3268007c40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:35.584 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.569+0000 7f3278ff9700 1 -- 172.21.15.192:0/1221988750 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326800a590 con 0x7f327c0bf540 2020-11-20T12:13:35.584 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.569+0000 7f3278ff9700 1 -- 172.21.15.192:0/1221988750 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f326800a6f0 con 0x7f327c0bf540 2020-11-20T12:13:35.585 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.569+0000 7f3278ff9700 1 -- 172.21.15.192:0/1221988750 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326800aa90 con 0x7f327c0bf540 2020-11-20T12:13:35.585 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.569+0000 7f3282ccb700 1 -- 172.21.15.192:0/1221988750 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f327c1130d0 con 0x7f327c0bf540 2020-11-20T12:13:35.585 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.569+0000 7f3282ccb700 1 -- 172.21.15.192:0/1221988750 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f327c112b20 con 0x7f327c0bf540 2020-11-20T12:13:35.585 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.570+0000 7f3282ccb700 1 -- 172.21.15.192:0/1221988750 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f327c05ca80 con 0x7f327c0bf540 2020-11-20T12:13:35.586 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.571+0000 7f3278ff9700 1 -- 172.21.15.192:0/1221988750 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f3268010070 con 0x7f327c0bf540 2020-11-20T12:13:35.586 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.571+0000 7f3278ff9700 1 --2- 172.21.15.192:0/1221988750 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3254080670 0x7f3254082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:35.587 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.571+0000 7f3278ff9700 1 -- 172.21.15.192:0/1221988750 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f32680a2e80 con 0x7f327c0bf540 2020-11-20T12:13:35.587 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.571+0000 7f3280a67700 1 --2- 172.21.15.192:0/1221988750 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3254080670 0x7f3254082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:35.587 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.572+0000 7f3280a67700 1 --2- 172.21.15.192:0/1221988750 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3254080670 0x7f3254082b30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f3270000ef0 tx=0x7f32700013b0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:35.587 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.574+0000 7f3278ff9700 1 -- 172.21.15.192:0/1221988750 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f3268077890 con 0x7f327c0bf540 2020-11-20T12:13:35.719 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.716+0000 7f3282ccb700 1 -- 172.21.15.192:0/1221988750 --> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f327c05c2e0 con 0x7f3254080670 2020-11-20T12:13:35.720 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.716+0000 7f3278ff9700 1 -- 172.21.15.192:0/1221988750 <== mgr.4106 v2:172.21.15.192:6800/22925 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f327c05c2e0 con 0x7f3254080670 2020-11-20T12:13:35.721 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.718+0000 7f3282ccb700 1 -- 172.21.15.192:0/1221988750 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3254080670 msgr2=0x7f3254082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:35.722 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.718+0000 7f3282ccb700 1 --2- 172.21.15.192:0/1221988750 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3254080670 0x7f3254082b30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f3270000ef0 tx=0x7f32700013b0).stop 2020-11-20T12:13:35.722 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.718+0000 7f3282ccb700 1 -- 172.21.15.192:0/1221988750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f327c0bf540 msgr2=0x7f327c14fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:35.722 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.718+0000 7f3282ccb700 1 --2- 172.21.15.192:0/1221988750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f327c0bf540 0x7f327c14fae0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f326800c880 tx=0x7f3268007c40).stop 2020-11-20T12:13:35.722 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.718+0000 7f3282ccb700 1 -- 172.21.15.192:0/1221988750 shutdown_connections 2020-11-20T12:13:35.722 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.718+0000 7f3282ccb700 1 --2- 172.21.15.192:0/1221988750 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3254080670 0x7f3254082b30 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:35.723 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.718+0000 7f3282ccb700 1 --2- 172.21.15.192:0/1221988750 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f327c151be0 0x7f327c14ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:35.723 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.718+0000 7f3282ccb700 1 --2- 172.21.15.192:0/1221988750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f327c0bf160 0x7f327c151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:35.723 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.718+0000 7f3282ccb700 1 --2- 172.21.15.192:0/1221988750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f327c0bf540 0x7f327c14fae0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:35.723 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.718+0000 7f3282ccb700 1 -- 172.21.15.192:0/1221988750 >> 172.21.15.192:0/1221988750 conn(0x7f327c0601b0 msgr2=0x7f327c060590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:35.723 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.718+0000 7f3282ccb700 1 -- 172.21.15.192:0/1221988750 shutdown_connections 2020-11-20T12:13:35.724 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.718+0000 7f3282ccb700 1 -- 172.21.15.192:0/1221988750 wait complete. 2020-11-20T12:13:35.724 INFO:teuthology.orchestra.run.smithi192.stderr:instructed osd(s) 2 to deep-scrub 2020-11-20T12:13:35.733 INFO:tasks.ceph:Scrubbing osd.5 2020-11-20T12:13:35.733 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:13:35.846 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.843+0000 7f38cda30700 1 Processor -- start 2020-11-20T12:13:35.847 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.843+0000 7f38cda30700 1 -- start start 2020-11-20T12:13:35.850 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.844+0000 7f38cda30700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f38c8060370 0x7f38c8060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:35.850 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.844+0000 7f38cda30700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f38c8064c40 0x7f38c8151340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:35.850 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.844+0000 7f38cda30700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c8151e80 con 0x7f38c8154920 2020-11-20T12:13:35.851 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.844+0000 7f38cda30700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c8152120 con 0x7f38c8064c40 2020-11-20T12:13:35.851 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.844+0000 7f38cda30700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c8064260 con 0x7f38c8060370 2020-11-20T12:13:35.851 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.844+0000 7f38c67fc700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f38c8154920 0x7f38c80c2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52678/0 (socket says 172.21.15.192:52678) 2020-11-20T12:13:35.851 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.844+0000 7f38c67fc700 1 -- 172.21.15.192:0/1767590381 learned_addr learned my addr 172.21.15.192:0/1767590381 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T12:13:35.851 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.844+0000 7f38c6ffd700 1 --2- 172.21.15.192:0/1767590381 >> v2:172.21.15.146:3300/0 conn(0x7f38c8060370 0x7f38c8060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:35.852 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.844+0000 7f38c77fe700 1 --2- 172.21.15.192:0/1767590381 >> v2:172.21.15.87:3300/0 conn(0x7f38c8064c40 0x7f38c8151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:35.852 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.844+0000 7f38c5ffb700 1 -- 172.21.15.192:0/1767590381 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3225945625 0 0) 0x7f38c8151e80 con 0x7f38c8154920 2020-11-20T12:13:35.852 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.844+0000 7f38c5ffb700 1 -- 172.21.15.192:0/1767590381 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38b4003280 con 0x7f38c8154920 2020-11-20T12:13:35.852 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.844+0000 7f38c5ffb700 1 -- 172.21.15.192:0/1767590381 <== mon.2 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2714074661 0 0) 0x7f38b4003280 con 0x7f38c8154920 2020-11-20T12:13:35.853 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.845+0000 7f38c5ffb700 1 -- 172.21.15.192:0/1767590381 >> v2:172.21.15.146:3300/0 conn(0x7f38c8060370 msgr2=0x7f38c8060750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:35.853 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.845+0000 7f38c5ffb700 1 --2- 172.21.15.192:0/1767590381 >> v2:172.21.15.146:3300/0 conn(0x7f38c8060370 0x7f38c8060750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:35.853 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.845+0000 7f38c5ffb700 1 -- 172.21.15.192:0/1767590381 >> v2:172.21.15.87:3300/0 conn(0x7f38c8064c40 msgr2=0x7f38c8151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:35.853 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.845+0000 7f38c5ffb700 1 --2- 172.21.15.192:0/1767590381 >> v2:172.21.15.87:3300/0 conn(0x7f38c8064c40 0x7f38c8151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:35.853 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.845+0000 7f38c5ffb700 1 -- 172.21.15.192:0/1767590381 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c8064500 con 0x7f38c8154920 2020-11-20T12:13:35.854 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.845+0000 7f38c5ffb700 1 -- 172.21.15.192:0/1767590381 <== mon.2 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3985397220 0 0) 0x7f38b8001520 con 0x7f38c8154920 2020-11-20T12:13:35.854 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.845+0000 7f38c5ffb700 1 -- 172.21.15.192:0/1767590381 >> v1:172.21.15.192:6789/0 conn(0x7f38c8154920 legacy=0x7f38c80c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:35.854 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.845+0000 7f38c5ffb700 1 --2- 172.21.15.192:0/1767590381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38b40037c0 0x7f38b4003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:35.854 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.845+0000 7f38c5ffb700 1 --2- 172.21.15.192:0/1767590381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38b4004520 0x7f38b40049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:35.854 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.845+0000 7f38c5ffb700 1 --2- 172.21.15.192:0/1767590381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38b4004e90 0x7f38b400b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:35.855 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.845+0000 7f38c5ffb700 1 -- 172.21.15.192:0/1767590381 --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c8152120 con 0x7f38b4004e90 2020-11-20T12:13:35.855 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.845+0000 7f38c5ffb700 1 -- 172.21.15.192:0/1767590381 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c8064260 con 0x7f38b4004520 2020-11-20T12:13:35.855 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.845+0000 7f38c5ffb700 1 -- 172.21.15.192:0/1767590381 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b4005340 con 0x7f38b40037c0 2020-11-20T12:13:35.855 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.845+0000 7f38c6ffd700 1 --2- 172.21.15.192:0/1767590381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38b40037c0 0x7f38b4003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:35.856 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.845+0000 7f38c77fe700 1 --2- 172.21.15.192:0/1767590381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38b4004e90 0x7f38b400b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:35.856 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.845+0000 7f38c67fc700 1 --2- 172.21.15.192:0/1767590381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38b4004520 0x7f38b40049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:35.856 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.845+0000 7f38c6ffd700 1 -- 172.21.15.192:0/1767590381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38b4004520 msgr2=0x7f38b40049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:35.856 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.845+0000 7f38c6ffd700 1 --2- 172.21.15.192:0/1767590381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38b4004520 0x7f38b40049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:35.856 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.845+0000 7f38c6ffd700 1 -- 172.21.15.192:0/1767590381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38b4004e90 msgr2=0x7f38b400b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:35.857 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.845+0000 7f38c6ffd700 1 --2- 172.21.15.192:0/1767590381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38b4004e90 0x7f38b400b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:35.857 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.845+0000 7f38c6ffd700 1 -- 172.21.15.192:0/1767590381 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b4003280 con 0x7f38b40037c0 2020-11-20T12:13:35.857 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.845+0000 7f38c77fe700 1 --2- 172.21.15.192:0/1767590381 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38b4004e90 0x7f38b400b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:13:35.857 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.845+0000 7f38c77fe700 1 -- 172.21.15.192:0/1767590381 reap_dead start 2020-11-20T12:13:35.857 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.845+0000 7f38c6ffd700 1 --2- 172.21.15.192:0/1767590381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38b40037c0 0x7f38b4003be0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f38bc00bc70 tx=0x7f38bc006e30).ready entity=mon.2 client_cookie=7d2024411dd9c807 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:35.858 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.845+0000 7f38c5ffb700 1 -- 172.21.15.192:0/1767590381 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc00be80 con 0x7f38b40037c0 2020-11-20T12:13:35.858 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.845+0000 7f38c5ffb700 1 -- 172.21.15.192:0/1767590381 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38bc00b350 con 0x7f38b40037c0 2020-11-20T12:13:35.858 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.845+0000 7f38c5ffb700 1 -- 172.21.15.192:0/1767590381 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc00ee70 con 0x7f38b40037c0 2020-11-20T12:13:36.001 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.846+0000 7f38cda30700 1 -- 172.21.15.192:0/1767590381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38b40037c0 msgr2=0x7f38b4003be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:36.002 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.846+0000 7f38cda30700 1 --2- 172.21.15.192:0/1767590381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38b40037c0 0x7f38b4003be0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f38bc00bc70 tx=0x7f38bc006e30).stop 2020-11-20T12:13:36.002 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.846+0000 7f38cda30700 1 -- 172.21.15.192:0/1767590381 shutdown_connections 2020-11-20T12:13:36.003 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.846+0000 7f38cda30700 1 --2- 172.21.15.192:0/1767590381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38b40037c0 0x7f38b4003be0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:36.003 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.846+0000 7f38cda30700 1 -- 172.21.15.192:0/1767590381 >> 172.21.15.192:0/1767590381 conn(0x7f38c8062100 msgr2=0x7f38c80c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:36.004 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.846+0000 7f38cda30700 1 -- 172.21.15.192:0/1767590381 shutdown_connections 2020-11-20T12:13:36.004 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.846+0000 7f38cda30700 1 -- 172.21.15.192:0/1767590381 wait complete. 2020-11-20T12:13:36.004 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.847+0000 7f38cda30700 1 Processor -- start 2020-11-20T12:13:36.005 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.847+0000 7f38cda30700 1 -- start start 2020-11-20T12:13:36.014 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.848+0000 7f38cda30700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38b40037c0 0x7f38c80c0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:36.015 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.848+0000 7f38cda30700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38c81559e0 0x7f38c80c2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:36.015 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.848+0000 7f38cda30700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38c80c3130 0x7f38c8156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:36.015 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.848+0000 7f38cda30700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c814ca30 con 0x7f38c80c3130 2020-11-20T12:13:36.016 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.848+0000 7f38cda30700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c80b1920 con 0x7f38c81559e0 2020-11-20T12:13:36.016 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.848+0000 7f38cda30700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c80b13e0 con 0x7f38b40037c0 2020-11-20T12:13:36.016 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.848+0000 7f38c6ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38b40037c0 0x7f38c80c0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:36.017 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.848+0000 7f38c6ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38b40037c0 0x7f38c80c0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50020/0 (socket says 172.21.15.192:50020) 2020-11-20T12:13:36.017 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.848+0000 7f38c6ffd700 1 -- 172.21.15.192:0/3792181313 learned_addr learned my addr 172.21.15.192:0/3792181313 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:36.018 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.848+0000 7f38c77fe700 1 --2- 172.21.15.192:0/3792181313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38c80c3130 0x7f38c8156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:36.018 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.848+0000 7f38c67fc700 1 --2- 172.21.15.192:0/3792181313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38c81559e0 0x7f38c80c2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:36.018 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.848+0000 7f38c6ffd700 1 -- 172.21.15.192:0/3792181313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38c81559e0 msgr2=0x7f38c80c2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:36.019 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.848+0000 7f38c6ffd700 1 --2- 172.21.15.192:0/3792181313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38c81559e0 0x7f38c80c2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:36.019 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.848+0000 7f38c6ffd700 1 -- 172.21.15.192:0/3792181313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38c80c3130 msgr2=0x7f38c8156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:36.020 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.848+0000 7f38c6ffd700 1 --2- 172.21.15.192:0/3792181313 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f38c80c3130 0x7f38c8156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:36.020 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.848+0000 7f38c6ffd700 1 -- 172.21.15.192:0/3792181313 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c80b1680 con 0x7f38b40037c0 2020-11-20T12:13:36.021 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.848+0000 7f38c6ffd700 1 --2- 172.21.15.192:0/3792181313 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38b40037c0 0x7f38c80c0110 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f38b40054d0 tx=0x7f38bc019000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:36.021 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.848+0000 7f38aeffd700 1 -- 172.21.15.192:0/3792181313 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc012ea0 con 0x7f38b40037c0 2020-11-20T12:13:36.022 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.848+0000 7f38aeffd700 1 -- 172.21.15.192:0/3792181313 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38bc000e90 con 0x7f38b40037c0 2020-11-20T12:13:36.022 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.848+0000 7f38cda30700 1 -- 172.21.15.192:0/3792181313 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c8156040 con 0x7f38b40037c0 2020-11-20T12:13:36.023 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.848+0000 7f38aeffd700 1 -- 172.21.15.192:0/3792181313 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc01d410 con 0x7f38b40037c0 2020-11-20T12:13:36.023 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.848+0000 7f38cda30700 1 -- 172.21.15.192:0/3792181313 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c80c3bc0 con 0x7f38b40037c0 2020-11-20T12:13:36.024 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.849+0000 7f38cda30700 1 -- 172.21.15.192:0/3792181313 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f38c80699a0 con 0x7f38b40037c0 2020-11-20T12:13:36.024 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.850+0000 7f38aeffd700 1 -- 172.21.15.192:0/3792181313 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f38bc01d840 con 0x7f38b40037c0 2020-11-20T12:13:36.025 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.850+0000 7f38aeffd700 1 --2- 172.21.15.192:0/3792181313 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f38a40806a0 0x7f38a4082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:36.025 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.850+0000 7f38aeffd700 1 -- 172.21.15.192:0/3792181313 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f38bc0a4ce0 con 0x7f38b40037c0 2020-11-20T12:13:36.026 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.850+0000 7f38c67fc700 1 --2- 172.21.15.192:0/3792181313 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f38a40806a0 0x7f38a4082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:36.027 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.851+0000 7f38aeffd700 1 --2- 172.21.15.192:0/3792181313 >> [v2:172.21.15.87:6800/23316,v1:172.21.15.87:6801/23316] conn(0x7f38a40893d0 0x7f38a408b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:36.027 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.851+0000 7f38aeffd700 1 -- 172.21.15.192:0/3792181313 --> [v2:172.21.15.87:6800/23316,v1:172.21.15.87:6801/23316] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f38a408be50 con 0x7f38a40893d0 2020-11-20T12:13:36.027 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.851+0000 7f38aeffd700 1 -- 172.21.15.192:0/3792181313 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38bc0a5070 con 0x7f38b40037c0 2020-11-20T12:13:36.028 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.851+0000 7f38c67fc700 1 --2- 172.21.15.192:0/3792181313 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f38a40806a0 0x7f38a4082b60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f38b8000e10 tx=0x7f38b8009040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:36.028 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.851+0000 7f38c77fe700 1 --2- 172.21.15.192:0/3792181313 >> [v2:172.21.15.87:6800/23316,v1:172.21.15.87:6801/23316] conn(0x7f38a40893d0 0x7f38a408b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:36.029 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.851+0000 7f38c77fe700 1 --2- 172.21.15.192:0/3792181313 >> [v2:172.21.15.87:6800/23316,v1:172.21.15.87:6801/23316] conn(0x7f38a40893d0 0x7f38a408b7f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:36.029 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.852+0000 7f38aeffd700 1 -- 172.21.15.192:0/3792181313 <== osd.5 v2:172.21.15.87:6800/23316 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f38a408be50 con 0x7f38a40893d0 2020-11-20T12:13:36.030 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.865+0000 7f38cda30700 1 -- 172.21.15.192:0/3792181313 --> [v2:172.21.15.87:6800/23316,v1:172.21.15.87:6801/23316] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f38c81564a0 con 0x7f38a40893d0 2020-11-20T12:13:36.030 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.865+0000 7f38aeffd700 1 -- 172.21.15.192:0/3792181313 <== osd.5 v2:172.21.15.87:6800/23316 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f38c81564a0 con 0x7f38a40893d0 2020-11-20T12:13:36.031 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.866+0000 7f38cda30700 1 -- 172.21.15.192:0/3792181313 >> [v2:172.21.15.87:6800/23316,v1:172.21.15.87:6801/23316] conn(0x7f38a40893d0 msgr2=0x7f38a408b7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:36.031 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.866+0000 7f38cda30700 1 --2- 172.21.15.192:0/3792181313 >> [v2:172.21.15.87:6800/23316,v1:172.21.15.87:6801/23316] conn(0x7f38a40893d0 0x7f38a408b7f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:36.031 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.866+0000 7f38cda30700 1 -- 172.21.15.192:0/3792181313 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f38a40806a0 msgr2=0x7f38a4082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:36.032 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.866+0000 7f38cda30700 1 --2- 172.21.15.192:0/3792181313 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f38a40806a0 0x7f38a4082b60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f38b8000e10 tx=0x7f38b8009040).stop 2020-11-20T12:13:36.032 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.866+0000 7f38cda30700 1 -- 172.21.15.192:0/3792181313 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38b40037c0 msgr2=0x7f38c80c0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:36.033 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.866+0000 7f38cda30700 1 --2- 172.21.15.192:0/3792181313 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38b40037c0 0x7f38c80c0110 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f38b40054d0 tx=0x7f38bc019000).stop 2020-11-20T12:13:36.035 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.866+0000 7f38c77fe700 1 -- 172.21.15.192:0/3792181313 reap_dead start 2020-11-20T12:13:36.035 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.866+0000 7f38cda30700 1 -- 172.21.15.192:0/3792181313 shutdown_connections 2020-11-20T12:13:36.035 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.866+0000 7f38cda30700 1 -- 172.21.15.192:0/3792181313 >> 172.21.15.192:0/3792181313 conn(0x7f38c8062100 msgr2=0x7f38c80c78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:36.035 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.866+0000 7f38cda30700 1 -- 172.21.15.192:0/3792181313 shutdown_connections 2020-11-20T12:13:36.036 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:35.866+0000 7f38cda30700 1 -- 172.21.15.192:0/3792181313 wait complete. 2020-11-20T12:13:36.036 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2020-11-20T12:13:36.036 INFO:teuthology.orchestra.run.smithi192.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:13:36.037 INFO:teuthology.orchestra.run.smithi192.stdout:} 2020-11-20T12:13:36.037 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2020-11-20T12:13:36.152 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.148+0000 7f008aef9700 1 Processor -- start 2020-11-20T12:13:36.152 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.148+0000 7f008aef9700 1 -- start start 2020-11-20T12:13:36.161 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.149+0000 7f008aef9700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f0084060370 0x7f0084060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:36.162 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.149+0000 7f008aef9700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0084151e80 con 0x7f0084154920 2020-11-20T12:13:36.162 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.149+0000 7f008aef9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0084152120 con 0x7f0084064c40 2020-11-20T12:13:36.163 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.149+0000 7f008aef9700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0084064260 con 0x7f0084060370 2020-11-20T12:13:36.163 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.149+0000 7f0089496700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0084064c40 0x7f0084151340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.192:33758/0 (socket says 172.21.15.192:33758) 2020-11-20T12:13:36.163 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.149+0000 7f0089496700 1 -- 172.21.15.192:0/3163521594 learned_addr learned my addr 172.21.15.192:0/3163521594 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T12:13:36.164 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.150+0000 7f0088c95700 1 --2- 172.21.15.192:0/3163521594 >> v2:172.21.15.87:3300/0 conn(0x7f0084060370 0x7f0084060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:36.164 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.150+0000 7f00837fe700 1 -- 172.21.15.192:0/3163521594 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2870397064 0 0) 0x7f0084152120 con 0x7f0084064c40 2020-11-20T12:13:36.165 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.150+0000 7f00837fe700 1 -- 172.21.15.192:0/3163521594 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0068003280 con 0x7f0084064c40 2020-11-20T12:13:36.165 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.150+0000 7f00837fe700 1 -- 172.21.15.192:0/3163521594 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3107934946 0 0) 0x7f0084151e80 con 0x7f0084154920 2020-11-20T12:13:36.165 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.150+0000 7f00837fe700 1 -- 172.21.15.192:0/3163521594 --> v1:172.21.15.87:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0084152120 con 0x7f0084154920 2020-11-20T12:13:36.166 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.150+0000 7f0088c95700 1 -- 172.21.15.192:0/3163521594 >> v1:172.21.15.146:6789/0 conn(0x7f0084064c40 legacy=0x7f0084151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:36.166 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.150+0000 7f00837fe700 1 -- 172.21.15.192:0/3163521594 <== mon.1 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1414025890 0 0) 0x7f0068003280 con 0x7f0084064c40 2020-11-20T12:13:36.166 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.150+0000 7f0088c95700 1 -- 172.21.15.192:0/3163521594 >> v1:172.21.15.87:6789/0 conn(0x7f0084154920 legacy=0x7f00840c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:36.167 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.150+0000 7f0088c95700 1 -- 172.21.15.192:0/3163521594 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0084064500 con 0x7f0084060370 2020-11-20T12:13:36.167 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.150+0000 7f0088c95700 1 --2- 172.21.15.192:0/3163521594 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0084060370 0x7f0084060750 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f0078006fd0 tx=0x7f0078006e30).ready entity=mon.0 client_cookie=46207e93e62b5faa server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:36.168 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.150+0000 7f00837fe700 1 -- 172.21.15.192:0/3163521594 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007c0018a0 con 0x7f0084060370 2020-11-20T12:13:36.168 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.150+0000 7f00837fe700 1 -- 172.21.15.192:0/3163521594 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0078000e90 con 0x7f0084060370 2020-11-20T12:13:36.168 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.150+0000 7f00837fe700 1 -- 172.21.15.192:0/3163521594 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0078011610 con 0x7f0084060370 2020-11-20T12:13:36.169 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.151+0000 7f008aef9700 1 -- 172.21.15.192:0/3163521594 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0084060370 msgr2=0x7f0084060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:36.169 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.151+0000 7f008aef9700 1 --2- 172.21.15.192:0/3163521594 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0084060370 0x7f0084060750 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f0078006fd0 tx=0x7f0078006e30).stop 2020-11-20T12:13:36.169 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.151+0000 7f008aef9700 1 -- 172.21.15.192:0/3163521594 shutdown_connections 2020-11-20T12:13:36.170 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.151+0000 7f008aef9700 1 --2- 172.21.15.192:0/3163521594 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0084060370 0x7f0084060750 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:36.170 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.151+0000 7f008aef9700 1 -- 172.21.15.192:0/3163521594 >> 172.21.15.192:0/3163521594 conn(0x7f0084062100 msgr2=0x7f00840c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:36.170 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.151+0000 7f008aef9700 1 -- 172.21.15.192:0/3163521594 shutdown_connections 2020-11-20T12:13:36.170 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.151+0000 7f008aef9700 1 -- 172.21.15.192:0/3163521594 wait complete. 2020-11-20T12:13:36.171 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.152+0000 7f008aef9700 1 Processor -- start 2020-11-20T12:13:36.171 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.152+0000 7f008aef9700 1 -- start start 2020-11-20T12:13:36.172 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.153+0000 7f008aef9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0084060370 0x7f00840c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:36.172 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.153+0000 7f008aef9700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0084064c40 0x7f0084067810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:36.172 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.153+0000 7f008aef9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0084154920 0x7f00840c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:36.173 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.153+0000 7f008aef9700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0084160870 con 0x7f0084064c40 2020-11-20T12:13:36.173 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.153+0000 7f008aef9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00840c6190 con 0x7f0084154920 2020-11-20T12:13:36.173 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.153+0000 7f008aef9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0084160ad0 con 0x7f0084060370 2020-11-20T12:13:36.174 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.153+0000 7f0088c95700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0084060370 0x7f00840c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:36.174 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.153+0000 7f0088c95700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0084060370 0x7f00840c63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50036/0 (socket says 172.21.15.192:50036) 2020-11-20T12:13:36.174 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.153+0000 7f0088c95700 1 -- 172.21.15.192:0/1609027619 learned_addr learned my addr 172.21.15.192:0/1609027619 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:36.175 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.153+0000 7f0089496700 1 --2- 172.21.15.192:0/1609027619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0084154920 0x7f00840c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:36.175 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.153+0000 7f0083fff700 1 --2- 172.21.15.192:0/1609027619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0084064c40 0x7f0084067810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:36.175 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.153+0000 7f0088c95700 1 -- 172.21.15.192:0/1609027619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0084154920 msgr2=0x7f00840c6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:36.175 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.153+0000 7f0088c95700 1 --2- 172.21.15.192:0/1609027619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0084154920 0x7f00840c6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:36.176 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.153+0000 7f0088c95700 1 -- 172.21.15.192:0/1609027619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0084064c40 msgr2=0x7f0084067810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:36.176 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.153+0000 7f0088c95700 1 --2- 172.21.15.192:0/1609027619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0084064c40 0x7f0084067810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:36.176 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.153+0000 7f0088c95700 1 -- 172.21.15.192:0/1609027619 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0084160d70 con 0x7f0084060370 2020-11-20T12:13:36.177 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.153+0000 7f0083fff700 1 --2- 172.21.15.192:0/1609027619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0084064c40 0x7f0084067810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:13:36.177 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.154+0000 7f0088c95700 1 --2- 172.21.15.192:0/1609027619 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0084060370 0x7f00840c63d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f0084066280 tx=0x7f0078015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:36.177 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.154+0000 7f0080ff9700 1 -- 172.21.15.192:0/1609027619 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0078010b10 con 0x7f0084060370 2020-11-20T12:13:36.178 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.154+0000 7f0080ff9700 1 -- 172.21.15.192:0/1609027619 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0078010c70 con 0x7f0084060370 2020-11-20T12:13:36.178 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.154+0000 7f008aef9700 1 -- 172.21.15.192:0/1609027619 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0084161010 con 0x7f0084060370 2020-11-20T12:13:36.178 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.154+0000 7f0080ff9700 1 -- 172.21.15.192:0/1609027619 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007801d3c0 con 0x7f0084060370 2020-11-20T12:13:36.179 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.154+0000 7f008aef9700 1 -- 172.21.15.192:0/1609027619 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0084161550 con 0x7f0084060370 2020-11-20T12:13:36.179 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.155+0000 7f008aef9700 1 -- 172.21.15.192:0/1609027619 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0084152ba0 con 0x7f0084060370 2020-11-20T12:13:36.179 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.155+0000 7f0080ff9700 1 -- 172.21.15.192:0/1609027619 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f0078026030 con 0x7f0084060370 2020-11-20T12:13:36.180 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.156+0000 7f0080ff9700 1 --2- 172.21.15.192:0/1609027619 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f005c080670 0x7f005c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:36.180 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.156+0000 7f0083fff700 1 --2- 172.21.15.192:0/1609027619 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f005c080670 0x7f005c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:36.180 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.156+0000 7f0080ff9700 1 -- 172.21.15.192:0/1609027619 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f00780a3eb0 con 0x7f0084060370 2020-11-20T12:13:36.180 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.156+0000 7f0083fff700 1 --2- 172.21.15.192:0/1609027619 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f005c080670 0x7f005c082b30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f0084155860 tx=0x7f0070009040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:36.181 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.159+0000 7f0080ff9700 1 -- 172.21.15.192:0/1609027619 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f00780788c0 con 0x7f0084060370 2020-11-20T12:13:36.304 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.300+0000 7f008aef9700 1 -- 172.21.15.192:0/1609027619 --> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f0084161750 con 0x7f005c080670 2020-11-20T12:13:36.304 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.301+0000 7f0080ff9700 1 -- 172.21.15.192:0/1609027619 <== mgr.4106 v2:172.21.15.192:6800/22925 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0070015440 con 0x7f005c080670 2020-11-20T12:13:36.306 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.302+0000 7f008aef9700 1 -- 172.21.15.192:0/1609027619 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f005c080670 msgr2=0x7f005c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:36.306 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.302+0000 7f008aef9700 1 --2- 172.21.15.192:0/1609027619 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f005c080670 0x7f005c082b30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f0084155860 tx=0x7f0070009040).stop 2020-11-20T12:13:36.306 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.302+0000 7f008aef9700 1 -- 172.21.15.192:0/1609027619 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0084060370 msgr2=0x7f00840c63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:36.306 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.302+0000 7f008aef9700 1 --2- 172.21.15.192:0/1609027619 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0084060370 0x7f00840c63d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f0084066280 tx=0x7f0078015000).stop 2020-11-20T12:13:36.307 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.302+0000 7f008aef9700 1 -- 172.21.15.192:0/1609027619 shutdown_connections 2020-11-20T12:13:36.307 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.302+0000 7f008aef9700 1 --2- 172.21.15.192:0/1609027619 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f005c080670 0x7f005c082b30 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:36.307 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.302+0000 7f008aef9700 1 --2- 172.21.15.192:0/1609027619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0084154920 0x7f00840c6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:36.307 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.302+0000 7f008aef9700 1 --2- 172.21.15.192:0/1609027619 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0084060370 0x7f00840c63d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:36.308 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.302+0000 7f008aef9700 1 --2- 172.21.15.192:0/1609027619 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f0084064c40 0x7f0084067810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:36.308 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.302+0000 7f008aef9700 1 -- 172.21.15.192:0/1609027619 >> 172.21.15.192:0/1609027619 conn(0x7f0084062100 msgr2=0x7f0084153b60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:36.308 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.302+0000 7f008aef9700 1 -- 172.21.15.192:0/1609027619 shutdown_connections 2020-11-20T12:13:36.308 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.302+0000 7f008aef9700 1 -- 172.21.15.192:0/1609027619 wait complete. 2020-11-20T12:13:36.309 INFO:teuthology.orchestra.run.smithi192.stderr:instructed osd(s) 5 to deep-scrub 2020-11-20T12:13:36.317 INFO:tasks.ceph:Scrubbing osd.8 2020-11-20T12:13:36.318 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:13:36.486 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.482+0000 7f5df1f94700 1 Processor -- start 2020-11-20T12:13:36.486 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.483+0000 7f5df1f94700 1 -- start start 2020-11-20T12:13:36.490 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.483+0000 7f5df1f94700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5dec060750 0x7f5dec064c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:36.490 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.483+0000 7f5df1f94700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dec065130 con 0x7f5dec060370 2020-11-20T12:13:36.490 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.483+0000 7f5df1f94700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dec151e80 con 0x7f5dec154920 2020-11-20T12:13:36.491 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.483+0000 7f5df1f94700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dec152120 con 0x7f5dec060750 2020-11-20T12:13:36.491 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.484+0000 7f5debfff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f5dec060750 0x7f5dec064c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:36.492 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.484+0000 7f5deaffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f5dec154920 0x7f5dec151340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.192:33770/0 (socket says 172.21.15.192:33770) 2020-11-20T12:13:36.492 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.484+0000 7f5deaffd700 1 -- 172.21.15.192:0/4187454832 learned_addr learned my addr 172.21.15.192:0/4187454832 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T12:13:36.492 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.484+0000 7f5dea7fc700 1 -- 172.21.15.192:0/4187454832 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4256509605 0 0) 0x7f5dec151e80 con 0x7f5dec154920 2020-11-20T12:13:36.493 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.484+0000 7f5dea7fc700 1 -- 172.21.15.192:0/4187454832 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dd8003280 con 0x7f5dec154920 2020-11-20T12:13:36.493 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.484+0000 7f5debfff700 1 -- 172.21.15.192:0/4187454832 >> v1:172.21.15.146:6789/0 conn(0x7f5dec154920 legacy=0x7f5dec151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:36.494 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.484+0000 7f5debfff700 1 -- 172.21.15.192:0/4187454832 >> v1:172.21.15.87:6789/0 conn(0x7f5dec060370 legacy=0x7f5dec0c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:36.494 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.484+0000 7f5dea7fc700 1 -- 172.21.15.192:0/4187454832 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3779545598 0 0) 0x7f5dec065130 con 0x7f5dec060370 2020-11-20T12:13:36.494 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.484+0000 7f5debfff700 1 -- 172.21.15.192:0/4187454832 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dec064260 con 0x7f5dec060750 2020-11-20T12:13:36.495 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.484+0000 7f5debfff700 1 --2- 172.21.15.192:0/4187454832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5dec060750 0x7f5dec064c40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f5de4009ce0 tx=0x7f5de4009220).ready entity=mon.0 client_cookie=a9393186aee2df26 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:36.496 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.484+0000 7f5dea7fc700 1 -- 172.21.15.192:0/4187454832 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de400bad0 con 0x7f5dec060750 2020-11-20T12:13:36.497 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.484+0000 7f5dea7fc700 1 -- 172.21.15.192:0/4187454832 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de400bc30 con 0x7f5dec060750 2020-11-20T12:13:36.498 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.484+0000 7f5dea7fc700 1 -- 172.21.15.192:0/4187454832 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de4011400 con 0x7f5dec060750 2020-11-20T12:13:36.499 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.485+0000 7f5df1f94700 1 -- 172.21.15.192:0/4187454832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5dec060750 msgr2=0x7f5dec064c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:36.499 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.485+0000 7f5df1f94700 1 --2- 172.21.15.192:0/4187454832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5dec060750 0x7f5dec064c40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f5de4009ce0 tx=0x7f5de4009220).stop 2020-11-20T12:13:36.500 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.485+0000 7f5df1f94700 1 -- 172.21.15.192:0/4187454832 shutdown_connections 2020-11-20T12:13:36.503 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.485+0000 7f5df1f94700 1 --2- 172.21.15.192:0/4187454832 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5dec060750 0x7f5dec064c40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:36.505 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.485+0000 7f5df1f94700 1 -- 172.21.15.192:0/4187454832 >> 172.21.15.192:0/4187454832 conn(0x7f5dec062100 msgr2=0x7f5dec0c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:36.505 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.485+0000 7f5df1f94700 1 -- 172.21.15.192:0/4187454832 shutdown_connections 2020-11-20T12:13:36.505 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.485+0000 7f5df1f94700 1 -- 172.21.15.192:0/4187454832 wait complete. 2020-11-20T12:13:36.505 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.486+0000 7f5df1f94700 1 Processor -- start 2020-11-20T12:13:36.506 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.486+0000 7f5df1f94700 1 -- start start 2020-11-20T12:13:36.509 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.487+0000 7f5df1f94700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5dec060370 0x7f5dec148e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:36.509 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.487+0000 7f5df1f94700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dec060750 0x7f5dec14b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:36.509 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.487+0000 7f5df1f94700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5dec154920 0x7f5dec14bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:36.510 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.487+0000 7f5df1f94700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec161410 con 0x7f5dec060370 2020-11-20T12:13:36.510 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.487+0000 7f5df1f94700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec160480 con 0x7f5dec154920 2020-11-20T12:13:36.510 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.487+0000 7f5df1f94700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec1606f0 con 0x7f5dec060750 2020-11-20T12:13:36.510 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.487+0000 7f5deaffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dec060750 0x7f5dec14b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:36.511 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.487+0000 7f5deaffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dec060750 0x7f5dec14b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50052/0 (socket says 172.21.15.192:50052) 2020-11-20T12:13:36.511 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.487+0000 7f5deaffd700 1 -- 172.21.15.192:0/427027536 learned_addr learned my addr 172.21.15.192:0/427027536 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:36.511 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.487+0000 7f5debfff700 1 --2- 172.21.15.192:0/427027536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5dec154920 0x7f5dec14bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:36.511 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.487+0000 7f5deb7fe700 1 --2- 172.21.15.192:0/427027536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5dec060370 0x7f5dec148e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:36.513 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.487+0000 7f5deaffd700 1 -- 172.21.15.192:0/427027536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5dec154920 msgr2=0x7f5dec14bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:36.513 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.487+0000 7f5deaffd700 1 --2- 172.21.15.192:0/427027536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5dec154920 0x7f5dec14bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:36.514 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.487+0000 7f5deaffd700 1 -- 172.21.15.192:0/427027536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5dec060370 msgr2=0x7f5dec148e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:36.514 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.487+0000 7f5deaffd700 1 --2- 172.21.15.192:0/427027536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5dec060370 0x7f5dec148e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:36.514 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.487+0000 7f5deaffd700 1 -- 172.21.15.192:0/427027536 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dec160990 con 0x7f5dec060750 2020-11-20T12:13:36.515 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.487+0000 7f5deb7fe700 1 --2- 172.21.15.192:0/427027536 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f5dec060370 0x7f5dec148e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:13:36.515 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.488+0000 7f5deaffd700 1 --2- 172.21.15.192:0/427027536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dec060750 0x7f5dec14b8e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f5de000c7a0 tx=0x7f5de0007b10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:36.516 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.488+0000 7f5dcb7fe700 1 -- 172.21.15.192:0/427027536 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de0007320 con 0x7f5dec060750 2020-11-20T12:13:36.516 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.488+0000 7f5dcb7fe700 1 -- 172.21.15.192:0/427027536 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de0007480 con 0x7f5dec060750 2020-11-20T12:13:36.516 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.488+0000 7f5df1f94700 1 -- 172.21.15.192:0/427027536 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dec160c30 con 0x7f5dec060750 2020-11-20T12:13:36.517 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.488+0000 7f5dcb7fe700 1 -- 172.21.15.192:0/427027536 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de0005840 con 0x7f5dec060750 2020-11-20T12:13:36.517 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.488+0000 7f5df1f94700 1 -- 172.21.15.192:0/427027536 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dec161170 con 0x7f5dec060750 2020-11-20T12:13:36.517 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.489+0000 7f5df1f94700 1 -- 172.21.15.192:0/427027536 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5dec0699a0 con 0x7f5dec060750 2020-11-20T12:13:36.517 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.489+0000 7f5dcb7fe700 1 -- 172.21.15.192:0/427027536 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f5de0010030 con 0x7f5dec060750 2020-11-20T12:13:36.518 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.490+0000 7f5dcb7fe700 1 --2- 172.21.15.192:0/427027536 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f5dc4080670 0x7f5dc4082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:36.518 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.490+0000 7f5dcb7fe700 1 -- 172.21.15.192:0/427027536 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f5de00a2700 con 0x7f5dec060750 2020-11-20T12:13:36.518 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.490+0000 7f5deb7fe700 1 --2- 172.21.15.192:0/427027536 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f5dc4080670 0x7f5dc4082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:36.518 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.490+0000 7f5dcb7fe700 1 --2- 172.21.15.192:0/427027536 >> [v2:172.21.15.87:6824/23333,v1:172.21.15.87:6825/23333] conn(0x7f5dc40893a0 0x7f5dc408b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:36.518 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.490+0000 7f5dcb7fe700 1 -- 172.21.15.192:0/427027536 --> [v2:172.21.15.87:6824/23333,v1:172.21.15.87:6825/23333] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5dc408be20 con 0x7f5dc40893a0 2020-11-20T12:13:36.519 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.490+0000 7f5dcb7fe700 1 -- 172.21.15.192:0/427027536 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5de00a4c60 con 0x7f5dec060750 2020-11-20T12:13:36.519 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.490+0000 7f5deb7fe700 1 --2- 172.21.15.192:0/427027536 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f5dc4080670 0x7f5dc4082b30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f5ddc007fd0 tx=0x7f5ddc009040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:36.519 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.490+0000 7f5debfff700 1 --2- 172.21.15.192:0/427027536 >> [v2:172.21.15.87:6824/23333,v1:172.21.15.87:6825/23333] conn(0x7f5dc40893a0 0x7f5dc408b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:36.519 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.491+0000 7f5debfff700 1 --2- 172.21.15.192:0/427027536 >> [v2:172.21.15.87:6824/23333,v1:172.21.15.87:6825/23333] conn(0x7f5dc40893a0 0x7f5dc408b7c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:36.520 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.492+0000 7f5dcb7fe700 1 -- 172.21.15.192:0/427027536 <== osd.8 v2:172.21.15.87:6824/23333 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f5dc408be20 con 0x7f5dc40893a0 2020-11-20T12:13:36.520 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.504+0000 7f5df1f94700 1 -- 172.21.15.192:0/427027536 --> [v2:172.21.15.87:6824/23333,v1:172.21.15.87:6825/23333] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5dec05ca80 con 0x7f5dc40893a0 2020-11-20T12:13:36.520 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.505+0000 7f5dcb7fe700 1 -- 172.21.15.192:0/427027536 <== osd.8 v2:172.21.15.87:6824/23333 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f5dec05ca80 con 0x7f5dc40893a0 2020-11-20T12:13:36.522 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2020-11-20T12:13:36.523 INFO:teuthology.orchestra.run.smithi192.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:13:36.523 INFO:teuthology.orchestra.run.smithi192.stdout:} 2020-11-20T12:13:36.523 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.505+0000 7f5df1f94700 1 -- 172.21.15.192:0/427027536 >> [v2:172.21.15.87:6824/23333,v1:172.21.15.87:6825/23333] conn(0x7f5dc40893a0 msgr2=0x7f5dc408b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:36.524 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.505+0000 7f5df1f94700 1 --2- 172.21.15.192:0/427027536 >> [v2:172.21.15.87:6824/23333,v1:172.21.15.87:6825/23333] conn(0x7f5dc40893a0 0x7f5dc408b7c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:36.524 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.505+0000 7f5df1f94700 1 -- 172.21.15.192:0/427027536 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f5dc4080670 msgr2=0x7f5dc4082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:36.524 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.505+0000 7f5df1f94700 1 --2- 172.21.15.192:0/427027536 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f5dc4080670 0x7f5dc4082b30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f5ddc007fd0 tx=0x7f5ddc009040).stop 2020-11-20T12:13:36.525 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.505+0000 7f5df1f94700 1 -- 172.21.15.192:0/427027536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dec060750 msgr2=0x7f5dec14b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:36.525 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.505+0000 7f5df1f94700 1 --2- 172.21.15.192:0/427027536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dec060750 0x7f5dec14b8e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f5de000c7a0 tx=0x7f5de0007b10).stop 2020-11-20T12:13:36.525 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.505+0000 7f5debfff700 1 -- 172.21.15.192:0/427027536 reap_dead start 2020-11-20T12:13:36.525 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.505+0000 7f5df1f94700 1 -- 172.21.15.192:0/427027536 shutdown_connections 2020-11-20T12:13:36.526 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.505+0000 7f5df1f94700 1 -- 172.21.15.192:0/427027536 >> 172.21.15.192:0/427027536 conn(0x7f5dec062100 msgr2=0x7f5dec154d90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:36.526 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.505+0000 7f5df1f94700 1 -- 172.21.15.192:0/427027536 shutdown_connections 2020-11-20T12:13:36.526 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.505+0000 7f5df1f94700 1 -- 172.21.15.192:0/427027536 wait complete. 2020-11-20T12:13:36.527 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 8 2020-11-20T12:13:36.640 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.637+0000 7f82665b0700 1 Processor -- start 2020-11-20T12:13:36.641 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.637+0000 7f82665b0700 1 -- start start 2020-11-20T12:13:36.642 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.638+0000 7f82665b0700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8260060370 0x7f8260060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:36.643 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.638+0000 7f82665b0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8260154920 0x7f8260064c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:36.643 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.638+0000 7f82665b0700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8260065130 con 0x7f82600c2340 2020-11-20T12:13:36.643 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.638+0000 7f82665b0700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8260151e80 con 0x7f8260060370 2020-11-20T12:13:36.643 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.638+0000 7f82665b0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8260152120 con 0x7f8260154920 2020-11-20T12:13:36.643 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.639+0000 7f825ffff700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f8260060370 0x7f8260060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:36.644 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.639+0000 7f8264b4d700 1 --1- >> v1:172.21.15.87:6789/0 conn(0x7f82600c2340 0x7f8260151340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.87:6789/0 says I am v1:172.21.15.192:39446/0 (socket says 172.21.15.192:39446) 2020-11-20T12:13:36.644 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.639+0000 7f8264b4d700 1 -- 172.21.15.192:0/2063955947 learned_addr learned my addr 172.21.15.192:0/2063955947 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T12:13:36.644 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.639+0000 7f825f7fe700 1 --2- 172.21.15.192:0/2063955947 >> v2:172.21.15.146:3300/0 conn(0x7f8260154920 0x7f8260064c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:36.644 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.639+0000 7f825ffff700 1 -- 172.21.15.192:0/2063955947 >> v2:172.21.15.146:3300/0 conn(0x7f8260154920 msgr2=0x7f8260064c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:36.644 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.639+0000 7f825ffff700 1 --2- 172.21.15.192:0/2063955947 >> v2:172.21.15.146:3300/0 conn(0x7f8260154920 0x7f8260064c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:36.645 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.639+0000 7f825ffff700 1 -- 172.21.15.192:0/2063955947 >> v1:172.21.15.87:6789/0 conn(0x7f82600c2340 legacy=0x7f8260151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:36.645 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.639+0000 7f825ffff700 1 -- 172.21.15.192:0/2063955947 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8260064260 con 0x7f8260060370 2020-11-20T12:13:36.646 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.639+0000 7f825ffff700 1 --2- 172.21.15.192:0/2063955947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8260060370 0x7f8260060750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f8260060f90 tx=0x7f8254006e30).ready entity=mon.0 client_cookie=fc60e6f50a35f6d5 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:36.646 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.639+0000 7f825effd700 1 -- 172.21.15.192:0/2063955947 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825400bec0 con 0x7f8260060370 2020-11-20T12:13:36.646 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.639+0000 7f825effd700 1 -- 172.21.15.192:0/2063955947 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8254000e90 con 0x7f8260060370 2020-11-20T12:13:36.646 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.639+0000 7f825effd700 1 -- 172.21.15.192:0/2063955947 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82540098c0 con 0x7f8260060370 2020-11-20T12:13:36.649 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.640+0000 7f82665b0700 1 -- 172.21.15.192:0/2063955947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8260060370 msgr2=0x7f8260060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:36.649 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.640+0000 7f82665b0700 1 --2- 172.21.15.192:0/2063955947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8260060370 0x7f8260060750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f8260060f90 tx=0x7f8254006e30).stop 2020-11-20T12:13:36.650 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.640+0000 7f82665b0700 1 -- 172.21.15.192:0/2063955947 shutdown_connections 2020-11-20T12:13:36.650 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.640+0000 7f82665b0700 1 --2- 172.21.15.192:0/2063955947 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8260060370 0x7f8260060750 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:36.650 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.640+0000 7f82665b0700 1 --2- 172.21.15.192:0/2063955947 >> v2:172.21.15.146:3300/0 conn(0x7f8260154920 0x7f8260064c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:36.650 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.640+0000 7f82665b0700 1 -- 172.21.15.192:0/2063955947 >> 172.21.15.192:0/2063955947 conn(0x7f8260062100 msgr2=0x7f82600c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:36.650 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.640+0000 7f82665b0700 1 -- 172.21.15.192:0/2063955947 shutdown_connections 2020-11-20T12:13:36.651 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.640+0000 7f82665b0700 1 -- 172.21.15.192:0/2063955947 wait complete. 2020-11-20T12:13:36.651 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.641+0000 7f82665b0700 1 Processor -- start 2020-11-20T12:13:36.651 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.641+0000 7f82665b0700 1 -- start start 2020-11-20T12:13:36.651 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.642+0000 7f82665b0700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8260060370 0x7f82600c09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:36.651 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.642+0000 7f82665b0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82600c2340 0x7f8260163d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:36.652 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.642+0000 7f82665b0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8260154920 0x7f8260161140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:36.652 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.642+0000 7f82665b0700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8260160820 con 0x7f8260060370 2020-11-20T12:13:36.652 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.642+0000 7f82665b0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82600c0eb0 con 0x7f8260154920 2020-11-20T12:13:36.652 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.642+0000 7f82665b0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8260164250 con 0x7f82600c2340 2020-11-20T12:13:36.652 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.642+0000 7f825f7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82600c2340 0x7f8260163d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:36.653 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.642+0000 7f825f7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82600c2340 0x7f8260163d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50068/0 (socket says 172.21.15.192:50068) 2020-11-20T12:13:36.653 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.642+0000 7f825f7fe700 1 -- 172.21.15.192:0/2281645450 learned_addr learned my addr 172.21.15.192:0/2281645450 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:36.653 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.642+0000 7f825ffff700 1 --2- 172.21.15.192:0/2281645450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8260060370 0x7f82600c09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:36.653 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.642+0000 7f8264b4d700 1 --2- 172.21.15.192:0/2281645450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8260154920 0x7f8260161140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:36.653 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.642+0000 7f825f7fe700 1 -- 172.21.15.192:0/2281645450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8260154920 msgr2=0x7f8260161140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:36.654 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.642+0000 7f825f7fe700 1 --2- 172.21.15.192:0/2281645450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8260154920 0x7f8260161140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:36.654 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.642+0000 7f825f7fe700 1 -- 172.21.15.192:0/2281645450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8260060370 msgr2=0x7f82600c09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:36.654 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.642+0000 7f825f7fe700 1 --2- 172.21.15.192:0/2281645450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8260060370 0x7f82600c09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:36.654 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.642+0000 7f825f7fe700 1 -- 172.21.15.192:0/2281645450 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82601644d0 con 0x7f82600c2340 2020-11-20T12:13:36.654 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.642+0000 7f825f7fe700 1 --2- 172.21.15.192:0/2281645450 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82600c2340 0x7f8260163d60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f825000eba0 tx=0x7f8250006e30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:36.655 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.642+0000 7f823ffff700 1 -- 172.21.15.192:0/2281645450 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825000eeb0 con 0x7f82600c2340 2020-11-20T12:13:36.655 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.643+0000 7f823ffff700 1 -- 172.21.15.192:0/2281645450 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825000c850 con 0x7f82600c2340 2020-11-20T12:13:36.655 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.643+0000 7f82665b0700 1 -- 172.21.15.192:0/2281645450 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8260164770 con 0x7f82600c2340 2020-11-20T12:13:36.655 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.643+0000 7f823ffff700 1 -- 172.21.15.192:0/2281645450 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825000cbd0 con 0x7f82600c2340 2020-11-20T12:13:36.656 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.643+0000 7f82665b0700 1 -- 172.21.15.192:0/2281645450 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8260160a00 con 0x7f82600c2340 2020-11-20T12:13:36.656 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.643+0000 7f82665b0700 1 -- 172.21.15.192:0/2281645450 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82600699a0 con 0x7f82600c2340 2020-11-20T12:13:36.656 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.644+0000 7f823ffff700 1 -- 172.21.15.192:0/2281645450 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f8250026430 con 0x7f82600c2340 2020-11-20T12:13:36.656 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.645+0000 7f823ffff700 1 --2- 172.21.15.192:0/2281645450 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f8238080670 0x7f8238082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:36.657 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.645+0000 7f823ffff700 1 -- 172.21.15.192:0/2281645450 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f82500a3730 con 0x7f82600c2340 2020-11-20T12:13:36.657 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.645+0000 7f825ffff700 1 --2- 172.21.15.192:0/2281645450 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f8238080670 0x7f8238082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:36.657 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.645+0000 7f825ffff700 1 --2- 172.21.15.192:0/2281645450 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f8238080670 0x7f8238082b30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f8254006e70 tx=0x7f8254015000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:36.658 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.647+0000 7f823ffff700 1 -- 172.21.15.192:0/2281645450 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f82500780e0 con 0x7f82600c2340 2020-11-20T12:13:36.795 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.791+0000 7f82665b0700 1 -- 172.21.15.192:0/2281645450 --> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "8", "target": ["mon-mgr", ""]}) v1 -- 0x7f826005ca80 con 0x7f8238080670 2020-11-20T12:13:36.796 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.791+0000 7f823ffff700 1 -- 172.21.15.192:0/2281645450 <== mgr.4106 v2:172.21.15.192:6800/22925 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 8 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f826005ca80 con 0x7f8238080670 2020-11-20T12:13:36.800 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.793+0000 7f82665b0700 1 -- 172.21.15.192:0/2281645450 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f8238080670 msgr2=0x7f8238082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:36.801 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.793+0000 7f82665b0700 1 --2- 172.21.15.192:0/2281645450 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f8238080670 0x7f8238082b30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f8254006e70 tx=0x7f8254015000).stop 2020-11-20T12:13:36.801 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.793+0000 7f82665b0700 1 -- 172.21.15.192:0/2281645450 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82600c2340 msgr2=0x7f8260163d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:36.801 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.793+0000 7f82665b0700 1 --2- 172.21.15.192:0/2281645450 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82600c2340 0x7f8260163d60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f825000eba0 tx=0x7f8250006e30).stop 2020-11-20T12:13:36.802 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.793+0000 7f82665b0700 1 -- 172.21.15.192:0/2281645450 shutdown_connections 2020-11-20T12:13:36.802 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.793+0000 7f82665b0700 1 --2- 172.21.15.192:0/2281645450 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f8238080670 0x7f8238082b30 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:36.802 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.793+0000 7f82665b0700 1 --2- 172.21.15.192:0/2281645450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8260154920 0x7f8260161140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:36.802 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.793+0000 7f82665b0700 1 --2- 172.21.15.192:0/2281645450 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f8260060370 0x7f82600c09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:36.802 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.793+0000 7f82665b0700 1 --2- 172.21.15.192:0/2281645450 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82600c2340 0x7f8260163d60 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:36.803 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.793+0000 7f82665b0700 1 -- 172.21.15.192:0/2281645450 >> 172.21.15.192:0/2281645450 conn(0x7f8260062100 msgr2=0x7f8260153d90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:36.803 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.793+0000 7f82665b0700 1 -- 172.21.15.192:0/2281645450 shutdown_connections 2020-11-20T12:13:36.803 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.793+0000 7f82665b0700 1 -- 172.21.15.192:0/2281645450 wait complete. 2020-11-20T12:13:36.803 INFO:teuthology.orchestra.run.smithi192.stderr:instructed osd(s) 8 to deep-scrub 2020-11-20T12:13:36.808 INFO:tasks.ceph:Scrubbing osd.11 2020-11-20T12:13:36.808 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:13:36.922 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.919+0000 7f78051a4700 1 Processor -- start 2020-11-20T12:13:36.923 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.919+0000 7f78051a4700 1 -- start start 2020-11-20T12:13:36.925 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.920+0000 7f78051a4700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7800154920 0x7f7800060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:36.925 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.920+0000 7f78051a4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7800064c40 0x7f7800151340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:36.926 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.920+0000 7f78051a4700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7800151e80 con 0x7f7800060370 2020-11-20T12:13:36.926 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.920+0000 7f78051a4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7800152120 con 0x7f7800064c40 2020-11-20T12:13:36.926 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.920+0000 7f78051a4700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7800064260 con 0x7f7800154920 2020-11-20T12:13:36.926 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.920+0000 7f77fe59c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7800154920 0x7f7800060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:36.927 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.920+0000 7f77fed9d700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f7800060370 0x7f78000c2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52742/0 (socket says 172.21.15.192:52742) 2020-11-20T12:13:36.927 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.920+0000 7f77fed9d700 1 -- 172.21.15.192:0/2023283437 learned_addr learned my addr 172.21.15.192:0/2023283437 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T12:13:36.927 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.920+0000 7f77ff59e700 1 --2- 172.21.15.192:0/2023283437 >> v2:172.21.15.146:3300/0 conn(0x7f7800064c40 0x7f7800151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:36.928 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.920+0000 7f77fe59c700 1 -- 172.21.15.192:0/2023283437 >> v2:172.21.15.146:3300/0 conn(0x7f7800064c40 msgr2=0x7f7800151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:36.928 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.920+0000 7f77fe59c700 1 --2- 172.21.15.192:0/2023283437 >> v2:172.21.15.146:3300/0 conn(0x7f7800064c40 0x7f7800151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:36.929 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.920+0000 7f77fe59c700 1 -- 172.21.15.192:0/2023283437 >> v1:172.21.15.192:6789/0 conn(0x7f7800060370 legacy=0x7f78000c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:36.929 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.920+0000 7f77fe59c700 1 -- 172.21.15.192:0/2023283437 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7800064500 con 0x7f7800154920 2020-11-20T12:13:36.929 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.920+0000 7f77fdd9b700 1 -- 172.21.15.192:0/2023283437 <== mon.2 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2177612771 0 0) 0x7f7800151e80 con 0x7f7800060370 2020-11-20T12:13:36.930 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.920+0000 7f77fe59c700 1 --2- 172.21.15.192:0/2023283437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7800154920 0x7f7800060750 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f7800060f60 tx=0x7f77e8006e30).ready entity=mon.2 client_cookie=2c39cd975ceaa4f5 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:36.930 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.920+0000 7f77fdd9b700 1 -- 172.21.15.192:0/2023283437 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e8009840 con 0x7f7800154920 2020-11-20T12:13:36.930 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.920+0000 7f77fdd9b700 1 -- 172.21.15.192:0/2023283437 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e8000e90 con 0x7f7800154920 2020-11-20T12:13:36.931 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.920+0000 7f77fdd9b700 1 -- 172.21.15.192:0/2023283437 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e8009bb0 con 0x7f7800154920 2020-11-20T12:13:36.931 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.921+0000 7f78051a4700 1 -- 172.21.15.192:0/2023283437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7800154920 msgr2=0x7f7800060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:36.932 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.921+0000 7f78051a4700 1 --2- 172.21.15.192:0/2023283437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7800154920 0x7f7800060750 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f7800060f60 tx=0x7f77e8006e30).stop 2020-11-20T12:13:36.932 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.921+0000 7f78051a4700 1 -- 172.21.15.192:0/2023283437 shutdown_connections 2020-11-20T12:13:36.932 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.921+0000 7f78051a4700 1 --2- 172.21.15.192:0/2023283437 >> v2:172.21.15.146:3300/0 conn(0x7f7800064c40 0x7f7800151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:36.933 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.921+0000 7f78051a4700 1 --2- 172.21.15.192:0/2023283437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7800154920 0x7f7800060750 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:36.933 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.921+0000 7f78051a4700 1 -- 172.21.15.192:0/2023283437 >> 172.21.15.192:0/2023283437 conn(0x7f7800062100 msgr2=0x7f78000c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:36.934 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.921+0000 7f78051a4700 1 -- 172.21.15.192:0/2023283437 shutdown_connections 2020-11-20T12:13:36.934 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.921+0000 7f78051a4700 1 -- 172.21.15.192:0/2023283437 wait complete. 2020-11-20T12:13:36.940 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.922+0000 7f78051a4700 1 Processor -- start 2020-11-20T12:13:36.940 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.922+0000 7f78051a4700 1 -- start start 2020-11-20T12:13:36.940 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.923+0000 7f78051a4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7800060370 0x7f78000b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:36.940 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.923+0000 7f78051a4700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7800064c40 0x7f78000c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:36.941 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.923+0000 7f78051a4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7800154920 0x7f780014c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:36.941 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.923+0000 7f78051a4700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78000bfbe0 con 0x7f7800064c40 2020-11-20T12:13:36.941 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.923+0000 7f78051a4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78000bfe80 con 0x7f7800154920 2020-11-20T12:13:36.941 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.923+0000 7f78051a4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78000c0120 con 0x7f7800060370 2020-11-20T12:13:36.941 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.923+0000 7f77fed9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7800060370 0x7f78000b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:36.942 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.923+0000 7f77fed9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7800060370 0x7f78000b0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50080/0 (socket says 172.21.15.192:50080) 2020-11-20T12:13:36.942 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.923+0000 7f77fed9d700 1 -- 172.21.15.192:0/3806688105 learned_addr learned my addr 172.21.15.192:0/3806688105 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:36.942 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.923+0000 7f77fe59c700 1 --2- 172.21.15.192:0/3806688105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7800064c40 0x7f78000c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:36.942 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.923+0000 7f77fed9d700 1 -- 172.21.15.192:0/3806688105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7800154920 msgr2=0x7f780014c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:36.942 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.923+0000 7f77fed9d700 1 --2- 172.21.15.192:0/3806688105 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7800154920 0x7f780014c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:13:36.943 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.923+0000 7f77fed9d700 1 -- 172.21.15.192:0/3806688105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7800064c40 msgr2=0x7f78000c46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:36.943 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.923+0000 7f77fed9d700 1 --2- 172.21.15.192:0/3806688105 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7800064c40 0x7f78000c46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:36.943 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.923+0000 7f77fed9d700 1 -- 172.21.15.192:0/3806688105 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78000c03c0 con 0x7f7800060370 2020-11-20T12:13:36.943 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.923+0000 7f77fed9d700 1 --2- 172.21.15.192:0/3806688105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7800060370 0x7f78000b0340 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f77f000c710 tx=0x7f77f0007cd0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:36.943 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.924+0000 7f77f6ffd700 1 -- 172.21.15.192:0/3806688105 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f00072e0 con 0x7f7800060370 2020-11-20T12:13:36.944 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.924+0000 7f77f6ffd700 1 -- 172.21.15.192:0/3806688105 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f0007440 con 0x7f7800060370 2020-11-20T12:13:36.944 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.924+0000 7f78051a4700 1 -- 172.21.15.192:0/3806688105 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78000c0660 con 0x7f7800060370 2020-11-20T12:13:36.944 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.924+0000 7f77f6ffd700 1 -- 172.21.15.192:0/3806688105 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f0005860 con 0x7f7800060370 2020-11-20T12:13:36.944 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.924+0000 7f78051a4700 1 -- 172.21.15.192:0/3806688105 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78000b0830 con 0x7f7800060370 2020-11-20T12:13:36.944 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.924+0000 7f78051a4700 1 -- 172.21.15.192:0/3806688105 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f78000b0a20 con 0x7f7800060370 2020-11-20T12:13:36.945 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.925+0000 7f77f6ffd700 1 -- 172.21.15.192:0/3806688105 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f77f001a060 con 0x7f7800060370 2020-11-20T12:13:36.945 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.926+0000 7f77f6ffd700 1 --2- 172.21.15.192:0/3806688105 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f77dc080670 0x7f77dc082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:36.945 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.926+0000 7f77f6ffd700 1 -- 172.21.15.192:0/3806688105 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f77f00a1e60 con 0x7f7800060370 2020-11-20T12:13:36.945 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.926+0000 7f77fe59c700 1 --2- 172.21.15.192:0/3806688105 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f77dc080670 0x7f77dc082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:36.945 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.926+0000 7f77f6ffd700 1 --2- 172.21.15.192:0/3806688105 >> [v2:172.21.15.87:6808/23317,v1:172.21.15.87:6809/23317] conn(0x7f77dc0893a0 0x7f77dc08b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:36.946 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.926+0000 7f77f6ffd700 1 -- 172.21.15.192:0/3806688105 --> [v2:172.21.15.87:6808/23317,v1:172.21.15.87:6809/23317] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f77dc08be20 con 0x7f77dc0893a0 2020-11-20T12:13:36.946 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.926+0000 7f77f6ffd700 1 -- 172.21.15.192:0/3806688105 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77f00a4440 con 0x7f7800060370 2020-11-20T12:13:36.946 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.926+0000 7f77fe59c700 1 --2- 172.21.15.192:0/3806688105 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f77dc080670 0x7f77dc082b30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f7800060f60 tx=0x7f77e8015000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:36.946 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.926+0000 7f77ff59e700 1 --2- 172.21.15.192:0/3806688105 >> [v2:172.21.15.87:6808/23317,v1:172.21.15.87:6809/23317] conn(0x7f77dc0893a0 0x7f77dc08b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:36.946 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.927+0000 7f77ff59e700 1 --2- 172.21.15.192:0/3806688105 >> [v2:172.21.15.87:6808/23317,v1:172.21.15.87:6809/23317] conn(0x7f77dc0893a0 0x7f77dc08b7c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:36.947 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.928+0000 7f77f6ffd700 1 -- 172.21.15.192:0/3806688105 <== osd.11 v2:172.21.15.87:6808/23317 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f77dc08be20 con 0x7f77dc0893a0 2020-11-20T12:13:36.948 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.940+0000 7f78051a4700 1 -- 172.21.15.192:0/3806688105 --> [v2:172.21.15.87:6808/23317,v1:172.21.15.87:6809/23317] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f78000c0ac0 con 0x7f77dc0893a0 2020-11-20T12:13:36.948 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.941+0000 7f77f6ffd700 1 -- 172.21.15.192:0/3806688105 <== osd.11 v2:172.21.15.87:6808/23317 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f78000c0ac0 con 0x7f77dc0893a0 2020-11-20T12:13:36.948 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.941+0000 7f78051a4700 1 -- 172.21.15.192:0/3806688105 >> [v2:172.21.15.87:6808/23317,v1:172.21.15.87:6809/23317] conn(0x7f77dc0893a0 msgr2=0x7f77dc08b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:36.948 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.941+0000 7f78051a4700 1 --2- 172.21.15.192:0/3806688105 >> [v2:172.21.15.87:6808/23317,v1:172.21.15.87:6809/23317] conn(0x7f77dc0893a0 0x7f77dc08b7c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:36.949 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.941+0000 7f78051a4700 1 -- 172.21.15.192:0/3806688105 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f77dc080670 msgr2=0x7f77dc082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:36.949 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.941+0000 7f78051a4700 1 --2- 172.21.15.192:0/3806688105 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f77dc080670 0x7f77dc082b30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f7800060f60 tx=0x7f77e8015000).stop 2020-11-20T12:13:36.949 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.941+0000 7f78051a4700 1 -- 172.21.15.192:0/3806688105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7800060370 msgr2=0x7f78000b0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:36.949 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.941+0000 7f78051a4700 1 --2- 172.21.15.192:0/3806688105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7800060370 0x7f78000b0340 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f77f000c710 tx=0x7f77f0007cd0).stop 2020-11-20T12:13:36.949 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.941+0000 7f77ff59e700 1 -- 172.21.15.192:0/3806688105 reap_dead start 2020-11-20T12:13:36.950 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.941+0000 7f78051a4700 1 -- 172.21.15.192:0/3806688105 shutdown_connections 2020-11-20T12:13:36.950 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.941+0000 7f78051a4700 1 -- 172.21.15.192:0/3806688105 >> 172.21.15.192:0/3806688105 conn(0x7f7800062100 msgr2=0x7f78000c3260 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:36.950 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.941+0000 7f78051a4700 1 -- 172.21.15.192:0/3806688105 shutdown_connections 2020-11-20T12:13:36.950 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:36.942+0000 7f78051a4700 1 -- 172.21.15.192:0/3806688105 wait complete. 2020-11-20T12:13:36.950 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2020-11-20T12:13:36.951 INFO:teuthology.orchestra.run.smithi192.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:13:36.951 INFO:teuthology.orchestra.run.smithi192.stdout:} 2020-11-20T12:13:36.956 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 11 2020-11-20T12:13:37.071 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.067+0000 7f3e2e112700 1 Processor -- start 2020-11-20T12:13:37.071 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.067+0000 7f3e2e112700 1 -- start start 2020-11-20T12:13:37.073 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.068+0000 7f3e2e112700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3e28060370 0x7f3e28060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:37.073 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.068+0000 7f3e2e112700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3e28154920 0x7f3e28064c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:37.073 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.068+0000 7f3e2e112700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e28065130 con 0x7f3e280c2340 2020-11-20T12:13:37.074 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.068+0000 7f3e2e112700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e28151e80 con 0x7f3e28154920 2020-11-20T12:13:37.074 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.068+0000 7f3e2e112700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e28152120 con 0x7f3e28060370 2020-11-20T12:13:37.074 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.068+0000 7f3e277fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3e28060370 0x7f3e28060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:37.074 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.068+0000 7f3e277fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3e28060370 0x7f3e28060750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50090/0 (socket says 172.21.15.192:50090) 2020-11-20T12:13:37.075 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.068+0000 7f3e277fe700 1 -- 172.21.15.192:0/2491088396 learned_addr learned my addr 172.21.15.192:0/2491088396 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:37.075 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.068+0000 7f3e26ffd700 1 --2- 172.21.15.192:0/2491088396 >> v2:172.21.15.146:3300/0 conn(0x7f3e28154920 0x7f3e28064c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:37.075 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.068+0000 7f3e277fe700 1 -- 172.21.15.192:0/2491088396 >> v2:172.21.15.146:3300/0 conn(0x7f3e28154920 msgr2=0x7f3e28064c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:37.075 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.068+0000 7f3e277fe700 1 --2- 172.21.15.192:0/2491088396 >> v2:172.21.15.146:3300/0 conn(0x7f3e28154920 0x7f3e28064c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:37.075 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.068+0000 7f3e277fe700 1 -- 172.21.15.192:0/2491088396 >> v1:172.21.15.146:6789/0 conn(0x7f3e280c2340 legacy=0x7f3e28151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:37.076 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.068+0000 7f3e277fe700 1 -- 172.21.15.192:0/2491088396 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e28064260 con 0x7f3e28060370 2020-11-20T12:13:37.076 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.069+0000 7f3e277fe700 1 --2- 172.21.15.192:0/2491088396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e28060370 0x7f3e28060750 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f3e280c5450 tx=0x7f3e18006ef0).ready entity=mon.2 client_cookie=83399bc5e95f69bc server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:37.076 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.069+0000 7f3e267fc700 1 -- 172.21.15.192:0/2491088396 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1800b8f0 con 0x7f3e28060370 2020-11-20T12:13:37.076 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.069+0000 7f3e267fc700 1 -- 172.21.15.192:0/2491088396 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e18000e90 con 0x7f3e28060370 2020-11-20T12:13:37.076 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.069+0000 7f3e267fc700 1 -- 172.21.15.192:0/2491088396 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1800bc60 con 0x7f3e28060370 2020-11-20T12:13:37.077 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.069+0000 7f3e2e112700 1 -- 172.21.15.192:0/2491088396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e28060370 msgr2=0x7f3e28060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:37.077 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.069+0000 7f3e2e112700 1 --2- 172.21.15.192:0/2491088396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e28060370 0x7f3e28060750 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f3e280c5450 tx=0x7f3e18006ef0).stop 2020-11-20T12:13:37.077 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.069+0000 7f3e2e112700 1 -- 172.21.15.192:0/2491088396 shutdown_connections 2020-11-20T12:13:37.077 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.069+0000 7f3e2e112700 1 --2- 172.21.15.192:0/2491088396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e28060370 0x7f3e28060750 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:37.077 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.069+0000 7f3e2e112700 1 --2- 172.21.15.192:0/2491088396 >> v2:172.21.15.146:3300/0 conn(0x7f3e28154920 0x7f3e28064c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:37.078 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.069+0000 7f3e2e112700 1 -- 172.21.15.192:0/2491088396 >> 172.21.15.192:0/2491088396 conn(0x7f3e28062100 msgr2=0x7f3e280c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:37.078 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.069+0000 7f3e2e112700 1 -- 172.21.15.192:0/2491088396 shutdown_connections 2020-11-20T12:13:37.078 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.069+0000 7f3e2e112700 1 -- 172.21.15.192:0/2491088396 wait complete. 2020-11-20T12:13:37.080 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.070+0000 7f3e2e112700 1 Processor -- start 2020-11-20T12:13:37.081 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.070+0000 7f3e2e112700 1 -- start start 2020-11-20T12:13:37.081 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.071+0000 7f3e2e112700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e28060370 0x7f3e280c1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:37.081 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.071+0000 7f3e2e112700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e280c2340 0x7f3e28067ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:37.081 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.071+0000 7f3e2e112700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e28154920 0x7f3e28148870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:37.082 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.071+0000 7f3e2e112700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e28164110 con 0x7f3e280c2340 2020-11-20T12:13:37.082 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.071+0000 7f3e2e112700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e281643b0 con 0x7f3e28060370 2020-11-20T12:13:37.082 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.071+0000 7f3e2e112700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e28164650 con 0x7f3e28154920 2020-11-20T12:13:37.082 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.071+0000 7f3e27fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e28154920 0x7f3e28148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:37.082 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.071+0000 7f3e27fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e28154920 0x7f3e28148870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50098/0 (socket says 172.21.15.192:50098) 2020-11-20T12:13:37.083 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.071+0000 7f3e27fff700 1 -- 172.21.15.192:0/3215672102 learned_addr learned my addr 172.21.15.192:0/3215672102 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:37.083 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.071+0000 7f3e277fe700 1 --2- 172.21.15.192:0/3215672102 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e28060370 0x7f3e280c1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:37.083 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.071+0000 7f3e26ffd700 1 --2- 172.21.15.192:0/3215672102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e280c2340 0x7f3e28067ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:37.083 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.072+0000 7f3e27fff700 1 -- 172.21.15.192:0/3215672102 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e28060370 msgr2=0x7f3e280c1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:37.083 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.072+0000 7f3e27fff700 1 --2- 172.21.15.192:0/3215672102 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e28060370 0x7f3e280c1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:37.084 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.072+0000 7f3e27fff700 1 -- 172.21.15.192:0/3215672102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e280c2340 msgr2=0x7f3e28067ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:37.084 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.072+0000 7f3e27fff700 1 --2- 172.21.15.192:0/3215672102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e280c2340 0x7f3e28067ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:37.084 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.072+0000 7f3e27fff700 1 -- 172.21.15.192:0/3215672102 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e281648f0 con 0x7f3e28154920 2020-11-20T12:13:37.084 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.072+0000 7f3e27fff700 1 --2- 172.21.15.192:0/3215672102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e28154920 0x7f3e28148870 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f3e2000ca90 tx=0x7f3e200013a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:37.084 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.072+0000 7f3e077fe700 1 -- 172.21.15.192:0/3215672102 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2000a550 con 0x7f3e28154920 2020-11-20T12:13:37.085 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.072+0000 7f3e077fe700 1 -- 172.21.15.192:0/3215672102 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2000a6b0 con 0x7f3e28154920 2020-11-20T12:13:37.085 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.072+0000 7f3e2e112700 1 -- 172.21.15.192:0/3215672102 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e28164b90 con 0x7f3e28154920 2020-11-20T12:13:37.085 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.072+0000 7f3e077fe700 1 -- 172.21.15.192:0/3215672102 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2000aa30 con 0x7f3e28154920 2020-11-20T12:13:37.085 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.072+0000 7f3e2e112700 1 -- 172.21.15.192:0/3215672102 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e280683e0 con 0x7f3e28154920 2020-11-20T12:13:37.085 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.073+0000 7f3e2e112700 1 -- 172.21.15.192:0/3215672102 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e280699a0 con 0x7f3e28154920 2020-11-20T12:13:37.086 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.074+0000 7f3e077fe700 1 -- 172.21.15.192:0/3215672102 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f3e20018020 con 0x7f3e28154920 2020-11-20T12:13:37.086 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.075+0000 7f3e077fe700 1 --2- 172.21.15.192:0/3215672102 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3e00080670 0x7f3e00082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:37.086 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.075+0000 7f3e077fe700 1 -- 172.21.15.192:0/3215672102 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f3e200a2870 con 0x7f3e28154920 2020-11-20T12:13:37.086 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.075+0000 7f3e277fe700 1 --2- 172.21.15.192:0/3215672102 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3e00080670 0x7f3e00082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:37.086 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.075+0000 7f3e277fe700 1 --2- 172.21.15.192:0/3215672102 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3e00080670 0x7f3e00082b30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f3e18006f30 tx=0x7f3e18016000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:37.087 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.077+0000 7f3e077fe700 1 -- 172.21.15.192:0/3215672102 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f3e20077280 con 0x7f3e28154920 2020-11-20T12:13:37.224 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.219+0000 7f3e2e112700 1 -- 172.21.15.192:0/3215672102 --> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "11", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e2805ca80 con 0x7f3e00080670 2020-11-20T12:13:37.224 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.219+0000 7f3e077fe700 1 -- 172.21.15.192:0/3215672102 <== mgr.4106 v2:172.21.15.192:6800/22925 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 11 to deep-scrub) v1 ==== 42+0+0 (secure 0 0 0) 0x7f3e2805ca80 con 0x7f3e00080670 2020-11-20T12:13:37.226 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.221+0000 7f3e2e112700 1 -- 172.21.15.192:0/3215672102 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3e00080670 msgr2=0x7f3e00082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:37.227 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.221+0000 7f3e2e112700 1 --2- 172.21.15.192:0/3215672102 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3e00080670 0x7f3e00082b30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f3e18006f30 tx=0x7f3e18016000).stop 2020-11-20T12:13:37.227 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.221+0000 7f3e2e112700 1 -- 172.21.15.192:0/3215672102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e28154920 msgr2=0x7f3e28148870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:37.228 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.221+0000 7f3e2e112700 1 --2- 172.21.15.192:0/3215672102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e28154920 0x7f3e28148870 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f3e2000ca90 tx=0x7f3e200013a0).stop 2020-11-20T12:13:37.228 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.221+0000 7f3e2e112700 1 -- 172.21.15.192:0/3215672102 shutdown_connections 2020-11-20T12:13:37.230 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.221+0000 7f3e2e112700 1 --2- 172.21.15.192:0/3215672102 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3e00080670 0x7f3e00082b30 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:37.230 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.221+0000 7f3e2e112700 1 --2- 172.21.15.192:0/3215672102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e28154920 0x7f3e28148870 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:37.231 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.221+0000 7f3e2e112700 1 --2- 172.21.15.192:0/3215672102 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e28060370 0x7f3e280c1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:37.231 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.221+0000 7f3e2e112700 1 --2- 172.21.15.192:0/3215672102 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3e280c2340 0x7f3e28067ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:37.231 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.221+0000 7f3e2e112700 1 -- 172.21.15.192:0/3215672102 >> 172.21.15.192:0/3215672102 conn(0x7f3e28062100 msgr2=0x7f3e2814ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:37.232 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.221+0000 7f3e2e112700 1 -- 172.21.15.192:0/3215672102 shutdown_connections 2020-11-20T12:13:37.232 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.221+0000 7f3e2e112700 1 -- 172.21.15.192:0/3215672102 wait complete. 2020-11-20T12:13:37.233 INFO:teuthology.orchestra.run.smithi192.stderr:instructed osd(s) 11 to deep-scrub 2020-11-20T12:13:37.237 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-20T12:13:37.348 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.345+0000 7f7eba640700 1 Processor -- start 2020-11-20T12:13:37.349 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.345+0000 7f7eba640700 1 -- start start 2020-11-20T12:13:37.354 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.346+0000 7f7eba640700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f7eb4150c70 0x7f7eb4061bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:37.355 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.346+0000 7f7eba640700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7eb4151430 0x7f7eb4151890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:37.355 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.346+0000 7f7eba640700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb4154610 con 0x7f7eb40617f0 2020-11-20T12:13:37.355 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.346+0000 7f7eba640700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb41548b0 con 0x7f7eb4150c70 2020-11-20T12:13:37.355 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.346+0000 7f7eba640700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb4154b50 con 0x7f7eb4151430 2020-11-20T12:13:37.355 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.346+0000 7f7eb9e3f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7eb4151430 0x7f7eb4151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:37.356 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.346+0000 7f7eb963e700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f7eb40617f0 0x7f7eb4150560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52772/0 (socket says 172.21.15.192:52772) 2020-11-20T12:13:37.356 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.346+0000 7f7eb963e700 1 -- 172.21.15.192:0/2392533685 learned_addr learned my addr 172.21.15.192:0/2392533685 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T12:13:37.356 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.346+0000 7f7eb8e3d700 1 --2- 172.21.15.192:0/2392533685 >> v2:172.21.15.87:3300/0 conn(0x7f7eb4150c70 0x7f7eb4061bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:37.356 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.346+0000 7f7eb9e3f700 1 -- 172.21.15.192:0/2392533685 >> v2:172.21.15.87:3300/0 conn(0x7f7eb4150c70 msgr2=0x7f7eb4061bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:37.356 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.346+0000 7f7eb9e3f700 1 --2- 172.21.15.192:0/2392533685 >> v2:172.21.15.87:3300/0 conn(0x7f7eb4150c70 0x7f7eb4061bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:37.357 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.346+0000 7f7eb9e3f700 1 -- 172.21.15.192:0/2392533685 >> v1:172.21.15.192:6789/0 conn(0x7f7eb40617f0 legacy=0x7f7eb4150560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:37.357 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.346+0000 7f7eb9e3f700 1 -- 172.21.15.192:0/2392533685 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb4154df0 con 0x7f7eb4151430 2020-11-20T12:13:37.357 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.346+0000 7f7eb8e3d700 1 --2- 172.21.15.192:0/2392533685 >> v2:172.21.15.87:3300/0 conn(0x7f7eb4150c70 0x7f7eb4061bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:13:37.357 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.346+0000 7f7eb9e3f700 1 --2- 172.21.15.192:0/2392533685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7eb4151430 0x7f7eb4151890 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f7eac009ce0 tx=0x7f7eac009220).ready entity=mon.2 client_cookie=f56c5974631c470e server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:37.358 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.346+0000 7f7ea3fff700 1 -- 172.21.15.192:0/2392533685 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac00bbb0 con 0x7f7eb4151430 2020-11-20T12:13:37.358 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.346+0000 7f7ea3fff700 1 -- 172.21.15.192:0/2392533685 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eac00bd10 con 0x7f7eb4151430 2020-11-20T12:13:37.358 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.346+0000 7f7ea3fff700 1 -- 172.21.15.192:0/2392533685 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac011610 con 0x7f7eb4151430 2020-11-20T12:13:37.358 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.347+0000 7f7eba640700 1 -- 172.21.15.192:0/2392533685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7eb4151430 msgr2=0x7f7eb4151890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:37.359 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.347+0000 7f7eba640700 1 --2- 172.21.15.192:0/2392533685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7eb4151430 0x7f7eb4151890 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f7eac009ce0 tx=0x7f7eac009220).stop 2020-11-20T12:13:37.359 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.347+0000 7f7eba640700 1 -- 172.21.15.192:0/2392533685 shutdown_connections 2020-11-20T12:13:37.359 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.347+0000 7f7eba640700 1 --2- 172.21.15.192:0/2392533685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7eb4151430 0x7f7eb4151890 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:37.359 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.347+0000 7f7eba640700 1 --2- 172.21.15.192:0/2392533685 >> v2:172.21.15.87:3300/0 conn(0x7f7eb4150c70 0x7f7eb4061bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:37.360 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.347+0000 7f7eba640700 1 -- 172.21.15.192:0/2392533685 >> 172.21.15.192:0/2392533685 conn(0x7f7eb40c77f0 msgr2=0x7f7eb40c7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:37.360 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.347+0000 7f7eba640700 1 -- 172.21.15.192:0/2392533685 shutdown_connections 2020-11-20T12:13:37.360 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.347+0000 7f7eba640700 1 -- 172.21.15.192:0/2392533685 wait complete. 2020-11-20T12:13:37.361 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.348+0000 7f7eba640700 1 Processor -- start 2020-11-20T12:13:37.361 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.348+0000 7f7eba640700 1 -- start start 2020-11-20T12:13:37.361 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.349+0000 7f7eba640700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7eb40617f0 0x7f7eb40b17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:37.361 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.349+0000 7f7eba640700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7eb4150c70 0x7f7eb40c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:37.361 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.349+0000 7f7eba640700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7eb4151430 0x7f7eb4161d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:37.362 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.349+0000 7f7eba640700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb40b1cd0 con 0x7f7eb40617f0 2020-11-20T12:13:37.362 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.349+0000 7f7eba640700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb4163e20 con 0x7f7eb4151430 2020-11-20T12:13:37.362 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.349+0000 7f7eba640700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb41613c0 con 0x7f7eb4150c70 2020-11-20T12:13:37.362 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.349+0000 7f7eb8e3d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7eb4150c70 0x7f7eb40c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:37.363 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.349+0000 7f7eb8e3d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7eb4150c70 0x7f7eb40c7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50112/0 (socket says 172.21.15.192:50112) 2020-11-20T12:13:37.363 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.349+0000 7f7eb8e3d700 1 -- 172.21.15.192:0/4068351609 learned_addr learned my addr 172.21.15.192:0/4068351609 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:37.363 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.349+0000 7f7eb9e3f700 1 --2- 172.21.15.192:0/4068351609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7eb4151430 0x7f7eb4161d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:37.363 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.349+0000 7f7eb963e700 1 --2- 172.21.15.192:0/4068351609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7eb40617f0 0x7f7eb40b17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:37.364 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.349+0000 7f7eb8e3d700 1 -- 172.21.15.192:0/4068351609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7eb4151430 msgr2=0x7f7eb4161d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:37.364 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.349+0000 7f7eb8e3d700 1 --2- 172.21.15.192:0/4068351609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7eb4151430 0x7f7eb4161d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:37.364 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.349+0000 7f7eb8e3d700 1 -- 172.21.15.192:0/4068351609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7eb40617f0 msgr2=0x7f7eb40b17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:37.365 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.349+0000 7f7eb8e3d700 1 --2- 172.21.15.192:0/4068351609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7eb40617f0 0x7f7eb40b17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:37.365 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.349+0000 7f7eb8e3d700 1 -- 172.21.15.192:0/4068351609 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb4161660 con 0x7f7eb4150c70 2020-11-20T12:13:37.365 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.349+0000 7f7eb963e700 1 --2- 172.21.15.192:0/4068351609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7eb40617f0 0x7f7eb40b17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:13:37.365 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.350+0000 7f7eb8e3d700 1 --2- 172.21.15.192:0/4068351609 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7eb4150c70 0x7f7eb40c7d90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f7eb000cb80 tx=0x7f7eb0008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:37.366 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.350+0000 7f7ea17fa700 1 -- 172.21.15.192:0/4068351609 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb00077d0 con 0x7f7eb4150c70 2020-11-20T12:13:37.366 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.350+0000 7f7ea17fa700 1 -- 172.21.15.192:0/4068351609 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb0007930 con 0x7f7eb4150c70 2020-11-20T12:13:37.366 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.350+0000 7f7eba640700 1 -- 172.21.15.192:0/4068351609 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb4164050 con 0x7f7eb4150c70 2020-11-20T12:13:37.366 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.350+0000 7f7ea17fa700 1 -- 172.21.15.192:0/4068351609 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0007cd0 con 0x7f7eb4150c70 2020-11-20T12:13:37.366 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.350+0000 7f7eba640700 1 -- 172.21.15.192:0/4068351609 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb4164590 con 0x7f7eb4150c70 2020-11-20T12:13:37.367 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.351+0000 7f7eba640700 1 -- 172.21.15.192:0/4068351609 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb4164720 con 0x7f7eb4150c70 2020-11-20T12:13:37.367 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.351+0000 7f7ea17fa700 1 -- 172.21.15.192:0/4068351609 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f7eb0011620 con 0x7f7eb4150c70 2020-11-20T12:13:37.368 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.352+0000 7f7ea17fa700 1 --2- 172.21.15.192:0/4068351609 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f7e8c0806a0 0x7f7e8c082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:37.368 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.352+0000 7f7ea17fa700 1 -- 172.21.15.192:0/4068351609 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f7eb00a2aa0 con 0x7f7eb4150c70 2020-11-20T12:13:37.368 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.352+0000 7f7eb963e700 1 --2- 172.21.15.192:0/4068351609 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f7e8c0806a0 0x7f7e8c082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:37.369 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.352+0000 7f7eb963e700 1 --2- 172.21.15.192:0/4068351609 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f7e8c0806a0 0x7f7e8c082b60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f7ea40014b0 tx=0x7f7ea4009040).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:37.369 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.355+0000 7f7ea17fa700 1 -- 172.21.15.192:0/4068351609 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f7eb0077450 con 0x7f7eb4150c70 2020-11-20T12:13:37.496 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.492+0000 7f7eba640700 1 -- 172.21.15.192:0/4068351609 --> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7eb405ca80 con 0x7f7e8c0806a0 2020-11-20T12:13:37.502 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.498+0000 7f7ea17fa700 1 -- 172.21.15.192:0/4068351609 <== mgr.4106 v2:172.21.15.192:6800/22925 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+149292 (secure 0 0 0) 0x7f7eb405ca80 con 0x7f7e8c0806a0 2020-11-20T12:13:37.503 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T12:13:37.512 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.500+0000 7f7eba640700 1 -- 172.21.15.192:0/4068351609 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f7e8c0806a0 msgr2=0x7f7e8c082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:37.512 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.500+0000 7f7eba640700 1 --2- 172.21.15.192:0/4068351609 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f7e8c0806a0 0x7f7e8c082b60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f7ea40014b0 tx=0x7f7ea4009040).stop 2020-11-20T12:13:37.512 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.500+0000 7f7eba640700 1 -- 172.21.15.192:0/4068351609 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7eb4150c70 msgr2=0x7f7eb40c7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:37.512 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.500+0000 7f7eba640700 1 --2- 172.21.15.192:0/4068351609 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7eb4150c70 0x7f7eb40c7d90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f7eb000cb80 tx=0x7f7eb0008040).stop 2020-11-20T12:13:37.513 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.500+0000 7f7eba640700 1 -- 172.21.15.192:0/4068351609 shutdown_connections 2020-11-20T12:13:37.513 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.500+0000 7f7eba640700 1 --2- 172.21.15.192:0/4068351609 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f7e8c0806a0 0x7f7e8c082b60 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:37.513 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.500+0000 7f7eba640700 1 --2- 172.21.15.192:0/4068351609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7eb4151430 0x7f7eb4161d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:37.513 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.500+0000 7f7eba640700 1 --2- 172.21.15.192:0/4068351609 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f7eb40617f0 0x7f7eb40b17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:37.514 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.500+0000 7f7eba640700 1 --2- 172.21.15.192:0/4068351609 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7eb4150c70 0x7f7eb40c7d90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:37.514 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.500+0000 7f7eba640700 1 -- 172.21.15.192:0/4068351609 >> 172.21.15.192:0/4068351609 conn(0x7f7eb40c77f0 msgr2=0x7f7eb414eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:37.514 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.500+0000 7f7eba640700 1 -- 172.21.15.192:0/4068351609 shutdown_connections 2020-11-20T12:13:37.514 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:37.500+0000 7f7eba640700 1 -- 172.21.15.192:0/4068351609 wait complete. 2020-11-20T12:13:37.514 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2020-11-20T12:13:37.515 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":788,"stamp":"2020-11-20T12:13:36.612111+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":239746965,"num_objects":90,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":0,"num_read":13768,"num_read_kb":740881,"num_write":316684,"num_write_kb":5410704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2183,"num_omap_keys":23,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160550,"ondisk_log_size":160550,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":3796544,"kb_used_data":362592,"kb_used_omap":0,"kb_used_meta":3433856,"kb_avail":1128665536,"statfs":{"total":1159641169920,"available":1155753508864,"internally_reserved":0,"allocated":371294208,"data_stored":481125486,"data_compressed":52868208,"data_compressed_allocated":111796224,"data_compressed_original":223592448,"omap_allocated":0,"internal_metadata":3516268544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,0,1,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-228303815,"num_objects":-875,"num_object_clones":0,"num_object_copies":-3274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-875,"num_whiteouts":0,"num_read":5,"num_read_kb":55,"num_write":1197,"num_write_kb":12673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-113,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2183,"num_omap_keys":23,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002279"},"pg_stats":[{"pgid":"4.2","version":"28'28165","reported_seq":"29423","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:29.795467+0000","last_change":"2020-11-20T11:48:09.603681+0000","last_active":"2020-11-20T12:13:29.795467+0000","last_peered":"2020-11-20T12:13:29.795467+0000","last_clean":"2020-11-20T12:13:29.795467+0000","last_became_active":"2020-11-20T11:48:09.603149+0000","last_became_peered":"2020-11-20T11:48:09.603149+0000","last_unstale":"2020-11-20T12:13:29.795467+0000","last_undegraded":"2020-11-20T12:13:29.795467+0000","last_fullsized":"2020-11-20T12:13:29.795467+0000","mapping_epoch":26,"log_start":"28'18154","ondisk_log_start":"28'18154","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_clean_scrub_stamp":"2020-11-20T11:48:08.486179+0000","log_size":10011,"ondisk_log_size":10011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1247,"num_read_kb":71900,"num_write":20182,"num_write_kb":535970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4,7],"acting":[1,8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.493100+0000","last_change":"2020-11-20T11:48:03.440989+0000","last_active":"2020-11-20T11:48:09.493100+0000","last_peered":"2020-11-20T11:48:09.493100+0000","last_clean":"2020-11-20T11:48:09.493100+0000","last_became_active":"2020-11-20T11:48:03.440545+0000","last_became_peered":"2020-11-20T11:48:03.440545+0000","last_unstale":"2020-11-20T11:48:09.493100+0000","last_undegraded":"2020-11-20T11:48:09.493100+0000","last_fullsized":"2020-11-20T11:48:09.493100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_clean_scrub_stamp":"2020-11-20T11:48:02.343998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10],"acting":[9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"28'26306","reported_seq":"26317","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:28.951873+0000","last_change":"2020-11-20T11:48:06.484654+0000","last_active":"2020-11-20T12:13:28.951873+0000","last_peered":"2020-11-20T12:13:28.951873+0000","last_clean":"2020-11-20T12:13:28.951873+0000","last_became_active":"2020-11-20T11:48:06.484261+0000","last_became_peered":"2020-11-20T11:48:06.484261+0000","last_unstale":"2020-11-20T12:13:28.951873+0000","last_undegraded":"2020-11-20T12:13:28.951873+0000","last_fullsized":"2020-11-20T12:13:28.951873+0000","mapping_epoch":23,"log_start":"28'16300","ondisk_log_start":"28'16300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_clean_scrub_stamp":"2020-11-20T11:48:05.473687+0000","log_size":10006,"ondisk_log_size":10006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16777376,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":26397,"num_write_kb":171630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'27002","reported_seq":"28349","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:29.484946+0000","last_change":"2020-11-20T11:48:09.601081+0000","last_active":"2020-11-20T12:13:29.484946+0000","last_peered":"2020-11-20T12:13:29.484946+0000","last_clean":"2020-11-20T12:13:29.484946+0000","last_became_active":"2020-11-20T11:48:09.600693+0000","last_became_peered":"2020-11-20T11:48:09.600693+0000","last_unstale":"2020-11-20T12:13:29.484946+0000","last_undegraded":"2020-11-20T12:13:29.484946+0000","last_fullsized":"2020-11-20T12:13:29.484946+0000","mapping_epoch":26,"log_start":"28'16967","ondisk_log_start":"28'16967","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_clean_scrub_stamp":"2020-11-20T11:48:08.486179+0000","log_size":10035,"ondisk_log_size":10035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1336,"num_read_kb":87000,"num_write":19165,"num_write_kb":539571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,8,10],"acting":[6,0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.495347+0000","last_change":"2020-11-20T11:48:03.364301+0000","last_active":"2020-11-20T11:48:09.495347+0000","last_peered":"2020-11-20T11:48:09.495347+0000","last_clean":"2020-11-20T11:48:09.495347+0000","last_became_active":"2020-11-20T11:48:03.364003+0000","last_became_peered":"2020-11-20T11:48:03.364003+0000","last_unstale":"2020-11-20T11:48:09.495347+0000","last_undegraded":"2020-11-20T11:48:09.495347+0000","last_fullsized":"2020-11-20T11:48:09.495347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_clean_scrub_stamp":"2020-11-20T11:48:02.343998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"28'22122","reported_seq":"22133","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:28.941108+0000","last_change":"2020-11-20T11:48:06.628946+0000","last_active":"2020-11-20T12:13:28.941108+0000","last_peered":"2020-11-20T12:13:28.941108+0000","last_clean":"2020-11-20T12:13:28.941108+0000","last_became_active":"2020-11-20T11:48:06.628670+0000","last_became_peered":"2020-11-20T11:48:06.628670+0000","last_unstale":"2020-11-20T12:13:28.941108+0000","last_undegraded":"2020-11-20T12:13:28.941108+0000","last_fullsized":"2020-11-20T12:13:28.941108+0000","mapping_epoch":23,"log_start":"28'12100","ondisk_log_start":"28'12100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_clean_scrub_stamp":"2020-11-20T11:48:05.473687+0000","log_size":10022,"ondisk_log_size":10022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":37748770,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":22175,"num_write_kb":164436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.7","version":"28'26179","reported_seq":"27710","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:29.620976+0000","last_change":"2020-11-20T11:48:09.598612+0000","last_active":"2020-11-20T12:13:29.620976+0000","last_peered":"2020-11-20T12:13:29.620976+0000","last_clean":"2020-11-20T12:13:29.620976+0000","last_became_active":"2020-11-20T11:48:09.598147+0000","last_became_peered":"2020-11-20T11:48:09.598147+0000","last_unstale":"2020-11-20T12:13:29.620976+0000","last_undegraded":"2020-11-20T12:13:29.620976+0000","last_fullsized":"2020-11-20T12:13:29.620976+0000","mapping_epoch":26,"log_start":"28'16165","ondisk_log_start":"28'16165","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_clean_scrub_stamp":"2020-11-20T11:48:08.486179+0000","log_size":10014,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1520,"num_read_kb":90522,"num_write":18274,"num_write_kb":563834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5,0],"acting":[6,1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.492302+0000","last_change":"2020-11-20T11:48:03.436692+0000","last_active":"2020-11-20T11:48:09.492302+0000","last_peered":"2020-11-20T11:48:09.492302+0000","last_clean":"2020-11-20T11:48:09.492302+0000","last_became_active":"2020-11-20T11:48:03.436251+0000","last_became_peered":"2020-11-20T11:48:03.436251+0000","last_unstale":"2020-11-20T11:48:09.492302+0000","last_undegraded":"2020-11-20T11:48:09.492302+0000","last_fullsized":"2020-11-20T11:48:09.492302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_clean_scrub_stamp":"2020-11-20T11:48:02.343998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"28'18838","reported_seq":"18850","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:28.948659+0000","last_change":"2020-11-20T11:48:06.645759+0000","last_active":"2020-11-20T12:13:28.948659+0000","last_peered":"2020-11-20T12:13:28.948659+0000","last_clean":"2020-11-20T12:13:28.948659+0000","last_became_active":"2020-11-20T11:48:06.645318+0000","last_became_peered":"2020-11-20T11:48:06.645318+0000","last_unstale":"2020-11-20T12:13:28.948659+0000","last_undegraded":"2020-11-20T12:13:28.948659+0000","last_fullsized":"2020-11-20T12:13:28.948659+0000","mapping_epoch":23,"log_start":"28'8800","ondisk_log_start":"28'8800","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_clean_scrub_stamp":"2020-11-20T11:48:05.473687+0000","log_size":10038,"ondisk_log_size":10038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":18953,"num_write_kb":142544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"28'26566","reported_seq":"27855","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:29.438579+0000","last_change":"2020-11-20T11:48:09.600841+0000","last_active":"2020-11-20T12:13:29.438579+0000","last_peered":"2020-11-20T12:13:29.438579+0000","last_clean":"2020-11-20T12:13:29.438579+0000","last_became_active":"2020-11-20T11:48:09.600181+0000","last_became_peered":"2020-11-20T11:48:09.600181+0000","last_unstale":"2020-11-20T12:13:29.438579+0000","last_undegraded":"2020-11-20T12:13:29.438579+0000","last_fullsized":"2020-11-20T12:13:29.438579+0000","mapping_epoch":26,"log_start":"28'16547","ondisk_log_start":"28'16547","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_clean_scrub_stamp":"2020-11-20T11:48:08.486179+0000","log_size":10019,"ondisk_log_size":10019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1278,"num_read_kb":79856,"num_write":18659,"num_write_kb":485186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,4,11],"acting":[5,10,4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.598292+0000","last_change":"2020-11-20T11:48:03.361972+0000","last_active":"2020-11-20T11:48:09.598292+0000","last_peered":"2020-11-20T11:48:09.598292+0000","last_clean":"2020-11-20T11:48:09.598292+0000","last_became_active":"2020-11-20T11:48:03.361549+0000","last_became_peered":"2020-11-20T11:48:03.361549+0000","last_unstale":"2020-11-20T11:48:09.598292+0000","last_undegraded":"2020-11-20T11:48:09.598292+0000","last_fullsized":"2020-11-20T11:48:09.598292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_clean_scrub_stamp":"2020-11-20T11:48:02.343998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"1.0","version":"18'3","reported_seq":"21","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.597862+0000","last_change":"2020-11-20T11:47:58.639760+0000","last_active":"2020-11-20T11:48:09.597862+0000","last_peered":"2020-11-20T11:48:09.597862+0000","last_clean":"2020-11-20T11:48:09.597862+0000","last_became_active":"2020-11-20T11:47:58.639096+0000","last_became_peered":"2020-11-20T11:47:58.639096+0000","last_unstale":"2020-11-20T11:48:09.597862+0000","last_undegraded":"2020-11-20T11:48:09.597862+0000","last_fullsized":"2020-11-20T11:48:09.597862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:47:52.386743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:47:52.386743+0000","last_clean_scrub_stamp":"2020-11-20T11:47:52.386743+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"28'23218","reported_seq":"23229","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:29.023645+0000","last_change":"2020-11-20T11:48:06.725267+0000","last_active":"2020-11-20T12:13:29.023645+0000","last_peered":"2020-11-20T12:13:29.023645+0000","last_clean":"2020-11-20T12:13:29.023645+0000","last_became_active":"2020-11-20T11:48:06.724982+0000","last_became_peered":"2020-11-20T11:48:06.724982+0000","last_unstale":"2020-11-20T12:13:29.023645+0000","last_undegraded":"2020-11-20T12:13:29.023645+0000","last_fullsized":"2020-11-20T12:13:29.023645+0000","mapping_epoch":23,"log_start":"28'13200","ondisk_log_start":"28'13200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_clean_scrub_stamp":"2020-11-20T11:48:05.473687+0000","log_size":10018,"ondisk_log_size":10018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38960552,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":23265,"num_write_kb":170579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"28'26481","reported_seq":"28534","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:29.726036+0000","last_change":"2020-11-20T11:48:09.600385+0000","last_active":"2020-11-20T12:13:29.726036+0000","last_peered":"2020-11-20T12:13:29.726036+0000","last_clean":"2020-11-20T12:13:29.726036+0000","last_became_active":"2020-11-20T11:48:09.599710+0000","last_became_peered":"2020-11-20T11:48:09.599710+0000","last_unstale":"2020-11-20T12:13:29.726036+0000","last_undegraded":"2020-11-20T12:13:29.726036+0000","last_fullsized":"2020-11-20T12:13:29.726036+0000","mapping_epoch":26,"log_start":"28'16449","ondisk_log_start":"28'16449","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_clean_scrub_stamp":"2020-11-20T11:48:08.486179+0000","log_size":10032,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2042,"num_read_kb":123354,"num_write":18484,"num_write_kb":487460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6,11],"acting":[10,9,6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.597758+0000","last_change":"2020-11-20T11:48:03.438147+0000","last_active":"2020-11-20T11:48:09.597758+0000","last_peered":"2020-11-20T11:48:09.597758+0000","last_clean":"2020-11-20T11:48:09.597758+0000","last_became_active":"2020-11-20T11:48:03.437759+0000","last_became_peered":"2020-11-20T11:48:03.437759+0000","last_unstale":"2020-11-20T11:48:09.597758+0000","last_undegraded":"2020-11-20T11:48:09.597758+0000","last_fullsized":"2020-11-20T11:48:09.597758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_clean_scrub_stamp":"2020-11-20T11:48:02.343998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"28'15776","reported_seq":"16650","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:28.894096+0000","last_change":"2020-11-20T11:48:06.485245+0000","last_active":"2020-11-20T12:13:28.894096+0000","last_peered":"2020-11-20T12:13:28.894096+0000","last_clean":"2020-11-20T12:13:28.894096+0000","last_became_active":"2020-11-20T11:48:06.484857+0000","last_became_peered":"2020-11-20T11:48:06.484857+0000","last_unstale":"2020-11-20T12:13:28.894096+0000","last_undegraded":"2020-11-20T12:13:28.894096+0000","last_fullsized":"2020-11-20T12:13:28.894096+0000","mapping_epoch":23,"log_start":"28'5700","ondisk_log_start":"28'5700","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_clean_scrub_stamp":"2020-11-20T11:48:05.473687+0000","log_size":10076,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":863,"num_read_kb":4704,"num_write":15805,"num_write_kb":119765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"28'26399","reported_seq":"28422","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:29.779212+0000","last_change":"2020-11-20T11:48:09.601300+0000","last_active":"2020-11-20T12:13:29.779212+0000","last_peered":"2020-11-20T12:13:29.779212+0000","last_clean":"2020-11-20T12:13:29.779212+0000","last_became_active":"2020-11-20T11:48:09.599735+0000","last_became_peered":"2020-11-20T11:48:09.599735+0000","last_unstale":"2020-11-20T12:13:29.779212+0000","last_undegraded":"2020-11-20T12:13:29.779212+0000","last_fullsized":"2020-11-20T12:13:29.779212+0000","mapping_epoch":26,"log_start":"28'16359","ondisk_log_start":"28'16359","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_clean_scrub_stamp":"2020-11-20T11:48:08.486179+0000","log_size":10040,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2012,"num_read_kb":122872,"num_write":18367,"num_write_kb":513978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,11,6],"acting":[1,4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.596913+0000","last_change":"2020-11-20T11:48:03.435827+0000","last_active":"2020-11-20T11:48:09.596913+0000","last_peered":"2020-11-20T11:48:09.596913+0000","last_clean":"2020-11-20T11:48:09.596913+0000","last_became_active":"2020-11-20T11:48:03.435438+0000","last_became_peered":"2020-11-20T11:48:03.435438+0000","last_unstale":"2020-11-20T11:48:09.596913+0000","last_undegraded":"2020-11-20T11:48:09.596913+0000","last_fullsized":"2020-11-20T11:48:09.596913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_clean_scrub_stamp":"2020-11-20T11:48:02.343998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"28'21914","reported_seq":"22464","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:28.934308+0000","last_change":"2020-11-20T11:48:06.484739+0000","last_active":"2020-11-20T12:13:28.934308+0000","last_peered":"2020-11-20T12:13:28.934308+0000","last_clean":"2020-11-20T12:13:28.934308+0000","last_became_active":"2020-11-20T11:48:06.484250+0000","last_became_peered":"2020-11-20T11:48:06.484250+0000","last_unstale":"2020-11-20T12:13:28.934308+0000","last_undegraded":"2020-11-20T12:13:28.934308+0000","last_fullsized":"2020-11-20T12:13:28.934308+0000","mapping_epoch":23,"log_start":"28'11900","ondisk_log_start":"28'11900","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_clean_scrub_stamp":"2020-11-20T11:48:05.473687+0000","log_size":10014,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":58179308,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":539,"num_read_kb":3921,"num_write":21970,"num_write_kb":180364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"28'27292","reported_seq":"28491","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:29.614109+0000","last_change":"2020-11-20T11:48:09.599059+0000","last_active":"2020-11-20T12:13:29.614109+0000","last_peered":"2020-11-20T12:13:29.614109+0000","last_clean":"2020-11-20T12:13:29.614109+0000","last_became_active":"2020-11-20T11:48:09.598112+0000","last_became_peered":"2020-11-20T11:48:09.598112+0000","last_unstale":"2020-11-20T12:13:29.614109+0000","last_undegraded":"2020-11-20T12:13:29.614109+0000","last_fullsized":"2020-11-20T12:13:29.614109+0000","mapping_epoch":26,"log_start":"28'17256","ondisk_log_start":"28'17256","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_clean_scrub_stamp":"2020-11-20T11:48:08.486179+0000","log_size":10036,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1188,"num_read_kb":87936,"num_write":19495,"num_write_kb":508885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"28'14075","reported_seq":"14683","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:28.945251+0000","last_change":"2020-11-20T11:48:06.645335+0000","last_active":"2020-11-20T12:13:28.945251+0000","last_peered":"2020-11-20T12:13:28.945251+0000","last_clean":"2020-11-20T12:13:28.945251+0000","last_became_active":"2020-11-20T11:48:06.644950+0000","last_became_peered":"2020-11-20T11:48:06.644950+0000","last_unstale":"2020-11-20T12:13:28.945251+0000","last_undegraded":"2020-11-20T12:13:28.945251+0000","last_fullsized":"2020-11-20T12:13:28.945251+0000","mapping_epoch":23,"log_start":"28'4000","ondisk_log_start":"28'4000","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:05.473687+0000","last_clean_scrub_stamp":"2020-11-20T11:48:05.473687+0000","log_size":10075,"ondisk_log_size":10075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":29360703,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":602,"num_read_kb":4468,"num_write":14198,"num_write_kb":107079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.493229+0000","last_change":"2020-11-20T11:48:03.441004+0000","last_active":"2020-11-20T11:48:09.493229+0000","last_peered":"2020-11-20T11:48:09.493229+0000","last_clean":"2020-11-20T11:48:09.493229+0000","last_became_active":"2020-11-20T11:48:03.440579+0000","last_became_peered":"2020-11-20T11:48:03.440579+0000","last_unstale":"2020-11-20T11:48:09.493229+0000","last_undegraded":"2020-11-20T11:48:09.493229+0000","last_fullsized":"2020-11-20T11:48:09.493229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_clean_scrub_stamp":"2020-11-20T11:48:02.343998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10],"acting":[9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1","version":"28'27318","reported_seq":"28457","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:29.711044+0000","last_change":"2020-11-20T11:48:09.625378+0000","last_active":"2020-11-20T12:13:29.711044+0000","last_peered":"2020-11-20T12:13:29.711044+0000","last_clean":"2020-11-20T12:13:29.711044+0000","last_became_active":"2020-11-20T11:48:09.624778+0000","last_became_peered":"2020-11-20T11:48:09.624778+0000","last_unstale":"2020-11-20T12:13:29.711044+0000","last_undegraded":"2020-11-20T12:13:29.711044+0000","last_fullsized":"2020-11-20T12:13:29.711044+0000","mapping_epoch":26,"log_start":"28'17276","ondisk_log_start":"28'17276","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_clean_scrub_stamp":"2020-11-20T11:48:08.486179+0000","log_size":10042,"ondisk_log_size":10042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1128,"num_read_kb":64348,"num_write":19481,"num_write_kb":566162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,11,8],"acting":[4,2,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"15","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T11:48:09.597648+0000","last_change":"2020-11-20T11:48:03.359921+0000","last_active":"2020-11-20T11:48:09.597648+0000","last_peered":"2020-11-20T11:48:09.597648+0000","last_clean":"2020-11-20T11:48:09.597648+0000","last_became_active":"2020-11-20T11:48:03.359617+0000","last_became_peered":"2020-11-20T11:48:03.359617+0000","last_unstale":"2020-11-20T11:48:09.597648+0000","last_undegraded":"2020-11-20T11:48:09.597648+0000","last_fullsized":"2020-11-20T11:48:09.597648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:02.343998+0000","last_clean_scrub_stamp":"2020-11-20T11:48:02.343998+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.6","version":"28'21169","reported_seq":"21183","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:32.913111+0000","last_change":"2020-11-20T12:13:32.913169+0000","last_active":"2020-11-20T12:13:32.913111+0000","last_peered":"2020-11-20T12:13:32.913111+0000","last_clean":"2020-11-20T12:13:32.913111+0000","last_became_active":"2020-11-20T11:48:06.483910+0000","last_became_peered":"2020-11-20T11:48:06.483910+0000","last_unstale":"2020-11-20T12:13:32.913111+0000","last_undegraded":"2020-11-20T12:13:32.913111+0000","last_fullsized":"2020-11-20T12:13:32.913111+0000","mapping_epoch":23,"log_start":"28'11100","ondisk_log_start":"28'11100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'21169","last_scrub_stamp":"2020-11-20T12:13:32.913105+0000","last_deep_scrub":"28'21169","last_deep_scrub_stamp":"2020-11-20T12:13:32.913105+0000","last_clean_scrub_stamp":"2020-11-20T12:13:32.913105+0000","log_size":10069,"ondisk_log_size":10069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25165824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21811,"num_write_kb":153246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2183,"num_omap_keys":23,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11751,"num_read_kb":727788,"num_write":152107,"num_write_kb":4201046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80229,"ondisk_log_size":80229,"up":32,"acting":32,"num_store_stats":12},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":239746965,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":2017,"num_read_kb":13093,"num_write":164574,"num_write_kb":1209643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2183,"num_omap_keys":23,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":367804416,"data_stored":479493930,"data_compressed":52834740,"data_compressed_allocated":111747072,"data_compressed_original":223494144,"omap_allocated":0,"internal_metadata":0},"log_size":80318,"ondisk_log_size":80318,"up":16,"acting":16,"num_store_stats":9},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":10}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444341,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":444368,"kb_used_data":49224,"kb_used_omap":0,"kb_used_meta":395136,"kb_avail":93927472,"statfs":{"total":96636764160,"available":96181731328,"internally_reserved":0,"allocated":50405376,"data_stored":63050557,"data_compressed":6045917,"data_compressed_allocated":12808192,"data_compressed_original":25616384,"omap_allocated":0,"internal_metadata":404619264},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":1.1359999999999999,"15min":0.99199999999999999},"min":{"1min":0.57499999999999996,"5min":0.55600000000000005,"15min":0.53300000000000003},"max":{"1min":2.323,"5min":12.345000000000001,"15min":12.345000000000001},"last":1.272},{"interface":"front","average":{"1min":1.419,"5min":1.1990000000000001,"15min":1.0589999999999999},"min":{"1min":0.628,"5min":0.57799999999999996,"15min":0.54800000000000004},"max":{"1min":3.722,"5min":12.679,"15min":12.679},"last":1.085}]},{"osd":1,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.143,"15min":1.1930000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58099999999999996},"max":{"1min":4.1580000000000004,"5min":12.709,"15min":12.709},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.379,"15min":2.9710000000000001},"min":{"1min":0.628,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.3180000000000001,"5min":12.489000000000001,"15min":285.29500000000002},"last":0.82099999999999995}]},{"osd":2,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.393,"15min":1.224},"min":{"1min":0.69699999999999995,"5min":0.56999999999999995,"15min":0.55600000000000005},"max":{"1min":4.4950000000000001,"5min":12.311,"15min":12.311},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.528,"5min":1.399,"15min":1.246},"min":{"1min":0.67200000000000004,"5min":0.624,"15min":0.59099999999999997},"max":{"1min":4.9370000000000003,"5min":12.285,"15min":12.285},"last":1.147}]},{"osd":3,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.5,"15min":1.742},"min":{"1min":0.80500000000000005,"5min":0.621,"15min":0.621},"max":{"1min":4.4219999999999997,"5min":12.523999999999999,"15min":90.236999999999995},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.6319999999999999,"15min":1.8540000000000001},"min":{"1min":0.95799999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":2.4159999999999999,"5min":12.629,"15min":90.265000000000001},"last":1.377}]},{"osd":4,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.849,"15min":2.113},"min":{"1min":0.83299999999999996,"5min":0.81499999999999995,"15min":0.76800000000000002},"max":{"1min":2.7869999999999999,"5min":12.944000000000001,"15min":120.355},"last":1.125},{"interface":"front","average":{"1min":1.9770000000000001,"5min":1.829,"15min":1.6379999999999999},"min":{"1min":1.0289999999999999,"5min":0.89900000000000002,"15min":0.79500000000000004},"max":{"1min":5.242,"5min":12.964,"15min":12.964},"last":1.2190000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":1.7110000000000001,"5min":1.7430000000000001,"15min":1.593},"min":{"1min":0.83099999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":4.6360000000000001,"5min":12.843999999999999,"15min":12.843999999999999},"last":1.296},{"interface":"front","average":{"1min":1.849,"5min":1.9530000000000001,"15min":1.9650000000000001},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.85699999999999998},"max":{"1min":5.2949999999999999,"5min":13.067,"15min":68.132000000000005},"last":1.4570000000000001}]},{"osd":6,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":1.883,"5min":1.7669999999999999,"15min":1.782},"min":{"1min":1.157,"5min":1.0649999999999999,"15min":1.0189999999999999},"max":{"1min":4.3730000000000002,"5min":12.826000000000001,"15min":12.826000000000001},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.768,"5min":1.829,"15min":1.7190000000000001},"min":{"1min":1.0669999999999999,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":4.5309999999999997,"5min":12.98,"15min":12.98},"last":1.5720000000000001}]},{"osd":7,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":2.1139999999999999,"5min":1.978,"15min":1.857},"min":{"1min":1.292,"5min":0.96699999999999997,"15min":0.96699999999999997},"max":{"1min":4.6139999999999999,"5min":13.167999999999999,"15min":13.167999999999999},"last":1.401},{"interface":"front","average":{"1min":2.0470000000000002,"5min":2.105,"15min":1.946},"min":{"1min":1.139,"5min":1.0860000000000001,"15min":1.0860000000000001},"max":{"1min":4.7380000000000004,"5min":13.102,"15min":13.102},"last":1.704}]},{"osd":8,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":1.6459999999999999,"5min":1.9750000000000001,"15min":1.8360000000000001},"min":{"1min":1.179,"5min":1.141,"15min":1.016},"max":{"1min":2.5539999999999998,"5min":13.148,"15min":13.148},"last":1.55},{"interface":"front","average":{"1min":2.153,"5min":1.9299999999999999,"15min":1.8200000000000001},"min":{"1min":1.2569999999999999,"5min":1.0680000000000001,"15min":1.0389999999999999},"max":{"1min":4.7279999999999998,"5min":13.086,"15min":13.086},"last":1.669}]},{"osd":10,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":2.262,"5min":2.2069999999999999,"15min":2.0070000000000001},"min":{"1min":1.2849999999999999,"5min":1.254,"15min":1.1639999999999999},"max":{"1min":7.6239999999999997,"5min":13.220000000000001,"15min":13.220000000000001},"last":1.643},{"interface":"front","average":{"1min":2.488,"5min":2.2829999999999999,"15min":2.0979999999999999},"min":{"1min":1.3999999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"max":{"1min":6.9320000000000004,"5min":13.233000000000001,"15min":19.605},"last":1.7729999999999999}]}]},{"osd":10,"up_from":17,"seq":73014444342,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127908,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":127616,"kb_avail":94243932,"statfs":{"total":96636764160,"available":96505786368,"internally_reserved":0,"allocated":290816,"data_stored":135963,"data_compressed":2789,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":130678784},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:12:43 2020","interfaces":[{"interface":"back","average":{"1min":1.986,"5min":1.5960000000000001,"15min":1.3069999999999999},"min":{"1min":0.61199999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":4.5570000000000004,"5min":7.4349999999999996,"15min":8.9849999999999994},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.944,"5min":1.5249999999999999,"15min":1.232},"min":{"1min":0.752,"5min":0.60999999999999999,"15min":0.60199999999999998},"max":{"1min":4.766,"5min":6.7789999999999999,"15min":6.7789999999999999},"last":0.72699999999999998}]},{"osd":1,"last update":"Fri Nov 20 12:12:43 2020","interfaces":[{"interface":"back","average":{"1min":2.2970000000000002,"5min":2.1040000000000001,"15min":1.754},"min":{"1min":0.71999999999999997,"5min":0.66300000000000003,"15min":0.58699999999999997},"max":{"1min":4.7149999999999999,"5min":12.619999999999999,"15min":12.619999999999999},"last":1.0840000000000001},{"interface":"front","average":{"1min":2.6139999999999999,"5min":1.96,"15min":1.732},"min":{"1min":0.876,"5min":0.70899999999999996,"15min":0.58899999999999997},"max":{"1min":5.1890000000000001,"5min":6.6509999999999998,"15min":10.332000000000001},"last":1.014}]},{"osd":2,"last update":"Fri Nov 20 12:12:43 2020","interfaces":[{"interface":"back","average":{"1min":2.5939999999999999,"5min":1.696,"15min":1.458},"min":{"1min":0.89200000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":5.3520000000000003,"5min":6.601,"15min":6.601},"last":1.056},{"interface":"front","average":{"1min":2.4009999999999998,"5min":2.044,"15min":1.7330000000000001},"min":{"1min":0.98999999999999999,"5min":0.89600000000000002,"15min":0.79600000000000004},"max":{"1min":5.1079999999999997,"5min":7.718,"15min":13.505000000000001},"last":1.353}]},{"osd":3,"last update":"Fri Nov 20 12:12:43 2020","interfaces":[{"interface":"back","average":{"1min":2.5009999999999999,"5min":2.0760000000000001,"15min":1.7929999999999999},"min":{"1min":1.2450000000000001,"5min":0.92600000000000005,"15min":0.69399999999999995},"max":{"1min":5.8769999999999998,"5min":8.4529999999999994,"15min":12.358000000000001},"last":1.151},{"interface":"front","average":{"1min":2.8119999999999998,"5min":1.956,"15min":1.671},"min":{"1min":0.70599999999999996,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":5.4960000000000004,"5min":6.8540000000000001,"15min":6.8540000000000001},"last":0.81100000000000005}]},{"osd":4,"last update":"Fri Nov 20 12:12:43 2020","interfaces":[{"interface":"back","average":{"1min":2.6739999999999999,"5min":2.4780000000000002,"15min":2.1970000000000001},"min":{"1min":1.1299999999999999,"5min":0.95699999999999996,"15min":0.85799999999999998},"max":{"1min":5.9219999999999997,"5min":8.4710000000000001,"15min":26.497},"last":1.456},{"interface":"front","average":{"1min":2.9580000000000002,"5min":2.5139999999999998,"15min":2.117},"min":{"1min":1.548,"5min":1.0589999999999999,"15min":0.79000000000000004},"max":{"1min":6.2590000000000003,"5min":10.172000000000001,"15min":10.478999999999999},"last":1.258}]},{"osd":5,"last update":"Fri Nov 20 12:12:43 2020","interfaces":[{"interface":"back","average":{"1min":2.8780000000000001,"5min":2.3940000000000001,"15min":2.0779999999999998},"min":{"1min":1.133,"5min":1.133,"15min":1.0760000000000001},"max":{"1min":6.3609999999999998,"5min":7.8479999999999999,"15min":13.752000000000001},"last":1.232},{"interface":"front","average":{"1min":2.7010000000000001,"5min":2.3700000000000001,"15min":2.097},"min":{"1min":1.3640000000000001,"5min":1.165,"15min":1.0580000000000001},"max":{"1min":6.0030000000000001,"5min":8.4529999999999994,"15min":12.118},"last":1.3839999999999999}]},{"osd":6,"last update":"Fri Nov 20 12:12:43 2020","interfaces":[{"interface":"back","average":{"1min":2.9929999999999999,"5min":2.242,"15min":1.9379999999999999},"min":{"1min":1.091,"5min":0.88600000000000001,"15min":0.85899999999999999},"max":{"1min":5.7450000000000001,"5min":7.5549999999999997,"15min":7.5549999999999997},"last":0.97499999999999998},{"interface":"front","average":{"1min":2.7589999999999999,"5min":2.504,"15min":2.2469999999999999},"min":{"1min":1.252,"5min":1.145,"15min":1.054},"max":{"1min":5.3789999999999996,"5min":9.9580000000000002,"15min":13.630000000000001},"last":1.548}]},{"osd":7,"last update":"Fri Nov 20 12:12:43 2020","interfaces":[{"interface":"back","average":{"1min":3.0470000000000002,"5min":2.633,"15min":2.3239999999999998},"min":{"1min":1.613,"5min":1.248,"15min":1.1839999999999999},"max":{"1min":6.1900000000000004,"5min":8.8710000000000004,"15min":11.385999999999999},"last":1.516},{"interface":"front","average":{"1min":3.3109999999999999,"5min":2.5169999999999999,"15min":2.2839999999999998},"min":{"1min":1.2,"5min":1.012,"15min":0.94899999999999995},"max":{"1min":5.9219999999999997,"5min":7.7830000000000004,"15min":20.707000000000001},"last":1.1830000000000001}]},{"osd":9,"last update":"Fri Nov 20 12:12:43 2020","interfaces":[{"interface":"back","average":{"1min":3.3820000000000001,"5min":2.544,"15min":2.222},"min":{"1min":1.484,"5min":1.113,"15min":1.034},"max":{"1min":5.7679999999999998,"5min":7.6699999999999999,"15min":11.432},"last":1.284},{"interface":"front","average":{"1min":2.8969999999999998,"5min":2.5920000000000001,"15min":2.2629999999999999},"min":{"1min":1.363,"5min":1.351,"15min":1.1519999999999999},"max":{"1min":6.4989999999999997,"5min":8.2859999999999996,"15min":13.865},"last":1.649}]},{"osd":11,"last update":"Fri Nov 20 12:12:43 2020","interfaces":[{"interface":"back","average":{"1min":2.9239999999999999,"5min":2.5859999999999999,"15min":2.25},"min":{"1min":1.4930000000000001,"5min":1.2729999999999999,"15min":1.268},"max":{"1min":6.1150000000000002,"5min":8.6549999999999994,"15min":10.875},"last":1.6180000000000001},{"interface":"front","average":{"1min":3.3479999999999999,"5min":2.5750000000000002,"15min":2.2599999999999998},"min":{"1min":1.3660000000000001,"5min":1.1279999999999999,"15min":1.101},"max":{"1min":5.8179999999999996,"5min":7.9109999999999996,"15min":11.536},"last":1.4159999999999999}]}]},{"osd":9,"up_from":17,"seq":73014444341,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45668,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":45376,"kb_avail":94326172,"statfs":{"total":96636764160,"available":96590000128,"internally_reserved":0,"allocated":290816,"data_stored":135963,"data_compressed":2789,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":46465024},"hb_peers":[0,1,2,3,4,5,6,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:12:57 2020","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.095,"15min":1.123},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":3.3069999999999999,"5min":5.5289999999999999,"15min":8.7680000000000007},"last":0.70099999999999996},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1879999999999999,"15min":1.2789999999999999},"min":{"1min":0.72799999999999998,"5min":0.627,"15min":0.627},"max":{"1min":3.3730000000000002,"5min":5.4500000000000002,"15min":9.0199999999999996},"last":0.83799999999999997}]},{"osd":1,"last update":"Fri Nov 20 12:12:57 2020","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.9370000000000001,"15min":2.0790000000000002},"min":{"1min":0.627,"5min":0.627,"15min":0.59699999999999998},"max":{"1min":6.2560000000000002,"5min":66.763000000000005,"15min":126.151},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.601,"15min":1.625},"min":{"1min":0.753,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.0579999999999998,"5min":6.556,"15min":31.262},"last":1.1020000000000001}]},{"osd":2,"last update":"Fri Nov 20 12:12:57 2020","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.339,"15min":1.379},"min":{"1min":0.75,"5min":0.67400000000000004,"15min":0.67100000000000004},"max":{"1min":2.6619999999999999,"5min":4.0179999999999998,"15min":8.9760000000000009},"last":1.208},{"interface":"front","average":{"1min":1.5720000000000001,"5min":1.4670000000000001,"15min":1.524},"min":{"1min":0.96399999999999997,"5min":0.748,"15min":0.69899999999999995},"max":{"1min":6.9359999999999999,"5min":6.9359999999999999,"15min":9.0449999999999999},"last":1.244}]},{"osd":3,"last update":"Fri Nov 20 12:12:57 2020","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.2310000000000001,"15min":1.3899999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.61599999999999999},"max":{"1min":2.262,"5min":6.3440000000000003,"15min":8.7949999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":1.476,"5min":1.643,"15min":1.7110000000000001},"min":{"1min":0.94599999999999995,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":2.7879999999999998,"5min":6.2050000000000001,"15min":9.2219999999999995},"last":1.026}]},{"osd":4,"last update":"Fri Nov 20 12:12:57 2020","interfaces":[{"interface":"back","average":{"1min":1.7729999999999999,"5min":1.891,"15min":1.7569999999999999},"min":{"1min":1.1180000000000001,"5min":0.93200000000000005,"15min":0.61599999999999999},"max":{"1min":6.8019999999999996,"5min":6.8259999999999996,"15min":9.6609999999999996},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.7450000000000001,"5min":1.665,"15min":1.7010000000000001},"min":{"1min":0.73099999999999998,"5min":0.65500000000000003,"15min":0.65200000000000002},"max":{"1min":4.2649999999999997,"5min":6.0810000000000004,"15min":9.2829999999999995},"last":0.996}]},{"osd":5,"last update":"Fri Nov 20 12:12:57 2020","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.554,"15min":1.6379999999999999},"min":{"1min":0.872,"5min":0.872,"15min":0.746},"max":{"1min":1.96,"5min":6.0170000000000003,"15min":9.1519999999999992},"last":1.083},{"interface":"front","average":{"1min":1.619,"5min":1.8220000000000001,"15min":1.804},"min":{"1min":1.097,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":2.903,"5min":6.3310000000000004,"15min":9.0980000000000008},"last":1.1319999999999999}]},{"osd":6,"last update":"Fri Nov 20 12:12:57 2020","interfaces":[{"interface":"back","average":{"1min":1.835,"5min":1.978,"15min":2.0169999999999999},"min":{"1min":1.23,"5min":1.0109999999999999,"15min":0.84499999999999997},"max":{"1min":3.238,"5min":6.5890000000000004,"15min":9.8030000000000008},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.782,"5min":1.9470000000000001,"15min":1.95},"min":{"1min":1.2509999999999999,"5min":1.115,"15min":1.03},"max":{"1min":3.4889999999999999,"5min":7.2110000000000003,"15min":10.294},"last":1.405}]},{"osd":8,"last update":"Fri Nov 20 12:12:57 2020","interfaces":[{"interface":"back","average":{"1min":1.7090000000000001,"5min":1.901,"15min":1.9099999999999999},"min":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":0.96899999999999997},"max":{"1min":3.359,"5min":6.9560000000000004,"15min":10.076000000000001},"last":1.651},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.72,"15min":1.861},"min":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"max":{"1min":2.0979999999999999,"5min":5.226,"15min":9.5210000000000008},"last":1.3080000000000001}]},{"osd":10,"last update":"Fri Nov 20 12:12:57 2020","interfaces":[{"interface":"back","average":{"1min":2.161,"5min":2.226,"15min":2.0990000000000002},"min":{"1min":1.1830000000000001,"5min":1.139,"15min":1.1359999999999999},"max":{"1min":4.9880000000000004,"5min":7.0339999999999998,"15min":9.4830000000000005},"last":1.286},{"interface":"front","average":{"1min":2.4590000000000001,"5min":2.242,"15min":2.0830000000000002},"min":{"1min":1.359,"5min":1.2010000000000001,"15min":1.093},"max":{"1min":9.3160000000000007,"5min":9.3160000000000007,"15min":10.202999999999999},"last":1.53}]},{"osd":11,"last update":"Fri Nov 20 12:12:57 2020","interfaces":[{"interface":"back","average":{"1min":1.754,"5min":1.833,"15min":1.962},"min":{"1min":1.129,"5min":1.1100000000000001,"15min":1.1100000000000001},"max":{"1min":4.8920000000000003,"5min":5.4450000000000003,"15min":9.4060000000000006},"last":1.385},{"interface":"front","average":{"1min":1.8919999999999999,"5min":2.052,"15min":2.0830000000000002},"min":{"1min":1.2809999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"max":{"1min":3.8809999999999998,"5min":8.5890000000000004,"15min":9.6059999999999999},"last":1.3640000000000001}]}]},{"osd":8,"up_from":17,"seq":73014444342,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":309488,"kb_used_data":30056,"kb_used_omap":0,"kb_used_meta":279424,"kb_avail":94062352,"statfs":{"total":96636764160,"available":96319848448,"internally_reserved":0,"allocated":30777344,"data_stored":37884733,"data_compressed":3425241,"data_compressed_allocated":7270400,"data_compressed_original":14540800,"omap_allocated":0,"internal_metadata":286130176},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":0.93999999999999995,"15min":0.94899999999999995},"min":{"1min":0.55800000000000005,"5min":0.55600000000000005,"15min":0.54500000000000004},"max":{"1min":2.589,"5min":4.7709999999999999,"15min":8.4719999999999995},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.1559999999999999,"15min":1.0600000000000001},"min":{"1min":0.57799999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":5.1909999999999998,"5min":6.3029999999999999,"15min":6.3029999999999999},"last":1.538}]},{"osd":1,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.3799999999999999,"15min":1.1319999999999999},"min":{"1min":0.60499999999999998,"5min":0.58999999999999997,"15min":0.56000000000000005},"max":{"1min":4.5449999999999999,"5min":13.785,"15min":13.785},"last":1.7230000000000001},{"interface":"front","average":{"1min":1.385,"5min":1.546,"15min":1.3320000000000001},"min":{"1min":0.79500000000000004,"5min":0.59299999999999997,"15min":0.59099999999999997},"max":{"1min":3.0179999999999998,"5min":14.462999999999999,"15min":14.462999999999999},"last":2.7650000000000001}]},{"osd":2,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":1.5700000000000001,"5min":1.3380000000000001,"15min":1.1970000000000001},"min":{"1min":0.70199999999999996,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":5.5419999999999998,"5min":6.444,"15min":6.444},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.3799999999999999,"15min":1.258},"min":{"1min":0.627,"5min":0.60399999999999998,"15min":0.56100000000000005},"max":{"1min":3.1080000000000001,"5min":5.5149999999999997,"15min":5.5149999999999997},"last":2.093}]},{"osd":3,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.482,"15min":1.3819999999999999},"min":{"1min":0.70499999999999996,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":5.4180000000000001,"5min":5.4180000000000001,"15min":5.4180000000000001},"last":1.9770000000000001},{"interface":"front","average":{"1min":1.486,"5min":1.6799999999999999,"15min":1.482},"min":{"1min":0.89600000000000002,"5min":0.82399999999999995,"15min":0.73199999999999998},"max":{"1min":2.6890000000000001,"5min":29.010999999999999,"15min":29.010999999999999},"last":1.143}]},{"osd":4,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":1.8440000000000001,"5min":1.675,"15min":1.9530000000000001},"min":{"1min":0.91500000000000004,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":5.4589999999999996,"5min":5.4589999999999996,"15min":54.881},"last":1.042},{"interface":"front","average":{"1min":2.0880000000000001,"5min":1.786,"15min":1.952},"min":{"1min":1.0760000000000001,"5min":0.875,"15min":0.85199999999999998},"max":{"1min":5.6710000000000003,"5min":6.5679999999999996,"15min":55.497},"last":1.9410000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":1.8049999999999999,"5min":1.9410000000000001,"15min":1.9239999999999999},"min":{"1min":0.96599999999999997,"5min":0.92500000000000004,"15min":0.86499999999999999},"max":{"1min":5.944,"5min":8.7219999999999995,"15min":54.777000000000001},"last":2.601},{"interface":"front","average":{"1min":1.784,"5min":1.861,"15min":1.9550000000000001},"min":{"1min":1.095,"5min":1.095,"15min":0.84899999999999998},"max":{"1min":3.371,"5min":8.7609999999999992,"15min":54.634999999999998},"last":1.669}]},{"osd":7,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":2.1829999999999998,"5min":2.0209999999999999,"15min":2.0049999999999999},"min":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"max":{"1min":5.9880000000000004,"5min":6.702,"15min":55.015999999999998},"last":2.2879999999999998},{"interface":"front","average":{"1min":2.0830000000000002,"5min":1.9370000000000001,"15min":2.0019999999999998},"min":{"1min":1.042,"5min":1.042,"15min":1.042},"max":{"1min":5.7729999999999997,"5min":5.7729999999999997,"15min":54.698},"last":2.3300000000000001}]},{"osd":9,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":1.794,"5min":1.7490000000000001,"15min":1.944},"min":{"1min":1.04,"5min":1.04,"15min":1.04},"max":{"1min":3.1269999999999998,"5min":4.8869999999999996,"15min":54.500999999999998},"last":1.2470000000000001},{"interface":"front","average":{"1min":2.0070000000000001,"5min":1.8380000000000001,"15min":1.9690000000000001},"min":{"1min":1.155,"5min":1.048,"15min":1.048},"max":{"1min":5.7969999999999997,"5min":6.8280000000000003,"15min":55.392000000000003},"last":2.0569999999999999}]},{"osd":10,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":2.137,"5min":2.1520000000000001,"15min":2.1469999999999998},"min":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.0580000000000001},"max":{"1min":5.8209999999999997,"5min":6.3700000000000001,"15min":54.901000000000003},"last":2.2349999999999999},{"interface":"front","average":{"1min":1.911,"5min":2.081,"15min":2.1139999999999999},"min":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.1559999999999999},"max":{"1min":3.7240000000000002,"5min":10.696999999999999,"15min":54.753},"last":1.345}]},{"osd":11,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":2.1309999999999998,"5min":1.97,"15min":2.0219999999999998},"min":{"1min":1.077,"5min":1.077,"15min":1.077},"max":{"1min":6.5149999999999997,"5min":6.9530000000000003,"15min":55.133000000000003},"last":2.1829999999999998},{"interface":"front","average":{"1min":2.0409999999999999,"5min":1.9610000000000001,"15min":2.0350000000000001},"min":{"1min":1.111,"5min":1.111,"15min":1.095},"max":{"1min":5.5700000000000003,"5min":5.7270000000000003,"15min":54.609999999999999},"last":2.3980000000000001}]}]},{"osd":7,"up_from":17,"seq":73014444342,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":283572,"kb_used_data":28012,"kb_used_omap":0,"kb_used_meta":255552,"kb_avail":94088268,"statfs":{"total":96636764160,"available":96346386432,"internally_reserved":0,"allocated":28684288,"data_stored":37885274,"data_compressed":4461955,"data_compressed_allocated":9367552,"data_compressed_original":18735104,"omap_allocated":0,"internal_metadata":261685248},"hb_peers":[0,1,2,3,4,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.3180000000000001,"15min":1.117},"min":{"1min":0.67400000000000004,"5min":0.63500000000000001,"15min":0.60099999999999998},"max":{"1min":5.9260000000000002,"5min":6.5129999999999999,"15min":6.5129999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.4470000000000001,"15min":1.3120000000000001},"min":{"1min":0.80100000000000005,"5min":0.71299999999999997,"15min":0.67100000000000004},"max":{"1min":3.927,"5min":5.508,"15min":8.5229999999999997},"last":1.054}]},{"osd":1,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.54,"15min":1.401},"min":{"1min":0.64500000000000002,"5min":0.60199999999999998,"15min":0.57099999999999995},"max":{"1min":3.8420000000000001,"5min":7.7850000000000001,"15min":27.488},"last":0.745},{"interface":"front","average":{"1min":1.6639999999999999,"5min":2.6480000000000001,"15min":1.9950000000000001},"min":{"1min":0.68899999999999995,"5min":0.61299999999999999,"15min":0.55200000000000005},"max":{"1min":4.5419999999999998,"5min":71.591999999999999,"15min":71.591999999999999},"last":0.71999999999999997}]},{"osd":2,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":2.1659999999999999,"5min":1.8029999999999999,"15min":1.4750000000000001},"min":{"1min":0.97999999999999998,"5min":0.81399999999999995,"15min":0.55800000000000005},"max":{"1min":6.2359999999999998,"5min":6.9569999999999999,"15min":6.9569999999999999},"last":1.331},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.728,"15min":1.516},"min":{"1min":0.86799999999999999,"5min":0.82499999999999996,"15min":0.63100000000000001},"max":{"1min":2.2229999999999999,"5min":7.4569999999999999,"15min":12.949999999999999},"last":1.2689999999999999}]},{"osd":3,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":1.804,"5min":1.8859999999999999,"15min":1.6879999999999999},"min":{"1min":0.90100000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":5.4349999999999996,"5min":6.8529999999999998,"15min":8.6959999999999997},"last":1.29},{"interface":"front","average":{"1min":2.5510000000000002,"5min":2.1339999999999999,"15min":1.774},"min":{"1min":0.97399999999999998,"5min":0.91000000000000003,"15min":0.748},"max":{"1min":6.6500000000000004,"5min":6.8289999999999997,"15min":6.8479999999999999},"last":1.228}]},{"osd":4,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":2.2530000000000001,"5min":2.028,"15min":1.8400000000000001},"min":{"1min":0.76000000000000001,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":6.4930000000000003,"5min":7.5350000000000001,"15min":26.966000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":2.347,"5min":2.3279999999999998,"15min":2.0870000000000002},"min":{"1min":1.149,"5min":0.876,"15min":0.78900000000000003},"max":{"1min":8.6560000000000006,"5min":8.6560000000000006,"15min":26.786999999999999},"last":1.4430000000000001}]},{"osd":6,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":2.573,"5min":2.4470000000000001,"15min":1.9950000000000001},"min":{"1min":0.995,"5min":0.995,"15min":0.66000000000000003},"max":{"1min":6.3849999999999998,"5min":10.233000000000001,"15min":10.233000000000001},"last":1.121},{"interface":"front","average":{"1min":1.9710000000000001,"5min":2.109,"15min":1.839},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.75800000000000001},"max":{"1min":6.3479999999999999,"5min":7.5990000000000002,"15min":11.321},"last":1.1399999999999999}]},{"osd":8,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":2.2040000000000002,"5min":2.1970000000000001,"15min":1.992},"min":{"1min":0.999,"5min":0.999,"15min":0.92400000000000004},"max":{"1min":7.0549999999999997,"5min":7.1020000000000003,"15min":8.843},"last":1.6890000000000001},{"interface":"front","average":{"1min":2.7370000000000001,"5min":2.4039999999999999,"15min":2.036},"min":{"1min":1.212,"5min":1.1910000000000001,"15min":0.874},"max":{"1min":6.5990000000000002,"5min":7.2930000000000001,"15min":9.2720000000000002},"last":1.5800000000000001}]},{"osd":9,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":2.7850000000000001,"5min":2.5379999999999998,"15min":2.1560000000000001},"min":{"1min":1.395,"5min":1.21,"15min":1.032},"max":{"1min":6.7709999999999999,"5min":7.3479999999999999,"15min":7.5979999999999999},"last":1.421},{"interface":"front","average":{"1min":2.5059999999999998,"5min":2.3919999999999999,"15min":2.0329999999999999},"min":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":0.97199999999999998},"max":{"1min":7.1719999999999997,"5min":7.6619999999999999,"15min":11.436999999999999},"last":1.3580000000000001}]},{"osd":10,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":2.3889999999999998,"5min":2.4620000000000002,"15min":2.2599999999999998},"min":{"1min":1.431,"5min":1.105,"15min":0.81999999999999995},"max":{"1min":8.423,"5min":8.423,"15min":8.9809999999999999},"last":1.54},{"interface":"front","average":{"1min":2.9359999999999999,"5min":2.806,"15min":2.3479999999999999},"min":{"1min":1.506,"5min":0.96799999999999997,"15min":0.96099999999999997},"max":{"1min":6.8879999999999999,"5min":8.0190000000000001,"15min":8.0190000000000001},"last":1.502}]},{"osd":11,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":2.548,"5min":2.3460000000000001,"15min":2.0449999999999999},"min":{"1min":1.1799999999999999,"5min":1.133,"15min":0.88600000000000001},"max":{"1min":7.5380000000000003,"5min":7.7229999999999999,"15min":11.547000000000001},"last":1.468},{"interface":"front","average":{"1min":2.407,"5min":2.4249999999999998,"15min":2.2639999999999998},"min":{"1min":1.22,"5min":1.1759999999999999,"15min":0.98199999999999998},"max":{"1min":8.5500000000000007,"5min":10.367000000000001,"15min":14.678000000000001},"last":1.617}]}]},{"osd":6,"up_from":17,"seq":73014444342,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":453476,"kb_used_data":61468,"kb_used_omap":0,"kb_used_meta":392000,"kb_avail":93918364,"statfs":{"total":96636764160,"available":96172404736,"internally_reserved":0,"allocated":62943232,"data_stored":83481095,"data_compressed":9754370,"data_compressed_allocated":20705280,"data_compressed_original":41410560,"omap_allocated":0,"internal_metadata":401408000},"hb_peers":[0,1,2,3,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.306,"15min":1.1639999999999999},"min":{"1min":0.63,"5min":0.56399999999999995,"15min":0.54100000000000004},"max":{"1min":4.4059999999999997,"5min":11.004,"15min":11.004},"last":0.67500000000000004},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.97999999999999998,"15min":1.0189999999999999},"min":{"1min":0.623,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":3.9860000000000002,"5min":3.9860000000000002,"15min":8.5150000000000006},"last":0.69499999999999995}]},{"osd":1,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":1.5629999999999999,"5min":1.323,"15min":1.363},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":4.5,"5min":4.5179999999999998,"15min":6.1369999999999996},"last":1.036},{"interface":"front","average":{"1min":1.177,"5min":1.55,"15min":2.181},"min":{"1min":0.63300000000000001,"5min":0.58099999999999996,"15min":0.56899999999999995},"max":{"1min":3.8330000000000002,"5min":21.001000000000001,"15min":136.38},"last":0.72599999999999998}]},{"osd":2,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.3069999999999999,"15min":1.4159999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.58399999999999996},"max":{"1min":3.4820000000000002,"5min":6.9470000000000001,"15min":34.850999999999999},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.554,"5min":1.6180000000000001,"15min":1.502},"min":{"1min":0.89000000000000001,"5min":0.77400000000000002,"15min":0.64600000000000002},"max":{"1min":4.6360000000000001,"5min":12.048999999999999,"15min":12.048999999999999},"last":1.2629999999999999}]},{"osd":3,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.423,"15min":1.4259999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.68700000000000006},"max":{"1min":2.2759999999999998,"5min":4.6500000000000004,"15min":6.5990000000000002},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.423,"5min":1.3999999999999999,"15min":1.6279999999999999},"min":{"1min":0.79100000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":4.9889999999999999,"5min":4.9889999999999999,"15min":54.747},"last":1.004}]},{"osd":5,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":1.7030000000000001,"5min":1.8560000000000001,"15min":1.738},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":4.5250000000000004,"5min":12.162000000000001,"15min":21.766999999999999},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.7330000000000001,"5min":1.621,"15min":1.665},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.84899999999999998},"max":{"1min":4.7460000000000004,"5min":4.7880000000000003,"15min":22.012},"last":1.133}]},{"osd":7,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":1.875,"5min":1.6870000000000001,"15min":1.7789999999999999},"min":{"1min":1.0189999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":4.4569999999999999,"5min":6.8789999999999996,"15min":34.982999999999997},"last":1.153},{"interface":"front","average":{"1min":2.2050000000000001,"5min":2.0899999999999999,"15min":1.917},"min":{"1min":1.1040000000000001,"5min":0.98599999999999999,"15min":0.84799999999999998},"max":{"1min":4.859,"5min":11.670999999999999,"15min":11.670999999999999},"last":1.1759999999999999}]},{"osd":8,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":1.7430000000000001,"5min":1.8220000000000001,"15min":1.7549999999999999},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":4.383,"5min":7.4560000000000004,"15min":7.4560000000000004},"last":1.2070000000000001},{"interface":"front","average":{"1min":2.0249999999999999,"5min":1.849,"15min":1.974},"min":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":5.4779999999999998,"5min":6.4550000000000001,"15min":54.307000000000002},"last":1.421}]},{"osd":9,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":1.9179999999999999,"5min":2.0009999999999999,"15min":1.9179999999999999},"min":{"1min":1.0369999999999999,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":4.7519999999999998,"5min":11.795999999999999,"15min":11.795999999999999},"last":1.073},{"interface":"front","average":{"1min":1.653,"5min":1.8240000000000001,"15min":1.819},"min":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"max":{"1min":4.6299999999999999,"5min":7.3869999999999996,"15min":7.3869999999999996},"last":1.2769999999999999}]},{"osd":10,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":2.0259999999999998,"5min":2.0489999999999999,"15min":2.1230000000000002},"min":{"1min":1.2869999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":5.109,"5min":8.8759999999999994,"15min":54.162999999999997},"last":1.5409999999999999},{"interface":"front","average":{"1min":2.254,"5min":2.2770000000000001,"15min":2.137},"min":{"1min":1.1819999999999999,"5min":1.093,"15min":1.0469999999999999},"max":{"1min":4.9640000000000004,"5min":11.913,"15min":11.913},"last":1.3999999999999999}]},{"osd":11,"last update":"Fri Nov 20 12:12:36 2020","interfaces":[{"interface":"back","average":{"1min":1.7769999999999999,"5min":1.9510000000000001,"15min":1.9279999999999999},"min":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"max":{"1min":4.859,"5min":7.2610000000000001,"15min":7.2610000000000001},"last":1.347},{"interface":"front","average":{"1min":1.972,"5min":1.9359999999999999,"15min":2.1080000000000001},"min":{"1min":1.1100000000000001,"5min":1.077,"15min":1.077},"max":{"1min":5.3540000000000001,"5min":6.6970000000000001,"15min":54.432000000000002},"last":1.6619999999999999}]}]},{"osd":1,"up_from":17,"seq":73014444340,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":472032,"kb_used_data":48216,"kb_used_omap":0,"kb_used_meta":423808,"kb_avail":93899808,"statfs":{"total":96636764160,"available":96153403392,"internally_reserved":0,"allocated":49373184,"data_stored":66703879,"data_compressed":8227218,"data_compressed_allocated":17498112,"data_compressed_original":34996224,"omap_allocated":0,"internal_metadata":433979392},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":1.4810000000000001,"5min":1.296,"15min":1.103},"min":{"1min":0.70099999999999996,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":5.4329999999999998,"5min":6.0700000000000003,"15min":6.1559999999999997},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.9850000000000001,"5min":1.5049999999999999,"15min":1.325},"min":{"1min":0.65600000000000003,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":6.0190000000000001,"5min":6.1580000000000004,"15min":9.3610000000000007},"last":1.345}]},{"osd":2,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.512,"15min":1.284},"min":{"1min":0.60699999999999998,"5min":0.59799999999999998,"15min":0.58699999999999997},"max":{"1min":5.4610000000000003,"5min":6.6760000000000002,"15min":6.6760000000000002},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.732,"5min":1.6579999999999999,"15min":1.4279999999999999},"min":{"1min":0.81999999999999995,"5min":0.73899999999999999,"15min":0.54900000000000004},"max":{"1min":5.7050000000000001,"5min":6.3159999999999998,"15min":8.5210000000000008},"last":1.1879999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":4,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":2.6749999999999998,"5min":1.9419999999999999,"15min":1.7170000000000001},"min":{"1min":0.69999999999999996,"5min":0.68000000000000005,"15min":0.60799999999999998},"max":{"1min":6.702,"5min":6.702,"15min":9.5419999999999998},"last":0.92500000000000004},{"interface":"front","average":{"1min":2.1389999999999998,"5min":2.0329999999999999,"15min":1.782},"min":{"1min":0.77900000000000003,"5min":0.67700000000000005,"15min":0.66700000000000004},"max":{"1min":6.7699999999999996,"5min":7.077,"15min":12.92},"last":1.417}]},{"osd":5,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":2.371,"5min":1.996,"15min":1.784},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.78400000000000003},"max":{"1min":6.1639999999999997,"5min":6.1639999999999997,"15min":9.7870000000000008},"last":1.6259999999999999},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.9259999999999999,"15min":1.6160000000000001},"min":{"1min":0.85099999999999998,"5min":0.82899999999999996,"15min":0.60299999999999998},"max":{"1min":5.766,"5min":7.165,"15min":7.4240000000000004},"last":1.28}]},{"osd":6,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":2.0089999999999999,"5min":1.962,"15min":1.7110000000000001},"min":{"1min":1.0449999999999999,"5min":0.81399999999999995,"15min":0.68400000000000005},"max":{"1min":6.0529999999999999,"5min":7.7210000000000001,"15min":7.7210000000000001},"last":1.329},{"interface":"front","average":{"1min":2.5910000000000002,"5min":2.2480000000000002,"15min":1.9950000000000001},"min":{"1min":1.226,"5min":1.0740000000000001,"15min":0.96599999999999997},"max":{"1min":6.3220000000000001,"5min":7.3600000000000003,"15min":9.2859999999999996},"last":1.492}]},{"osd":7,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":1.835,"5min":2.2050000000000001,"15min":1.901},"min":{"1min":0.82499999999999996,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":5.9420000000000002,"5min":7.2539999999999996,"15min":8.8810000000000002},"last":1.123},{"interface":"front","average":{"1min":2.48,"5min":2.23,"15min":2.0139999999999998},"min":{"1min":1.1919999999999999,"5min":1.042,"15min":0.92300000000000004},"max":{"1min":7.0540000000000003,"5min":7.0540000000000003,"15min":8.6080000000000005},"last":1.544}]},{"osd":8,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":2.758,"5min":2.5779999999999998,"15min":2.2490000000000001},"min":{"1min":1.284,"5min":1.2,"15min":1.1950000000000001},"max":{"1min":6.7439999999999998,"5min":14.266999999999999,"15min":14.266999999999999},"last":1.8979999999999999},{"interface":"front","average":{"1min":2.0739999999999998,"5min":2.4809999999999999,"15min":2.0699999999999998},"min":{"1min":1.153,"5min":0.98299999999999998,"15min":0.82599999999999996},"max":{"1min":6.0810000000000004,"5min":14.351000000000001,"15min":14.351000000000001},"last":1.579}]},{"osd":9,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":2.4780000000000002,"5min":2.202,"15min":2.036},"min":{"1min":1.107,"5min":1.079,"15min":1.079},"max":{"1min":7.2149999999999999,"5min":7.2149999999999999,"15min":11.465999999999999},"last":1.4530000000000001},{"interface":"front","average":{"1min":2.9049999999999998,"5min":2.4870000000000001,"15min":2.262},"min":{"1min":1.347,"5min":1.2689999999999999,"15min":1.1970000000000001},"max":{"1min":6.8810000000000002,"5min":6.8810000000000002,"15min":12.558999999999999},"last":1.768}]},{"osd":10,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":2.7149999999999999,"5min":2.4750000000000001,"15min":2.1949999999999998},"min":{"1min":1.45,"5min":1.1120000000000001,"15min":1.0069999999999999},"max":{"1min":7.335,"5min":7.335,"15min":8.7420000000000009},"last":1.6599999999999999},{"interface":"front","average":{"1min":3.2850000000000001,"5min":2.9260000000000002,"15min":2.629},"min":{"1min":1.615,"5min":1.343,"15min":1.272},"max":{"1min":7.298,"5min":7.298,"15min":12.689},"last":2.1339999999999999}]},{"osd":11,"last update":"Fri Nov 20 12:13:08 2020","interfaces":[{"interface":"back","average":{"1min":2.9239999999999999,"5min":2.6949999999999998,"15min":2.4830000000000001},"min":{"1min":1.4570000000000001,"5min":1.409,"15min":1.3540000000000001},"max":{"1min":7.141,"5min":7.141,"15min":12.827},"last":2.02},{"interface":"front","average":{"1min":3.077,"5min":2.7610000000000001,"15min":2.5699999999999998},"min":{"1min":1.544,"5min":1.4710000000000001,"15min":1.389},"max":{"1min":7.25,"5min":7.25,"15min":12.941000000000001},"last":2.2559999999999998}]}]},{"osd":0,"up_from":17,"seq":73014444341,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":290796,"kb_used_data":19428,"kb_used_omap":0,"kb_used_meta":271360,"kb_avail":94081044,"statfs":{"total":96636764160,"available":96338989056,"internally_reserved":0,"allocated":19894272,"data_stored":25301787,"data_compressed":2644903,"data_compressed_allocated":5566464,"data_compressed_original":11132928,"omap_allocated":0,"internal_metadata":277872640},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 20 12:12:44 2020","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.0269999999999999,"15min":1.095},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.56100000000000005},"max":{"1min":2.4660000000000002,"5min":8.7539999999999996,"15min":13.342000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.089,"5min":1.1459999999999999,"15min":1.1879999999999999},"min":{"1min":0.63800000000000001,"5min":0.61699999999999999,"15min":0.58999999999999997},"max":{"1min":2.0110000000000001,"5min":9.157,"15min":12.875},"last":0.88600000000000001}]},{"osd":2,"last update":"Fri Nov 20 12:12:44 2020","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.0489999999999999,"15min":1.127},"min":{"1min":0.69599999999999995,"5min":0.65100000000000002,"15min":0.61199999999999999},"max":{"1min":4.4459999999999997,"5min":4.4459999999999997,"15min":5.7370000000000001},"last":1.456},{"interface":"front","average":{"1min":1.236,"5min":1.1910000000000001,"15min":1.238},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.56799999999999995},"max":{"1min":1.8200000000000001,"5min":2.2330000000000001,"15min":6.3029999999999999},"last":1.5669999999999999}]},{"osd":3,"last update":"Fri Nov 20 12:12:44 2020","interfaces":[{"interface":"back","average":{"1min":1.746,"5min":1.3440000000000001,"15min":1.3240000000000001},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":4.7539999999999996,"5min":4.7539999999999996,"15min":13.930999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.587,"5min":1.1830000000000001,"15min":1.2450000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.59299999999999997},"max":{"1min":4.46,"5min":4.46,"15min":5.5339999999999998},"last":0.93300000000000005}]},{"osd":4,"last update":"Fri Nov 20 12:12:44 2020","interfaces":[{"interface":"back","average":{"1min":1.74,"5min":1.5029999999999999,"15min":1.4890000000000001},"min":{"1min":0.80200000000000005,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":4.5700000000000003,"5min":5.7610000000000001,"15min":7.8120000000000003},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.609,"5min":1.5049999999999999,"15min":1.494},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.58299999999999996},"max":{"1min":5.4000000000000004,"5min":5.4000000000000004,"15min":7.9980000000000002},"last":1.169}]},{"osd":5,"last update":"Fri Nov 20 12:12:44 2020","interfaces":[{"interface":"back","average":{"1min":1.593,"5min":1.5589999999999999,"15min":1.5820000000000001},"min":{"1min":0.92500000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":3.8999999999999999,"5min":6.5609999999999999,"15min":13.669},"last":1.3},{"interface":"front","average":{"1min":1.877,"5min":1.5209999999999999,"15min":1.5569999999999999},"min":{"1min":0.95999999999999996,"5min":0.83199999999999996,"15min":0.81899999999999995},"max":{"1min":4.8289999999999997,"5min":5.2160000000000002,"15min":13.018000000000001},"last":1.26}]},{"osd":6,"last update":"Fri Nov 20 12:12:44 2020","interfaces":[{"interface":"back","average":{"1min":2.0670000000000002,"5min":1.6559999999999999,"15min":1.6759999999999999},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":6.6790000000000003,"5min":6.6790000000000003,"15min":8.0410000000000004},"last":1.333},{"interface":"front","average":{"1min":1.742,"5min":1.629,"15min":1.7030000000000001},"min":{"1min":1.085,"5min":0.95399999999999996,"15min":0.73799999999999999},"max":{"1min":3.2709999999999999,"5min":3.2709999999999999,"15min":6.6909999999999998},"last":1.4830000000000001}]},{"osd":7,"last update":"Fri Nov 20 12:12:44 2020","interfaces":[{"interface":"back","average":{"1min":2.2719999999999998,"5min":1.7010000000000001,"15min":1.7},"min":{"1min":1.0329999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":7.827,"5min":7.827,"15min":8.5820000000000007},"last":1.6180000000000001},{"interface":"front","average":{"1min":2.2469999999999999,"5min":1.833,"15min":1.869},"min":{"1min":1.1830000000000001,"5min":1.0509999999999999,"15min":1.0509999999999999},"max":{"1min":6.4400000000000004,"5min":6.4400000000000004,"15min":9.5909999999999993},"last":1.7310000000000001}]},{"osd":8,"last update":"Fri Nov 20 12:12:44 2020","interfaces":[{"interface":"back","average":{"1min":2.0510000000000002,"5min":1.764,"15min":1.7609999999999999},"min":{"1min":1.1020000000000001,"5min":1.0549999999999999,"15min":1.0549999999999999},"max":{"1min":4.952,"5min":5.2309999999999999,"15min":8.3469999999999995},"last":1.395},{"interface":"front","average":{"1min":2.2709999999999999,"5min":1.782,"15min":1.8240000000000001},"min":{"1min":1.3089999999999999,"5min":1.157,"15min":1.0900000000000001},"max":{"1min":6.556,"5min":6.556,"15min":8.4039999999999999},"last":1.5880000000000001}]},{"osd":9,"last update":"Fri Nov 20 12:12:44 2020","interfaces":[{"interface":"back","average":{"1min":1.9850000000000001,"5min":1.804,"15min":1.8300000000000001},"min":{"1min":1.157,"5min":1.1000000000000001,"15min":1.1000000000000001},"max":{"1min":4.3129999999999997,"5min":4.3129999999999997,"15min":8.4610000000000003},"last":1.6359999999999999},{"interface":"front","average":{"1min":2.2509999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"min":{"1min":1.21,"5min":1.042,"15min":1.042},"max":{"1min":5.0309999999999997,"5min":5.6879999999999997,"15min":8.4649999999999999},"last":1.6919999999999999}]},{"osd":11,"last update":"Fri Nov 20 12:12:44 2020","interfaces":[{"interface":"back","average":{"1min":1.954,"5min":1.78,"15min":1.8660000000000001},"min":{"1min":1.2250000000000001,"5min":1.177,"15min":1.1699999999999999},"max":{"1min":4.4740000000000002,"5min":4.4740000000000002,"15min":8.3800000000000008},"last":1.712},{"interface":"front","average":{"1min":2.2450000000000001,"5min":1.889,"15min":1.9259999999999999},"min":{"1min":1.282,"5min":1.1240000000000001,"15min":1.1240000000000001},"max":{"1min":5.2519999999999998,"5min":5.4909999999999997,"15min":8.7029999999999994},"last":1.504}]}]},{"osd":2,"up_from":17,"seq":73014444341,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51748,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":51456,"kb_avail":94320092,"statfs":{"total":96636764160,"available":96583774208,"internally_reserved":0,"allocated":290816,"data_stored":135963,"data_compressed":2789,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":52690944},"hb_peers":[0,1,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.93200000000000005,"15min":0.96599999999999997},"min":{"1min":0.64900000000000002,"5min":0.60599999999999998,"15min":0.56299999999999994},"max":{"1min":1.3140000000000001,"5min":3.5840000000000001,"15min":3.8690000000000002},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.244,"5min":1.163,"15min":1.175},"min":{"1min":0.77300000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":3.8679999999999999,"5min":6.4470000000000001,"15min":8.0739999999999998},"last":1.2909999999999999}]},{"osd":1,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.214,"15min":1.2589999999999999},"min":{"1min":0.67100000000000004,"5min":0.60199999999999998,"15min":0.55800000000000005},"max":{"1min":4.6479999999999997,"5min":4.867,"15min":29.183},"last":1},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.4330000000000001,"15min":1.3580000000000001},"min":{"1min":0.82399999999999995,"5min":0.58799999999999997,"15min":0.57699999999999996},"max":{"1min":4.5060000000000002,"5min":7.7560000000000002,"15min":11.492000000000001},"last":1.403}]},{"osd":3,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.01,"15min":1.0700000000000001},"min":{"1min":0.69199999999999995,"5min":0.59499999999999997,"15min":0.58099999999999996},"max":{"1min":4.0129999999999999,"5min":4.0129999999999999,"15min":6.0220000000000002},"last":0.71599999999999997},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.222,"15min":1.2110000000000001},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":4.2080000000000002,"5min":4.2080000000000002,"15min":9.3160000000000007},"last":0.68799999999999994}]},{"osd":4,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":1.4810000000000001,"5min":1.3839999999999999,"15min":1.383},"min":{"1min":0.78400000000000003,"5min":0.746,"15min":0.58299999999999996},"max":{"1min":4.7279999999999998,"5min":4.7279999999999998,"15min":7.0510000000000002},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.4590000000000001,"15min":1.401},"min":{"1min":0.82599999999999996,"5min":0.745,"15min":0.72499999999999998},"max":{"1min":3.1000000000000001,"5min":5.1349999999999998,"15min":5.875},"last":1.121}]},{"osd":5,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.3839999999999999,"15min":1.3380000000000001},"min":{"1min":0.69899999999999995,"5min":0.66300000000000003,"15min":0.624},"max":{"1min":6.016,"5min":6.5869999999999997,"15min":7.3659999999999997},"last":1.081},{"interface":"front","average":{"1min":1.359,"5min":1.484,"15min":1.579},"min":{"1min":0.83299999999999996,"5min":0.82999999999999996,"15min":0.65600000000000003},"max":{"1min":4.4649999999999999,"5min":9.1240000000000006,"15min":35.177},"last":0.84999999999999998}]},{"osd":6,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.482,"15min":1.4470000000000001},"min":{"1min":0.93999999999999995,"5min":0.86299999999999999,"15min":0.75900000000000001},"max":{"1min":4.3780000000000001,"5min":4.3780000000000001,"15min":5.4880000000000004},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.617,"5min":1.583,"15min":1.611},"min":{"1min":1.1399999999999999,"5min":0.92800000000000005,"15min":0.80500000000000005},"max":{"1min":4.1390000000000002,"5min":6.7149999999999999,"15min":8.202},"last":1.431}]},{"osd":7,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":1.8149999999999999,"15min":1.712},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":4.5629999999999997,"5min":9.3460000000000001,"15min":10.002000000000001},"last":1.333},{"interface":"front","average":{"1min":1.752,"5min":1.6639999999999999,"15min":1.5920000000000001},"min":{"1min":1.2430000000000001,"5min":1.002,"15min":0.85799999999999998},"max":{"1min":4.7460000000000004,"5min":4.7460000000000004,"15min":4.9340000000000002},"last":1.5349999999999999}]},{"osd":8,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":1.718,"5min":1.76,"15min":1.6619999999999999},"min":{"1min":1.2210000000000001,"5min":1.0029999999999999,"15min":0.81399999999999995},"max":{"1min":4.2969999999999997,"5min":8.3019999999999996,"15min":8.3019999999999996},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.5960000000000001,"5min":1.76,"15min":1.6990000000000001},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":4.6609999999999996,"5min":9.2420000000000009,"15min":9.2420000000000009},"last":1.1519999999999999}]},{"osd":9,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":1.5449999999999999,"5min":1.671,"15min":1.621},"min":{"1min":1.1719999999999999,"5min":1.081,"15min":0.999},"max":{"1min":1.8879999999999999,"5min":4.2000000000000002,"15min":6.3769999999999998},"last":1.27},{"interface":"front","average":{"1min":1.788,"5min":1.77,"15min":1.772},"min":{"1min":1.3120000000000001,"5min":1.109,"15min":1.028},"max":{"1min":4.4180000000000001,"5min":6.8319999999999999,"15min":9.0559999999999992},"last":1.706}]},{"osd":10,"last update":"Fri Nov 20 12:12:48 2020","interfaces":[{"interface":"back","average":{"1min":1.8999999999999999,"5min":1.944,"15min":1.821},"min":{"1min":1.2969999999999999,"5min":1.224,"15min":1.1739999999999999},"max":{"1min":4.6239999999999997,"5min":5.3609999999999998,"15min":6.4409999999999998},"last":1.6819999999999999},{"interface":"front","average":{"1min":2.6720000000000002,"5min":2.1080000000000001,"15min":2.1299999999999999},"min":{"1min":1.381,"5min":1.2190000000000001,"15min":1.127},"max":{"1min":13.752000000000001,"5min":13.752000000000001,"15min":29.145},"last":1.796}]}]},{"osd":3,"up_from":17,"seq":73014444342,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":662276,"kb_used_data":83004,"kb_used_omap":0,"kb_used_meta":579264,"kb_avail":93709564,"statfs":{"total":96636764160,"available":95958593536,"internally_reserved":0,"allocated":84996096,"data_stored":110400418,"data_compressed":12152602,"data_compressed_allocated":25579520,"data_compressed_original":51159040,"omap_allocated":0,"internal_metadata":593166336},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.452,"15min":1.1060000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.54700000000000004},"max":{"1min":5.6319999999999997,"5min":32.991,"15min":32.991},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.6799999999999999,"15min":1.3560000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.621},"max":{"1min":1.591,"5min":33.176000000000002,"15min":33.176000000000002},"last":1.117}]},{"osd":1,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":5.3460000000000001,"5min":2.0750000000000002,"15min":1.532},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":35.597999999999999,"5min":35.597999999999999,"15min":35.597999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":2.9550000000000001,"5min":1.6899999999999999,"15min":1.27},"min":{"1min":0.623,"5min":0.61299999999999999,"15min":0.59299999999999997},"max":{"1min":33.368000000000002,"5min":33.368000000000002,"15min":33.368000000000002},"last":0.77100000000000002}]},{"osd":2,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":3.4870000000000001,"5min":1.778,"15min":1.4059999999999999},"min":{"1min":0.75,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":33.314,"5min":33.314,"15min":33.314},"last":0.95099999999999996},{"interface":"front","average":{"1min":3.1629999999999998,"5min":1.72,"15min":1.4350000000000001},"min":{"1min":0.71199999999999997,"5min":0.60899999999999999,"15min":0.60199999999999998},"max":{"1min":33.457000000000001,"5min":33.457000000000001,"15min":33.457000000000001},"last":0.751}]},{"osd":4,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":3.0449999999999999,"5min":1.8200000000000001,"15min":1.5109999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":33.484999999999999,"5min":33.484999999999999,"15min":33.484999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":3.8599999999999999,"5min":2.0289999999999999,"15min":1.609},"min":{"1min":0.81599999999999995,"5min":0.80000000000000004,"15min":0.72599999999999998},"max":{"1min":33.442999999999998,"5min":33.442999999999998,"15min":33.442999999999998},"last":1.228}]},{"osd":5,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":3.5800000000000001,"5min":2.0179999999999998,"15min":1.647},"min":{"1min":0.91300000000000003,"5min":0.90800000000000003,"15min":0.79000000000000004},"max":{"1min":33.523000000000003,"5min":33.523000000000003,"15min":33.523000000000003},"last":1.097},{"interface":"front","average":{"1min":3.3959999999999999,"5min":1.9610000000000001,"15min":1.6910000000000001},"min":{"1min":1.0760000000000001,"5min":1.028,"15min":0.90600000000000003},"max":{"1min":33.753,"5min":33.753,"15min":33.753},"last":1.258}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":7,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":3.468,"5min":2.1779999999999999,"15min":1.873},"min":{"1min":1.1299999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":33.869,"5min":33.869,"15min":33.869},"last":1.3859999999999999},{"interface":"front","average":{"1min":3.5329999999999999,"5min":2.0169999999999999,"15min":1.6719999999999999},"min":{"1min":0.93600000000000005,"5min":0.879,"15min":0.83999999999999997},"max":{"1min":36.171999999999997,"5min":36.171999999999997,"15min":36.171999999999997},"last":1.1659999999999999}]},{"osd":8,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":3.5619999999999998,"5min":2.1579999999999999,"15min":1.891},"min":{"1min":1.2470000000000001,"5min":1.0269999999999999,"15min":0.89300000000000002},"max":{"1min":33.996000000000002,"5min":33.996000000000002,"15min":33.996000000000002},"last":1.5049999999999999},{"interface":"front","average":{"1min":3.3679999999999999,"5min":1.9139999999999999,"15min":1.6240000000000001},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.82299999999999995},"max":{"1min":36.100000000000001,"5min":36.100000000000001,"15min":36.100000000000001},"last":1.2889999999999999}]},{"osd":9,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":3.6230000000000002,"5min":2.1989999999999998,"15min":1.8200000000000001},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":33.655999999999999,"5min":33.655999999999999,"15min":33.655999999999999},"last":1.3640000000000001},{"interface":"front","average":{"1min":3.734,"5min":2.2999999999999998,"15min":2.052},"min":{"1min":1.3879999999999999,"5min":1.036,"15min":1.036},"max":{"1min":34.082999999999998,"5min":34.082999999999998,"15min":34.082999999999998},"last":1.643}]},{"osd":10,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":3.6970000000000001,"5min":2.1629999999999998,"15min":1.8759999999999999},"min":{"1min":1.0329999999999999,"5min":0.94099999999999995,"15min":0.90000000000000002},"max":{"1min":36.235999999999997,"5min":36.235999999999997,"15min":36.235999999999997},"last":1.4119999999999999},{"interface":"front","average":{"1min":3.8490000000000002,"5min":2.387,"15min":2.02},"min":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.071},"max":{"1min":33.789999999999999,"5min":33.789999999999999,"15min":33.789999999999999},"last":1.4830000000000001}]},{"osd":11,"last update":"Fri Nov 20 12:12:46 2020","interfaces":[{"interface":"back","average":{"1min":4.0819999999999999,"5min":2.4620000000000002,"15min":2.1219999999999999},"min":{"1min":1.4059999999999999,"5min":1.24,"15min":1.153},"max":{"1min":35.018999999999998,"5min":35.018999999999998,"15min":35.018999999999998},"last":1.577},{"interface":"front","average":{"1min":3.9700000000000002,"5min":2.1909999999999998,"15min":1.869},"min":{"1min":1.202,"5min":1.0569999999999999,"15min":1.0029999999999999},"max":{"1min":36.298000000000002,"5min":36.298000000000002,"15min":36.298000000000002},"last":1.5329999999999999}]}]},{"osd":4,"up_from":17,"seq":73014444342,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":345160,"kb_used_data":29568,"kb_used_omap":0,"kb_used_meta":315584,"kb_avail":94026680,"statfs":{"total":96636764160,"available":96283320320,"internally_reserved":0,"allocated":30277632,"data_stored":39096515,"data_compressed":4213942,"data_compressed_allocated":8978432,"data_compressed_original":17956864,"omap_allocated":0,"internal_metadata":323158016},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,1,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":1,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.6579999999999999,"15min":1.52},"min":{"1min":0.68200000000000005,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":3.5070000000000001,"5min":10.784000000000001,"15min":35.734999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":1.542,"5min":1.8819999999999999,"15min":2.0070000000000001},"min":{"1min":0.68799999999999994,"5min":0.629,"15min":0.52500000000000002},"max":{"1min":6.048,"5min":8.0079999999999991,"15min":104.79300000000001},"last":3.6320000000000001}]},{"osd":2,"last update":"Fri Nov 20 12:12:58 2020","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.6100000000000001,"15min":1.506},"min":{"1min":0.83499999999999996,"5min":0.749,"15min":0.65600000000000003},"max":{"1min":2.556,"5min":6.843,"15min":6.843},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.373,"5min":1.8460000000000001,"15min":1.603},"min":{"1min":0.67000000000000004,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.5470000000000002,"5min":7.3079999999999998,"15min":16.853999999999999},"last":3.827}]},{"osd":3,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.853,"15min":1.667},"min":{"1min":1.069,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":2.827,"5min":10.906000000000001,"15min":10.906000000000001},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.536,"5min":2.028,"15min":1.7450000000000001},"min":{"1min":0.748,"5min":0.748,"15min":0.63700000000000001},"max":{"1min":2.6579999999999999,"5min":6.9779999999999998,"15min":11.813000000000001},"last":3.7250000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":1.569,"5min":1.6339999999999999,"15min":1.385},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.59599999999999997},"max":{"1min":5.5700000000000003,"5min":6.1689999999999996,"15min":6.6600000000000001},"last":1.369},{"interface":"front","average":{"1min":1.704,"5min":2.0870000000000002,"15min":1.8919999999999999},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":2.7509999999999999,"5min":5.9820000000000002,"15min":9.2070000000000007},"last":4.0499999999999998}]},{"osd":6,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":1.768,"5min":1.6890000000000001,"15min":1.595},"min":{"1min":0.71799999999999997,"5min":0.64500000000000002,"15min":0.60499999999999998},"max":{"1min":5.6970000000000001,"5min":5.7850000000000001,"15min":25.809000000000001},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.8169999999999999,"5min":2.27,"15min":2.0819999999999999},"min":{"1min":1.1719999999999999,"5min":1.101,"15min":0.998},"max":{"1min":3.077,"5min":10.268000000000001,"15min":12.85},"last":1.1619999999999999}]},{"osd":7,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":2.0760000000000001,"5min":2.464,"15min":2.109},"min":{"1min":1.0149999999999999,"5min":0.92500000000000004,"15min":0.82899999999999996},"max":{"1min":5.8140000000000001,"5min":8.9719999999999995,"15min":16.713999999999999},"last":3.8999999999999999},{"interface":"front","average":{"1min":2.1230000000000002,"5min":2.1389999999999998,"15min":1.774},"min":{"1min":1.03,"5min":0.876,"15min":0.71399999999999997},"max":{"1min":6.1589999999999998,"5min":11.853,"15min":11.853},"last":3.8730000000000002}]},{"osd":8,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":2.0270000000000001,"5min":2.637,"15min":2.2450000000000001},"min":{"1min":1.3540000000000001,"5min":1.161,"15min":1.1439999999999999},"max":{"1min":3.0720000000000001,"5min":12.117000000000001,"15min":12.117000000000001},"last":1.222},{"interface":"front","average":{"1min":2.1339999999999999,"5min":2.4399999999999999,"15min":2.1160000000000001},"min":{"1min":1.1619999999999999,"5min":1.127,"15min":1.099},"max":{"1min":6,"5min":9.0939999999999994,"15min":11.938000000000001},"last":3.9620000000000002}]},{"osd":9,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":2.1539999999999999,"5min":2.5779999999999998,"15min":2.214},"min":{"1min":1.284,"5min":1.1890000000000001,"15min":1.0629999999999999},"max":{"1min":6.109,"5min":9.202,"15min":12.176},"last":4.0300000000000002},{"interface":"front","average":{"1min":2.1579999999999999,"5min":2.1469999999999998,"15min":1.887},"min":{"1min":1.147,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":6.085,"5min":6.085,"15min":7.8689999999999998},"last":1.7450000000000001}]},{"osd":10,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":2.7589999999999999,"5min":2.5310000000000001,"15min":2.105},"min":{"1min":1.304,"5min":1.109,"15min":0.99399999999999999},"max":{"1min":6.4850000000000003,"5min":6.4850000000000003,"15min":8.0099999999999998},"last":1.677},{"interface":"front","average":{"1min":2.4510000000000001,"5min":2.6579999999999999,"15min":2.3490000000000002},"min":{"1min":1.246,"5min":1.2210000000000001,"15min":1.2050000000000001},"max":{"1min":5.4009999999999998,"5min":10.391,"15min":10.391},"last":1.288}]},{"osd":11,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":2.1829999999999998,"5min":2.6299999999999999,"15min":2.3220000000000001},"min":{"1min":1.4139999999999999,"5min":1.278,"15min":1.1399999999999999},"max":{"1min":3.4380000000000002,"5min":10.654,"15min":10.654},"last":1.3500000000000001},{"interface":"front","average":{"1min":2.298,"5min":2.7639999999999998,"15min":2.3330000000000002},"min":{"1min":1.351,"5min":1.2190000000000001,"15min":1.1359999999999999},"max":{"1min":6.2229999999999999,"5min":11.749000000000001,"15min":12.053000000000001},"last":4.1040000000000001}]}]},{"osd":5,"up_from":17,"seq":73014444343,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310052,"kb_used_data":12764,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94061788,"statfs":{"total":96636764160,"available":96319270912,"internally_reserved":0,"allocated":13070336,"data_stored":16913339,"data_compressed":1933693,"data_compressed_allocated":4009984,"data_compressed_original":8019968,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:12:39 2020","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":0.874,"15min":0.876},"min":{"1min":0.57699999999999996,"5min":0.54100000000000004,"15min":0.53800000000000003},"max":{"1min":4.5519999999999996,"5min":4.5519999999999996,"15min":6.7670000000000003},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.96999999999999997,"15min":0.96199999999999997},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":3.7770000000000001,"5min":6.3840000000000003,"15min":6.3840000000000003},"last":0.83499999999999996}]},{"osd":1,"last update":"Fri Nov 20 12:12:39 2020","interfaces":[{"interface":"back","average":{"1min":1.877,"5min":1.2909999999999999,"15min":1.2},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.52900000000000003},"max":{"1min":7.069,"5min":8.5269999999999992,"15min":11.497},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.9830000000000001,"5min":1.518,"15min":1.389},"min":{"1min":0.89400000000000002,"5min":0.76900000000000002,"15min":0.52900000000000003},"max":{"1min":5.1390000000000002,"5min":8.4290000000000003,"15min":8.4290000000000003},"last":1.284}]},{"osd":3,"last update":"Fri Nov 20 12:12:39 2020","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.2929999999999999,"15min":1.236},"min":{"1min":0.63700000000000001,"5min":0.58099999999999996,"15min":0.56000000000000005},"max":{"1min":3.9169999999999998,"5min":6.1299999999999999,"15min":20.777000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.605,"5min":1.331,"15min":1.3340000000000001},"min":{"1min":0.80500000000000005,"5min":0.67800000000000005,"15min":0.58599999999999997},"max":{"1min":5.7279999999999998,"5min":5.7279999999999998,"15min":11.946},"last":1.014}]},{"osd":4,"last update":"Fri Nov 20 12:12:39 2020","interfaces":[{"interface":"back","average":{"1min":1.885,"5min":1.496,"15min":1.3380000000000001},"min":{"1min":0.71499999999999997,"5min":0.69899999999999995,"15min":0.56399999999999995},"max":{"1min":6.1299999999999999,"5min":6.4909999999999997,"15min":11.629},"last":1.181},{"interface":"front","average":{"1min":1.7729999999999999,"5min":1.6970000000000001,"15min":1.5589999999999999},"min":{"1min":0.86299999999999999,"5min":0.73499999999999999,"15min":0.56200000000000006},"max":{"1min":5.9409999999999998,"5min":7.484,"15min":10.872999999999999},"last":1.3740000000000001}]},{"osd":6,"last update":"Fri Nov 20 12:12:39 2020","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.4159999999999999,"15min":1.3979999999999999},"min":{"1min":0.77900000000000003,"5min":0.625,"15min":0.625},"max":{"1min":5.0949999999999998,"5min":5.0949999999999998,"15min":7.0060000000000002},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.397,"5min":1.4610000000000001,"15min":1.6479999999999999},"min":{"1min":0.81499999999999995,"5min":0.75800000000000001,"15min":0.71299999999999997},"max":{"1min":3.6619999999999999,"5min":6.2370000000000001,"15min":54.036000000000001},"last":1.3420000000000001}]},{"osd":7,"last update":"Fri Nov 20 12:12:39 2020","interfaces":[{"interface":"back","average":{"1min":1.6559999999999999,"5min":1.7210000000000001,"15min":1.526},"min":{"1min":0.91100000000000003,"5min":0.83599999999999997,"15min":0.76100000000000001},"max":{"1min":4.5739999999999998,"5min":7.0910000000000002,"15min":7.0910000000000002},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.7090000000000001,"5min":1.7230000000000001,"15min":1.6479999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":3.9950000000000001,"5min":5.8810000000000002,"15min":11.364000000000001},"last":1.4870000000000001}]},{"osd":8,"last update":"Fri Nov 20 12:12:39 2020","interfaces":[{"interface":"back","average":{"1min":1.6819999999999999,"5min":1.6279999999999999,"15min":1.5740000000000001},"min":{"1min":0.93600000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":5.0129999999999999,"5min":5.1609999999999996,"15min":7.1189999999999998},"last":1.573},{"interface":"front","average":{"1min":1.5249999999999999,"5min":1.754,"15min":1.619},"min":{"1min":0.95299999999999996,"5min":0.86299999999999999,"15min":0.78400000000000003},"max":{"1min":3.956,"5min":7.3860000000000001,"15min":7.3860000000000001},"last":1.694}]},{"osd":9,"last update":"Fri Nov 20 12:12:39 2020","interfaces":[{"interface":"back","average":{"1min":1.788,"5min":1.694,"15min":1.6759999999999999},"min":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.84799999999999998},"max":{"1min":4.0579999999999998,"5min":4.0579999999999998,"15min":10.994},"last":1.621},{"interface":"front","average":{"1min":1.7629999999999999,"5min":1.7070000000000001,"15min":1.6830000000000001},"min":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"max":{"1min":5.1639999999999997,"5min":5.1639999999999997,"15min":7.2320000000000002},"last":1.4299999999999999}]},{"osd":10,"last update":"Fri Nov 20 12:12:39 2020","interfaces":[{"interface":"back","average":{"1min":2.0350000000000001,"5min":1.9870000000000001,"15min":1.893},"min":{"1min":1.121,"5min":1.0760000000000001,"15min":1.036},"max":{"1min":4.5949999999999998,"5min":11.638999999999999,"15min":11.638999999999999},"last":1.7230000000000001},{"interface":"front","average":{"1min":2.044,"5min":1.8300000000000001,"15min":1.7909999999999999},"min":{"1min":1.163,"5min":1.1020000000000001,"15min":1.0780000000000001},"max":{"1min":5.7800000000000002,"5min":5.7800000000000002,"15min":7.3410000000000002},"last":1.6679999999999999}]},{"osd":11,"last update":"Fri Nov 20 12:12:39 2020","interfaces":[{"interface":"back","average":{"1min":1.631,"5min":1.792,"15min":1.655},"min":{"1min":1.038,"5min":1.0249999999999999,"15min":1.0009999999999999},"max":{"1min":3.8460000000000001,"5min":7.2539999999999996,"15min":7.2539999999999996},"last":1.599},{"interface":"front","average":{"1min":1.948,"5min":1.829,"15min":1.819},"min":{"1min":1.121,"5min":1.0840000000000001,"15min":1.0840000000000001},"max":{"1min":4.4329999999999998,"5min":4.6959999999999997,"15min":11.231999999999999},"last":1.8}]}]}]}} 2020-11-20T12:13:37.524 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2020-11-20T11:48:08.486179+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=48, tm_sec=8, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=13, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:13:37.525 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2020-11-20T11:48:02.343998+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=48, tm_sec=2, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=13, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:13:37.526 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2020-11-20T11:48:05.473687+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=48, tm_sec=5, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=13, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:13:37.526 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2020-11-20T11:48:08.486179+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=48, tm_sec=8, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=13, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:13:37.527 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2020-11-20T11:48:02.343998+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=48, tm_sec=2, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=13, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:13:37.527 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2020-11-20T11:48:05.473687+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=48, tm_sec=5, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=13, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:13:37.528 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2020-11-20T11:48:08.486179+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=48, tm_sec=8, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=13, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:13:37.528 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2020-11-20T11:48:02.343998+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=48, tm_sec=2, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=13, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:13:37.529 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2020-11-20T11:48:05.473687+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=48, tm_sec=5, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=13, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:13:37.529 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2020-11-20T11:48:08.486179+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=48, tm_sec=8, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=13, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:13:37.530 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2020-11-20T11:48:02.343998+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=48, tm_sec=2, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=13, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:13:37.530 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2020-11-20T11:47:52.386743+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=47, tm_sec=52, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=13, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:13:37.531 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2020-11-20T11:48:05.473687+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=48, tm_sec=5, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=13, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:13:37.531 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2020-11-20T11:48:08.486179+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=48, tm_sec=8, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=13, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:13:37.531 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2020-11-20T11:48:02.343998+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=48, tm_sec=2, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=13, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:13:37.532 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2020-11-20T11:48:05.473687+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=48, tm_sec=5, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=13, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:13:37.532 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2020-11-20T11:48:08.486179+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=48, tm_sec=8, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=13, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:13:37.532 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2020-11-20T11:48:02.343998+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=48, tm_sec=2, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=13, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:13:37.533 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2020-11-20T11:48:05.473687+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=48, tm_sec=5, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=13, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:13:37.533 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2020-11-20T11:48:08.486179+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=48, tm_sec=8, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=13, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:13:37.533 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2020-11-20T11:48:05.473687+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=48, tm_sec=5, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=13, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:13:37.534 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2020-11-20T11:48:02.343998+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=48, tm_sec=2, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=13, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:13:37.534 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2020-11-20T11:48:08.486179+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=48, tm_sec=8, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=13, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:13:37.534 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2020-11-20T11:48:02.343998+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=48, tm_sec=2, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=13, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:13:37.534 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2020-11-20T12:13:57.536 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-20T12:13:57.668 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.663+0000 7ffa95f4e700 1 Processor -- start 2020-11-20T12:13:57.668 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.663+0000 7ffa95f4e700 1 -- start start 2020-11-20T12:13:57.668 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.664+0000 7ffa95f4e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ffa90060370 0x7ffa90060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:57.669 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.664+0000 7ffa95f4e700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7ffa90064c40 0x7ffa90151340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:57.669 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.664+0000 7ffa95f4e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa90151e80 con 0x7ffa90154920 2020-11-20T12:13:57.669 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.664+0000 7ffa95f4e700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa90152120 con 0x7ffa90064c40 2020-11-20T12:13:57.669 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.664+0000 7ffa95f4e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa90064260 con 0x7ffa90060370 2020-11-20T12:13:57.669 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.664+0000 7ffa8f7fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ffa90060370 0x7ffa90060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:57.670 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.664+0000 7ffa8f7fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ffa90060370 0x7ffa90060750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50120/0 (socket says 172.21.15.192:50120) 2020-11-20T12:13:57.670 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.664+0000 7ffa8f7fe700 1 -- 172.21.15.192:0/3721685652 learned_addr learned my addr 172.21.15.192:0/3721685652 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:57.670 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.664+0000 7ffa8effd700 1 --1- 172.21.15.192:0/3721685652 >> v1:172.21.15.146:6789/0 conn(0x7ffa90154920 0x7ffa900c2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.192:33842/0 (socket says 172.21.15.192:33842) 2020-11-20T12:13:57.670 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.665+0000 7ffa8ffff700 1 --2- 172.21.15.192:0/3721685652 >> v2:172.21.15.87:3300/0 conn(0x7ffa90064c40 0x7ffa90151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:57.670 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.665+0000 7ffa8f7fe700 1 -- 172.21.15.192:0/3721685652 >> v2:172.21.15.87:3300/0 conn(0x7ffa90064c40 msgr2=0x7ffa90151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:57.671 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.665+0000 7ffa8e7fc700 1 -- 172.21.15.192:0/3721685652 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3739887349 0 0) 0x7ffa90151e80 con 0x7ffa90154920 2020-11-20T12:13:57.674 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.665+0000 7ffa8f7fe700 1 --2- 172.21.15.192:0/3721685652 >> v2:172.21.15.87:3300/0 conn(0x7ffa90064c40 0x7ffa90151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:57.674 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.665+0000 7ffa8f7fe700 1 -- 172.21.15.192:0/3721685652 >> v1:172.21.15.146:6789/0 conn(0x7ffa90154920 legacy=0x7ffa900c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:57.675 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.665+0000 7ffa8f7fe700 1 -- 172.21.15.192:0/3721685652 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa90064500 con 0x7ffa90060370 2020-11-20T12:13:57.675 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.665+0000 7ffa8f7fe700 1 --2- 172.21.15.192:0/3721685652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa90060370 0x7ffa90060750 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7ffa900c5450 tx=0x7ffa80006ef0).ready entity=mon.2 client_cookie=3c020016dea08c80 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:57.675 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.665+0000 7ffa8e7fc700 1 -- 172.21.15.192:0/3721685652 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8000b8f0 con 0x7ffa90060370 2020-11-20T12:13:57.675 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.665+0000 7ffa8e7fc700 1 -- 172.21.15.192:0/3721685652 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa80000e90 con 0x7ffa90060370 2020-11-20T12:13:57.675 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.665+0000 7ffa8e7fc700 1 -- 172.21.15.192:0/3721685652 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8000bc60 con 0x7ffa90060370 2020-11-20T12:13:57.676 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.665+0000 7ffa95f4e700 1 -- 172.21.15.192:0/3721685652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa90060370 msgr2=0x7ffa90060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:57.676 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.665+0000 7ffa95f4e700 1 --2- 172.21.15.192:0/3721685652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa90060370 0x7ffa90060750 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7ffa900c5450 tx=0x7ffa80006ef0).stop 2020-11-20T12:13:57.676 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.666+0000 7ffa95f4e700 1 -- 172.21.15.192:0/3721685652 shutdown_connections 2020-11-20T12:13:57.676 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.666+0000 7ffa95f4e700 1 --2- 172.21.15.192:0/3721685652 >> v2:172.21.15.87:3300/0 conn(0x7ffa90064c40 0x7ffa90151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:57.676 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.666+0000 7ffa95f4e700 1 --2- 172.21.15.192:0/3721685652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa90060370 0x7ffa90060750 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:57.677 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.666+0000 7ffa95f4e700 1 -- 172.21.15.192:0/3721685652 >> 172.21.15.192:0/3721685652 conn(0x7ffa90062100 msgr2=0x7ffa900c79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:57.677 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.666+0000 7ffa95f4e700 1 -- 172.21.15.192:0/3721685652 shutdown_connections 2020-11-20T12:13:57.677 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.666+0000 7ffa95f4e700 1 -- 172.21.15.192:0/3721685652 wait complete. 2020-11-20T12:13:57.677 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.667+0000 7ffa95f4e700 1 Processor -- start 2020-11-20T12:13:57.677 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.667+0000 7ffa95f4e700 1 -- start start 2020-11-20T12:13:57.678 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.667+0000 7ffa95f4e700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa90060370 0x7ffa9014d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:57.678 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.667+0000 7ffa95f4e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa90064c40 0x7ffa90155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:57.678 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.667+0000 7ffa95f4e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa90154920 0x7ffa900b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:57.678 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.667+0000 7ffa95f4e700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa90158630 con 0x7ffa90060370 2020-11-20T12:13:57.678 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.667+0000 7ffa95f4e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa900bf890 con 0x7ffa90064c40 2020-11-20T12:13:57.679 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.667+0000 7ffa95f4e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa900bfb30 con 0x7ffa90154920 2020-11-20T12:13:57.679 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.668+0000 7ffa8ffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa90154920 0x7ffa900b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:57.679 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.668+0000 7ffa8effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa90064c40 0x7ffa90155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:57.679 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.668+0000 7ffa8ffff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa90154920 0x7ffa900b04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50128/0 (socket says 172.21.15.192:50128) 2020-11-20T12:13:57.679 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.668+0000 7ffa8ffff700 1 -- 172.21.15.192:0/2157953552 learned_addr learned my addr 172.21.15.192:0/2157953552 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:13:57.680 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.668+0000 7ffa8effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa90064c40 0x7ffa90155dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.192:54214/0 (socket says 172.21.15.192:54214) 2020-11-20T12:13:57.680 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.668+0000 7ffa8f7fe700 1 --2- 172.21.15.192:0/2157953552 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa90060370 0x7ffa9014d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:57.680 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.668+0000 7ffa8ffff700 1 -- 172.21.15.192:0/2157953552 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa90064c40 msgr2=0x7ffa90155dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:57.680 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.668+0000 7ffa8ffff700 1 --2- 172.21.15.192:0/2157953552 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa90064c40 0x7ffa90155dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:57.680 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.668+0000 7ffa8ffff700 1 -- 172.21.15.192:0/2157953552 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa90060370 msgr2=0x7ffa9014d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:57.681 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.668+0000 7ffa8ffff700 1 --2- 172.21.15.192:0/2157953552 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa90060370 0x7ffa9014d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:57.681 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.668+0000 7ffa8ffff700 1 -- 172.21.15.192:0/2157953552 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa900bfdd0 con 0x7ffa90154920 2020-11-20T12:13:57.681 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.668+0000 7ffa8ffff700 1 --2- 172.21.15.192:0/2157953552 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa90154920 0x7ffa900b04d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7ffa8800ed20 tx=0x7ffa88009220).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:57.681 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.668+0000 7ffa6f7fe700 1 -- 172.21.15.192:0/2157953552 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8800ee80 con 0x7ffa90154920 2020-11-20T12:13:57.681 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.668+0000 7ffa6f7fe700 1 -- 172.21.15.192:0/2157953552 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8800cbe0 con 0x7ffa90154920 2020-11-20T12:13:57.682 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.668+0000 7ffa95f4e700 1 -- 172.21.15.192:0/2157953552 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa900c0070 con 0x7ffa90154920 2020-11-20T12:13:57.682 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.668+0000 7ffa6f7fe700 1 -- 172.21.15.192:0/2157953552 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa880123f0 con 0x7ffa90154920 2020-11-20T12:13:57.682 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.668+0000 7ffa95f4e700 1 -- 172.21.15.192:0/2157953552 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa9014f980 con 0x7ffa90154920 2020-11-20T12:13:57.682 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.669+0000 7ffa95f4e700 1 -- 172.21.15.192:0/2157953552 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa900699a0 con 0x7ffa90154920 2020-11-20T12:13:57.682 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.670+0000 7ffa6f7fe700 1 -- 172.21.15.192:0/2157953552 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7ffa88022070 con 0x7ffa90154920 2020-11-20T12:13:57.683 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.670+0000 7ffa6f7fe700 1 --2- 172.21.15.192:0/2157953552 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7ffa68080670 0x7ffa68082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:57.683 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.670+0000 7ffa6f7fe700 1 -- 172.21.15.192:0/2157953552 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7ffa880a30d0 con 0x7ffa90154920 2020-11-20T12:13:57.683 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.670+0000 7ffa8f7fe700 1 --2- 172.21.15.192:0/2157953552 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7ffa68080670 0x7ffa68082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:57.684 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.671+0000 7ffa8f7fe700 1 --2- 172.21.15.192:0/2157953552 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7ffa68080670 0x7ffa68082b30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7ffa80006f30 tx=0x7ffa80016000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:57.684 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.674+0000 7ffa6f7fe700 1 -- 172.21.15.192:0/2157953552 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7ffa88077ae0 con 0x7ffa90154920 2020-11-20T12:13:57.812 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.809+0000 7ffa95f4e700 1 -- 172.21.15.192:0/2157953552 --> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffa900c04d0 con 0x7ffa68080670 2020-11-20T12:13:57.819 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.815+0000 7ffa6f7fe700 1 -- 172.21.15.192:0/2157953552 <== mgr.4106 v2:172.21.15.192:6800/22925 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+149103 (secure 0 0 0) 0x7ffa900c04d0 con 0x7ffa68080670 2020-11-20T12:13:57.819 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T12:13:57.822 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.818+0000 7ffa95f4e700 1 -- 172.21.15.192:0/2157953552 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7ffa68080670 msgr2=0x7ffa68082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:57.822 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.818+0000 7ffa95f4e700 1 --2- 172.21.15.192:0/2157953552 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7ffa68080670 0x7ffa68082b30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7ffa80006f30 tx=0x7ffa80016000).stop 2020-11-20T12:13:57.823 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.818+0000 7ffa95f4e700 1 -- 172.21.15.192:0/2157953552 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa90154920 msgr2=0x7ffa900b04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:57.823 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.818+0000 7ffa95f4e700 1 --2- 172.21.15.192:0/2157953552 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa90154920 0x7ffa900b04d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7ffa8800ed20 tx=0x7ffa88009220).stop 2020-11-20T12:13:57.823 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.818+0000 7ffa95f4e700 1 -- 172.21.15.192:0/2157953552 shutdown_connections 2020-11-20T12:13:57.823 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.818+0000 7ffa95f4e700 1 --2- 172.21.15.192:0/2157953552 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7ffa68080670 0x7ffa68082b30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:57.823 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.818+0000 7ffa95f4e700 1 --2- 172.21.15.192:0/2157953552 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa90154920 0x7ffa900b04d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:57.824 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.818+0000 7ffa95f4e700 1 --2- 172.21.15.192:0/2157953552 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7ffa90060370 0x7ffa9014d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:57.824 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.818+0000 7ffa95f4e700 1 --2- 172.21.15.192:0/2157953552 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa90064c40 0x7ffa90155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:57.824 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.818+0000 7ffa95f4e700 1 -- 172.21.15.192:0/2157953552 >> 172.21.15.192:0/2157953552 conn(0x7ffa90062100 msgr2=0x7ffa90153ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:57.824 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.818+0000 7ffa95f4e700 1 -- 172.21.15.192:0/2157953552 shutdown_connections 2020-11-20T12:13:57.824 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:13:57.818+0000 7ffa95f4e700 1 -- 172.21.15.192:0/2157953552 wait complete. 2020-11-20T12:13:57.825 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2020-11-20T12:13:57.832 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":798,"stamp":"2020-11-20T12:13:56.616602+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":239746965,"num_objects":90,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":0,"num_read":13768,"num_read_kb":740881,"num_write":316686,"num_write_kb":5410704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":93265,"num_omap_keys":159,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160617,"ondisk_log_size":160617,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":3800896,"kb_used_data":362592,"kb_used_omap":0,"kb_used_meta":3438208,"kb_avail":1128661184,"statfs":{"total":1159641169920,"available":1155749052416,"internally_reserved":0,"allocated":371294208,"data_stored":481125486,"data_compressed":52868208,"data_compressed_allocated":111796224,"data_compressed_original":223592448,"omap_allocated":0,"internal_metadata":3520724992},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14931,"num_omap_keys":25,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002787"},"pg_stats":[{"pgid":"4.2","version":"28'28165","reported_seq":"29426","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:37.108042+0000","last_change":"2020-11-20T12:13:37.108139+0000","last_active":"2020-11-20T12:13:37.108042+0000","last_peered":"2020-11-20T12:13:37.108042+0000","last_clean":"2020-11-20T12:13:37.108042+0000","last_became_active":"2020-11-20T11:48:09.603149+0000","last_became_peered":"2020-11-20T11:48:09.603149+0000","last_unstale":"2020-11-20T12:13:37.108042+0000","last_undegraded":"2020-11-20T12:13:37.108042+0000","last_fullsized":"2020-11-20T12:13:37.108042+0000","mapping_epoch":26,"log_start":"28'18154","ondisk_log_start":"28'18154","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'28165","last_scrub_stamp":"2020-11-20T12:13:37.108036+0000","last_deep_scrub":"28'28165","last_deep_scrub_stamp":"2020-11-20T12:13:37.108036+0000","last_clean_scrub_stamp":"2020-11-20T12:13:37.108036+0000","log_size":10011,"ondisk_log_size":10011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1247,"num_read_kb":71900,"num_write":20182,"num_write_kb":535970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4,7],"acting":[1,8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:33.600746+0000","last_change":"2020-11-20T12:13:33.600835+0000","last_active":"2020-11-20T12:13:33.600746+0000","last_peered":"2020-11-20T12:13:33.600746+0000","last_clean":"2020-11-20T12:13:33.600746+0000","last_became_active":"2020-11-20T11:48:03.440545+0000","last_became_peered":"2020-11-20T11:48:03.440545+0000","last_unstale":"2020-11-20T12:13:33.600746+0000","last_undegraded":"2020-11-20T12:13:33.600746+0000","last_fullsized":"2020-11-20T12:13:33.600746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:13:33.600741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:13:33.600741+0000","last_clean_scrub_stamp":"2020-11-20T12:13:33.600741+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10],"acting":[9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"28'26312","reported_seq":"26326","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:41.768991+0000","last_change":"2020-11-20T12:13:41.769056+0000","last_active":"2020-11-20T12:13:41.768991+0000","last_peered":"2020-11-20T12:13:41.768991+0000","last_clean":"2020-11-20T12:13:41.768991+0000","last_became_active":"2020-11-20T11:48:06.484261+0000","last_became_peered":"2020-11-20T11:48:06.484261+0000","last_unstale":"2020-11-20T12:13:41.768991+0000","last_undegraded":"2020-11-20T12:13:41.768991+0000","last_fullsized":"2020-11-20T12:13:41.768991+0000","mapping_epoch":23,"log_start":"28'16300","ondisk_log_start":"28'16300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'26312","last_scrub_stamp":"2020-11-20T12:13:41.768985+0000","last_deep_scrub":"28'26312","last_deep_scrub_stamp":"2020-11-20T12:13:41.768985+0000","last_clean_scrub_stamp":"2020-11-20T12:13:41.768985+0000","log_size":10012,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16777376,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":26397,"num_write_kb":171630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":21225,"num_omap_keys":35,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'27002","reported_seq":"28349","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:29.484946+0000","last_change":"2020-11-20T11:48:09.601081+0000","last_active":"2020-11-20T12:13:29.484946+0000","last_peered":"2020-11-20T12:13:29.484946+0000","last_clean":"2020-11-20T12:13:29.484946+0000","last_became_active":"2020-11-20T11:48:09.600693+0000","last_became_peered":"2020-11-20T11:48:09.600693+0000","last_unstale":"2020-11-20T12:13:29.484946+0000","last_undegraded":"2020-11-20T12:13:29.484946+0000","last_fullsized":"2020-11-20T12:13:29.484946+0000","mapping_epoch":26,"log_start":"28'16967","ondisk_log_start":"28'16967","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_clean_scrub_stamp":"2020-11-20T11:48:08.486179+0000","log_size":10035,"ondisk_log_size":10035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1336,"num_read_kb":87000,"num_write":19165,"num_write_kb":539571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,8,10],"acting":[6,0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"17","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:40.647994+0000","last_change":"2020-11-20T12:13:40.648105+0000","last_active":"2020-11-20T12:13:40.647994+0000","last_peered":"2020-11-20T12:13:40.647994+0000","last_clean":"2020-11-20T12:13:40.647994+0000","last_became_active":"2020-11-20T11:48:03.364003+0000","last_became_peered":"2020-11-20T11:48:03.364003+0000","last_unstale":"2020-11-20T12:13:40.647994+0000","last_undegraded":"2020-11-20T12:13:40.647994+0000","last_fullsized":"2020-11-20T12:13:40.647994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:13:40.647988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:13:40.647988+0000","last_clean_scrub_stamp":"2020-11-20T12:13:40.647988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"28'22134","reported_seq":"22148","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:39.721374+0000","last_change":"2020-11-20T12:13:39.721429+0000","last_active":"2020-11-20T12:13:39.721374+0000","last_peered":"2020-11-20T12:13:39.721374+0000","last_clean":"2020-11-20T12:13:39.721374+0000","last_became_active":"2020-11-20T11:48:06.628670+0000","last_became_peered":"2020-11-20T11:48:06.628670+0000","last_unstale":"2020-11-20T12:13:39.721374+0000","last_undegraded":"2020-11-20T12:13:39.721374+0000","last_fullsized":"2020-11-20T12:13:39.721374+0000","mapping_epoch":23,"log_start":"28'12100","ondisk_log_start":"28'12100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'22134","last_scrub_stamp":"2020-11-20T12:13:39.721369+0000","last_deep_scrub":"28'22134","last_deep_scrub_stamp":"2020-11-20T12:13:39.721369+0000","last_clean_scrub_stamp":"2020-11-20T12:13:39.721369+0000","log_size":10034,"ondisk_log_size":10034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":37748770,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":22175,"num_write_kb":164436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4978,"num_omap_keys":11,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.7","version":"28'26179","reported_seq":"27710","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:29.620976+0000","last_change":"2020-11-20T11:48:09.598612+0000","last_active":"2020-11-20T12:13:29.620976+0000","last_peered":"2020-11-20T12:13:29.620976+0000","last_clean":"2020-11-20T12:13:29.620976+0000","last_became_active":"2020-11-20T11:48:09.598147+0000","last_became_peered":"2020-11-20T11:48:09.598147+0000","last_unstale":"2020-11-20T12:13:29.620976+0000","last_undegraded":"2020-11-20T12:13:29.620976+0000","last_fullsized":"2020-11-20T12:13:29.620976+0000","mapping_epoch":26,"log_start":"28'16165","ondisk_log_start":"28'16165","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:48:08.486179+0000","last_clean_scrub_stamp":"2020-11-20T11:48:08.486179+0000","log_size":10014,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1520,"num_read_kb":90522,"num_write":18274,"num_write_kb":563834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5,0],"acting":[6,1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:38.302699+0000","last_change":"2020-11-20T12:13:38.302794+0000","last_active":"2020-11-20T12:13:38.302699+0000","last_peered":"2020-11-20T12:13:38.302699+0000","last_clean":"2020-11-20T12:13:38.302699+0000","last_became_active":"2020-11-20T11:48:03.436251+0000","last_became_peered":"2020-11-20T11:48:03.436251+0000","last_unstale":"2020-11-20T12:13:38.302699+0000","last_undegraded":"2020-11-20T12:13:38.302699+0000","last_fullsized":"2020-11-20T12:13:38.302699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:13:38.302691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:13:38.302691+0000","last_clean_scrub_stamp":"2020-11-20T12:13:38.302691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"28'18843","reported_seq":"18858","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:36.149565+0000","last_change":"2020-11-20T12:13:36.149634+0000","last_active":"2020-11-20T12:13:36.149565+0000","last_peered":"2020-11-20T12:13:36.149565+0000","last_clean":"2020-11-20T12:13:36.149565+0000","last_became_active":"2020-11-20T11:48:06.645318+0000","last_became_peered":"2020-11-20T11:48:06.645318+0000","last_unstale":"2020-11-20T12:13:36.149565+0000","last_undegraded":"2020-11-20T12:13:36.149565+0000","last_fullsized":"2020-11-20T12:13:36.149565+0000","mapping_epoch":23,"log_start":"28'8800","ondisk_log_start":"28'8800","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'18843","last_scrub_stamp":"2020-11-20T12:13:36.149559+0000","last_deep_scrub":"28'18843","last_deep_scrub_stamp":"2020-11-20T12:13:36.149559+0000","last_clean_scrub_stamp":"2020-11-20T12:13:36.149559+0000","log_size":10043,"ondisk_log_size":10043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":18953,"num_write_kb":142544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18841,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"28'26566","reported_seq":"27858","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:45.642391+0000","last_change":"2020-11-20T12:13:45.642488+0000","last_active":"2020-11-20T12:13:45.642391+0000","last_peered":"2020-11-20T12:13:45.642391+0000","last_clean":"2020-11-20T12:13:45.642391+0000","last_became_active":"2020-11-20T11:48:09.600181+0000","last_became_peered":"2020-11-20T11:48:09.600181+0000","last_unstale":"2020-11-20T12:13:45.642391+0000","last_undegraded":"2020-11-20T12:13:45.642391+0000","last_fullsized":"2020-11-20T12:13:45.642391+0000","mapping_epoch":26,"log_start":"28'16547","ondisk_log_start":"28'16547","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'26566","last_scrub_stamp":"2020-11-20T12:13:45.642385+0000","last_deep_scrub":"28'26566","last_deep_scrub_stamp":"2020-11-20T12:13:45.642385+0000","last_clean_scrub_stamp":"2020-11-20T12:13:45.642385+0000","log_size":10019,"ondisk_log_size":10019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1278,"num_read_kb":79856,"num_write":18659,"num_write_kb":485186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,4,11],"acting":[5,10,4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"17","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:37.496242+0000","last_change":"2020-11-20T12:13:37.496344+0000","last_active":"2020-11-20T12:13:37.496242+0000","last_peered":"2020-11-20T12:13:37.496242+0000","last_clean":"2020-11-20T12:13:37.496242+0000","last_became_active":"2020-11-20T11:48:03.361549+0000","last_became_peered":"2020-11-20T11:48:03.361549+0000","last_unstale":"2020-11-20T12:13:37.496242+0000","last_undegraded":"2020-11-20T12:13:37.496242+0000","last_fullsized":"2020-11-20T12:13:37.496242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:13:37.496233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:13:37.496233+0000","last_clean_scrub_stamp":"2020-11-20T12:13:37.496233+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"1.0","version":"28'6","reported_seq":"27","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:36.902400+0000","last_change":"2020-11-20T12:13:36.902489+0000","last_active":"2020-11-20T12:13:36.902400+0000","last_peered":"2020-11-20T12:13:36.902400+0000","last_clean":"2020-11-20T12:13:36.902400+0000","last_became_active":"2020-11-20T11:47:58.639096+0000","last_became_peered":"2020-11-20T11:47:58.639096+0000","last_unstale":"2020-11-20T12:13:36.902400+0000","last_undegraded":"2020-11-20T12:13:36.902400+0000","last_fullsized":"2020-11-20T12:13:36.902400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2020-11-20T12:13:36.902391+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2020-11-20T12:13:36.902391+0000","last_clean_scrub_stamp":"2020-11-20T12:13:36.902391+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12390,"num_omap_keys":3,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"28'23227","reported_seq":"23241","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:35.182155+0000","last_change":"2020-11-20T12:13:35.182216+0000","last_active":"2020-11-20T12:13:35.182155+0000","last_peered":"2020-11-20T12:13:35.182155+0000","last_clean":"2020-11-20T12:13:35.182155+0000","last_became_active":"2020-11-20T11:48:06.724982+0000","last_became_peered":"2020-11-20T11:48:06.724982+0000","last_unstale":"2020-11-20T12:13:35.182155+0000","last_undegraded":"2020-11-20T12:13:35.182155+0000","last_fullsized":"2020-11-20T12:13:35.182155+0000","mapping_epoch":23,"log_start":"28'13200","ondisk_log_start":"28'13200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'23227","last_scrub_stamp":"2020-11-20T12:13:35.182149+0000","last_deep_scrub":"28'23227","last_deep_scrub_stamp":"2020-11-20T12:13:35.182149+0000","last_clean_scrub_stamp":"2020-11-20T12:13:35.182149+0000","log_size":10027,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38960552,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":23265,"num_write_kb":170579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6598,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"28'26481","reported_seq":"28537","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:40.152558+0000","last_change":"2020-11-20T12:13:40.152642+0000","last_active":"2020-11-20T12:13:40.152558+0000","last_peered":"2020-11-20T12:13:40.152558+0000","last_clean":"2020-11-20T12:13:40.152558+0000","last_became_active":"2020-11-20T11:48:09.599710+0000","last_became_peered":"2020-11-20T11:48:09.599710+0000","last_unstale":"2020-11-20T12:13:40.152558+0000","last_undegraded":"2020-11-20T12:13:40.152558+0000","last_fullsized":"2020-11-20T12:13:40.152558+0000","mapping_epoch":26,"log_start":"28'16449","ondisk_log_start":"28'16449","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'26481","last_scrub_stamp":"2020-11-20T12:13:40.152552+0000","last_deep_scrub":"28'26481","last_deep_scrub_stamp":"2020-11-20T12:13:40.152552+0000","last_clean_scrub_stamp":"2020-11-20T12:13:40.152552+0000","log_size":10032,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2042,"num_read_kb":123354,"num_write":18484,"num_write_kb":487460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6,11],"acting":[10,9,6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:38.864190+0000","last_change":"2020-11-20T12:13:38.864279+0000","last_active":"2020-11-20T12:13:38.864190+0000","last_peered":"2020-11-20T12:13:38.864190+0000","last_clean":"2020-11-20T12:13:38.864190+0000","last_became_active":"2020-11-20T11:48:03.437759+0000","last_became_peered":"2020-11-20T11:48:03.437759+0000","last_unstale":"2020-11-20T12:13:38.864190+0000","last_undegraded":"2020-11-20T12:13:38.864190+0000","last_fullsized":"2020-11-20T12:13:38.864190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:13:38.864185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:13:38.864185+0000","last_clean_scrub_stamp":"2020-11-20T12:13:38.864185+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"28'15782","reported_seq":"16659","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:40.424256+0000","last_change":"2020-11-20T12:13:40.424318+0000","last_active":"2020-11-20T12:13:40.424256+0000","last_peered":"2020-11-20T12:13:40.424256+0000","last_clean":"2020-11-20T12:13:40.424256+0000","last_became_active":"2020-11-20T11:48:06.484857+0000","last_became_peered":"2020-11-20T11:48:06.484857+0000","last_unstale":"2020-11-20T12:13:40.424256+0000","last_undegraded":"2020-11-20T12:13:40.424256+0000","last_fullsized":"2020-11-20T12:13:40.424256+0000","mapping_epoch":23,"log_start":"28'5700","ondisk_log_start":"28'5700","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'15782","last_scrub_stamp":"2020-11-20T12:13:40.424250+0000","last_deep_scrub":"28'15782","last_deep_scrub_stamp":"2020-11-20T12:13:40.424250+0000","last_clean_scrub_stamp":"2020-11-20T12:13:40.424250+0000","log_size":10082,"ondisk_log_size":10082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":863,"num_read_kb":4704,"num_write":15805,"num_write_kb":119765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"28'26399","reported_seq":"28425","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:38.131850+0000","last_change":"2020-11-20T12:13:38.131929+0000","last_active":"2020-11-20T12:13:38.131850+0000","last_peered":"2020-11-20T12:13:38.131850+0000","last_clean":"2020-11-20T12:13:38.131850+0000","last_became_active":"2020-11-20T11:48:09.599735+0000","last_became_peered":"2020-11-20T11:48:09.599735+0000","last_unstale":"2020-11-20T12:13:38.131850+0000","last_undegraded":"2020-11-20T12:13:38.131850+0000","last_fullsized":"2020-11-20T12:13:38.131850+0000","mapping_epoch":26,"log_start":"28'16359","ondisk_log_start":"28'16359","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'26399","last_scrub_stamp":"2020-11-20T12:13:38.131845+0000","last_deep_scrub":"28'26399","last_deep_scrub_stamp":"2020-11-20T12:13:38.131845+0000","last_clean_scrub_stamp":"2020-11-20T12:13:38.131845+0000","log_size":10040,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2012,"num_read_kb":122872,"num_write":18367,"num_write_kb":513978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,11,6],"acting":[1,4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:41.086003+0000","last_change":"2020-11-20T12:13:41.086067+0000","last_active":"2020-11-20T12:13:41.086003+0000","last_peered":"2020-11-20T12:13:41.086003+0000","last_clean":"2020-11-20T12:13:41.086003+0000","last_became_active":"2020-11-20T11:48:03.435438+0000","last_became_peered":"2020-11-20T11:48:03.435438+0000","last_unstale":"2020-11-20T12:13:41.086003+0000","last_undegraded":"2020-11-20T12:13:41.086003+0000","last_fullsized":"2020-11-20T12:13:41.086003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:13:41.086000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:13:41.086000+0000","last_clean_scrub_stamp":"2020-11-20T12:13:41.086000+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"28'21928","reported_seq":"22481","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:47.537213+0000","last_change":"2020-11-20T12:13:47.537274+0000","last_active":"2020-11-20T12:13:47.537213+0000","last_peered":"2020-11-20T12:13:47.537213+0000","last_clean":"2020-11-20T12:13:47.537213+0000","last_became_active":"2020-11-20T11:48:06.484250+0000","last_became_peered":"2020-11-20T11:48:06.484250+0000","last_unstale":"2020-11-20T12:13:47.537213+0000","last_undegraded":"2020-11-20T12:13:47.537213+0000","last_fullsized":"2020-11-20T12:13:47.537213+0000","mapping_epoch":23,"log_start":"28'11900","ondisk_log_start":"28'11900","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'21928","last_scrub_stamp":"2020-11-20T12:13:47.537207+0000","last_deep_scrub":"28'21928","last_deep_scrub_stamp":"2020-11-20T12:13:47.537207+0000","last_clean_scrub_stamp":"2020-11-20T12:13:47.537207+0000","log_size":10028,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":58179308,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":539,"num_read_kb":3921,"num_write":21970,"num_write_kb":180364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14931,"num_omap_keys":25,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"28'27292","reported_seq":"28494","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:40.075596+0000","last_change":"2020-11-20T12:13:40.075696+0000","last_active":"2020-11-20T12:13:40.075596+0000","last_peered":"2020-11-20T12:13:40.075596+0000","last_clean":"2020-11-20T12:13:40.075596+0000","last_became_active":"2020-11-20T11:48:09.598112+0000","last_became_peered":"2020-11-20T11:48:09.598112+0000","last_unstale":"2020-11-20T12:13:40.075596+0000","last_undegraded":"2020-11-20T12:13:40.075596+0000","last_fullsized":"2020-11-20T12:13:40.075596+0000","mapping_epoch":26,"log_start":"28'17256","ondisk_log_start":"28'17256","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'27292","last_scrub_stamp":"2020-11-20T12:13:40.075589+0000","last_deep_scrub":"28'27292","last_deep_scrub_stamp":"2020-11-20T12:13:40.075589+0000","last_clean_scrub_stamp":"2020-11-20T12:13:40.075589+0000","log_size":10036,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1188,"num_read_kb":87936,"num_write":19495,"num_write_kb":508885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"28'14086","reported_seq":"14697","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:39.211058+0000","last_change":"2020-11-20T12:13:39.211115+0000","last_active":"2020-11-20T12:13:39.211058+0000","last_peered":"2020-11-20T12:13:39.211058+0000","last_clean":"2020-11-20T12:13:39.211058+0000","last_became_active":"2020-11-20T11:48:06.644950+0000","last_became_peered":"2020-11-20T11:48:06.644950+0000","last_unstale":"2020-11-20T12:13:39.211058+0000","last_undegraded":"2020-11-20T12:13:39.211058+0000","last_fullsized":"2020-11-20T12:13:39.211058+0000","mapping_epoch":23,"log_start":"28'4000","ondisk_log_start":"28'4000","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'14086","last_scrub_stamp":"2020-11-20T12:13:39.211053+0000","last_deep_scrub":"28'14086","last_deep_scrub_stamp":"2020-11-20T12:13:39.211053+0000","last_clean_scrub_stamp":"2020-11-20T12:13:39.211053+0000","log_size":10086,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":29360703,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":602,"num_read_kb":4468,"num_write":14198,"num_write_kb":107079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12119,"num_omap_keys":20,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:35.558932+0000","last_change":"2020-11-20T12:13:35.559016+0000","last_active":"2020-11-20T12:13:35.558932+0000","last_peered":"2020-11-20T12:13:35.558932+0000","last_clean":"2020-11-20T12:13:35.558932+0000","last_became_active":"2020-11-20T11:48:03.440579+0000","last_became_peered":"2020-11-20T11:48:03.440579+0000","last_unstale":"2020-11-20T12:13:35.558932+0000","last_undegraded":"2020-11-20T12:13:35.558932+0000","last_fullsized":"2020-11-20T12:13:35.558932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:13:35.558927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:13:35.558927+0000","last_clean_scrub_stamp":"2020-11-20T12:13:35.558927+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10],"acting":[9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1","version":"28'27318","reported_seq":"28460","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:45.058183+0000","last_change":"2020-11-20T12:13:45.058283+0000","last_active":"2020-11-20T12:13:45.058183+0000","last_peered":"2020-11-20T12:13:45.058183+0000","last_clean":"2020-11-20T12:13:45.058183+0000","last_became_active":"2020-11-20T11:48:09.624778+0000","last_became_peered":"2020-11-20T11:48:09.624778+0000","last_unstale":"2020-11-20T12:13:45.058183+0000","last_undegraded":"2020-11-20T12:13:45.058183+0000","last_fullsized":"2020-11-20T12:13:45.058183+0000","mapping_epoch":26,"log_start":"28'17276","ondisk_log_start":"28'17276","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'27318","last_scrub_stamp":"2020-11-20T12:13:45.058177+0000","last_deep_scrub":"28'27318","last_deep_scrub_stamp":"2020-11-20T12:13:45.058177+0000","last_clean_scrub_stamp":"2020-11-20T12:13:45.058177+0000","log_size":10042,"ondisk_log_size":10042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1128,"num_read_kb":64348,"num_write":19481,"num_write_kb":566162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,11,8],"acting":[4,2,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:41.874267+0000","last_change":"2020-11-20T12:13:41.874328+0000","last_active":"2020-11-20T12:13:41.874267+0000","last_peered":"2020-11-20T12:13:41.874267+0000","last_clean":"2020-11-20T12:13:41.874267+0000","last_became_active":"2020-11-20T11:48:03.359617+0000","last_became_peered":"2020-11-20T11:48:03.359617+0000","last_unstale":"2020-11-20T12:13:41.874267+0000","last_undegraded":"2020-11-20T12:13:41.874267+0000","last_fullsized":"2020-11-20T12:13:41.874267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:13:41.874261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:13:41.874261+0000","last_clean_scrub_stamp":"2020-11-20T12:13:41.874261+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.6","version":"28'21170","reported_seq":"21184","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:32.913169+0000","last_change":"2020-11-20T12:13:32.913169+0000","last_active":"2020-11-20T12:13:32.913169+0000","last_peered":"2020-11-20T12:13:32.913169+0000","last_clean":"2020-11-20T12:13:32.913169+0000","last_became_active":"2020-11-20T11:48:06.483910+0000","last_became_peered":"2020-11-20T11:48:06.483910+0000","last_unstale":"2020-11-20T12:13:32.913169+0000","last_undegraded":"2020-11-20T12:13:32.913169+0000","last_fullsized":"2020-11-20T12:13:32.913169+0000","mapping_epoch":23,"log_start":"28'11100","ondisk_log_start":"28'11100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'21169","last_scrub_stamp":"2020-11-20T12:13:32.913105+0000","last_deep_scrub":"28'21169","last_deep_scrub_stamp":"2020-11-20T12:13:32.913105+0000","last_clean_scrub_stamp":"2020-11-20T12:13:32.913105+0000","log_size":10070,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25165824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21813,"num_write_kb":153246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2183,"num_omap_keys":23,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11751,"num_read_kb":727788,"num_write":152107,"num_write_kb":4201046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80229,"ondisk_log_size":80229,"up":32,"acting":32,"num_store_stats":12},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":239746965,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":2017,"num_read_kb":13093,"num_write":164576,"num_write_kb":1209643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":80875,"num_omap_keys":156,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":367804416,"data_stored":479493930,"data_compressed":52834740,"data_compressed_allocated":111747072,"data_compressed_original":223494144,"omap_allocated":0,"internal_metadata":0},"log_size":80382,"ondisk_log_size":80382,"up":16,"acting":16,"num_store_stats":9},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12390,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":10}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444345,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":444432,"kb_used_data":49224,"kb_used_omap":0,"kb_used_meta":395200,"kb_avail":93927408,"statfs":{"total":96636764160,"available":96181665792,"internally_reserved":0,"allocated":50405376,"data_stored":63050557,"data_compressed":6045917,"data_compressed_allocated":12808192,"data_compressed_original":25616384,"omap_allocated":0,"internal_metadata":404684800},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:13:52 2020","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.1890000000000001,"15min":1.0069999999999999},"min":{"1min":0.60599999999999998,"5min":0.55600000000000005,"15min":0.53300000000000003},"max":{"1min":4.5209999999999999,"5min":12.345000000000001,"15min":12.345000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.179,"15min":1.0629999999999999},"min":{"1min":0.63600000000000001,"5min":0.57799999999999996,"15min":0.54800000000000004},"max":{"1min":2.3759999999999999,"5min":12.679,"15min":12.679},"last":0.90400000000000003}]},{"osd":1,"last update":"Fri Nov 20 12:13:52 2020","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.1759999999999999,"15min":1.212},"min":{"1min":0.58799999999999997,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.7570000000000001,"5min":12.709,"15min":12.709},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.4810000000000001,"15min":3.0099999999999998},"min":{"1min":0.82099999999999995,"5min":0.61099999999999999,"15min":0.54400000000000004},"max":{"1min":4.6449999999999996,"5min":12.489000000000001,"15min":285.29500000000002},"last":1.268}]},{"osd":2,"last update":"Fri Nov 20 12:13:52 2020","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.4419999999999999,"15min":1.2509999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.56999999999999995},"max":{"1min":3.4169999999999998,"5min":12.311,"15min":12.311},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.335,"5min":1.4339999999999999,"15min":1.268},"min":{"1min":0.79300000000000004,"5min":0.624,"15min":0.61199999999999999},"max":{"1min":3.4119999999999999,"5min":12.285,"15min":12.285},"last":0.97299999999999998}]},{"osd":3,"last update":"Fri Nov 20 12:13:52 2020","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.5109999999999999,"15min":1.7529999999999999},"min":{"1min":0.86099999999999999,"5min":0.621,"15min":0.621},"max":{"1min":2.8700000000000001,"5min":12.523999999999999,"15min":90.236999999999995},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.552,"5min":1.694,"15min":1.8720000000000001},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.82499999999999996},"max":{"1min":5.0810000000000004,"5min":12.629,"15min":90.265000000000001},"last":1.536}]},{"osd":4,"last update":"Fri Nov 20 12:13:52 2020","interfaces":[{"interface":"back","average":{"1min":1.6739999999999999,"5min":1.8839999999999999,"15min":2.1389999999999998},"min":{"1min":0.97299999999999998,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":5.3360000000000003,"5min":12.944000000000001,"15min":120.355},"last":1.403},{"interface":"front","average":{"1min":1.5069999999999999,"5min":1.8120000000000001,"15min":1.655},"min":{"1min":1.0509999999999999,"5min":0.94499999999999995,"15min":0.79500000000000004},"max":{"1min":3.0299999999999998,"5min":12.964,"15min":12.964},"last":1.802}]},{"osd":5,"last update":"Fri Nov 20 12:13:52 2020","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.7549999999999999,"15min":1.605},"min":{"1min":1.0149999999999999,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.9729999999999999,"5min":12.843999999999999,"15min":12.843999999999999},"last":1.359},{"interface":"front","average":{"1min":1.9450000000000001,"5min":2.0449999999999999,"15min":1.998},"min":{"1min":1.131,"5min":0.94299999999999995,"15min":0.874},"max":{"1min":5.4509999999999996,"5min":13.067,"15min":68.132000000000005},"last":1.6910000000000001}]},{"osd":6,"last update":"Fri Nov 20 12:13:52 2020","interfaces":[{"interface":"back","average":{"1min":1.7889999999999999,"5min":1.79,"15min":1.8080000000000001},"min":{"1min":1.177,"5min":1.0649999999999999,"15min":1.0189999999999999},"max":{"1min":6.2549999999999999,"5min":12.826000000000001,"15min":12.826000000000001},"last":1.6100000000000001},{"interface":"front","average":{"1min":1.6699999999999999,"5min":1.8400000000000001,"15min":1.736},"min":{"1min":1.1439999999999999,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":3.0760000000000001,"5min":12.98,"15min":12.98},"last":1.631}]},{"osd":7,"last update":"Fri Nov 20 12:13:52 2020","interfaces":[{"interface":"back","average":{"1min":1.7110000000000001,"5min":1.9990000000000001,"15min":1.869},"min":{"1min":1.256,"5min":1.1870000000000001,"15min":0.96699999999999997},"max":{"1min":3.1850000000000001,"5min":13.167999999999999,"15min":13.167999999999999},"last":1.72},{"interface":"front","average":{"1min":1.786,"5min":2.0539999999999998,"15min":1.9630000000000001},"min":{"1min":1.212,"5min":1.0860000000000001,"15min":1.0860000000000001},"max":{"1min":3.2919999999999998,"5min":13.102,"15min":13.102},"last":1.7729999999999999}]},{"osd":8,"last update":"Fri Nov 20 12:13:52 2020","interfaces":[{"interface":"back","average":{"1min":1.913,"5min":1.9910000000000001,"15min":1.851},"min":{"1min":1.1970000000000001,"5min":1.141,"15min":1.016},"max":{"1min":5.585,"5min":13.148,"15min":13.148},"last":1.833},{"interface":"front","average":{"1min":2.028,"5min":1.976,"15min":1.8500000000000001},"min":{"1min":1.327,"5min":1.1000000000000001,"15min":1.0680000000000001},"max":{"1min":7.6349999999999998,"5min":13.086,"15min":13.086},"last":1.893}]},{"osd":10,"last update":"Fri Nov 20 12:13:52 2020","interfaces":[{"interface":"back","average":{"1min":1.9710000000000001,"5min":2.2389999999999999,"15min":2.0310000000000001},"min":{"1min":1.276,"5min":1.262,"15min":1.179},"max":{"1min":5.2169999999999996,"5min":13.220000000000001,"15min":13.220000000000001},"last":1.9239999999999999},{"interface":"front","average":{"1min":1.875,"5min":2.2589999999999999,"15min":2.1110000000000002},"min":{"1min":1.391,"5min":1.306,"15min":1.1379999999999999},"max":{"1min":3.3029999999999999,"5min":13.233000000000001,"15min":19.605},"last":1.986}]}]},{"osd":10,"up_from":17,"seq":73014444346,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127908,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":127616,"kb_avail":94243932,"statfs":{"total":96636764160,"available":96505786368,"internally_reserved":0,"allocated":290816,"data_stored":135963,"data_compressed":2789,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":130678784},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.5569999999999999,"15min":1.333},"min":{"1min":0.68000000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.8799999999999999,"5min":7.4349999999999996,"15min":8.9849999999999994},"last":0.67000000000000004},{"interface":"front","average":{"1min":1.5840000000000001,"5min":1.5449999999999999,"15min":1.276},"min":{"1min":0.70199999999999996,"5min":0.60999999999999999,"15min":0.60199999999999998},"max":{"1min":4.5270000000000001,"5min":6.7789999999999999,"15min":6.7789999999999999},"last":0.69499999999999995}]},{"osd":1,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":1.8169999999999999,"5min":2.0790000000000002,"15min":1.7849999999999999},"min":{"1min":0.69699999999999995,"5min":0.66300000000000003,"15min":0.59199999999999997},"max":{"1min":11.619999999999999,"5min":12.619999999999999,"15min":12.619999999999999},"last":1.026},{"interface":"front","average":{"1min":2.1520000000000001,"5min":2.0489999999999999,"15min":1.7729999999999999},"min":{"1min":0.76000000000000001,"5min":0.70899999999999996,"15min":0.58899999999999997},"max":{"1min":11.154,"5min":11.154,"15min":11.154},"last":1.111}]},{"osd":2,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":2.0640000000000001,"5min":1.851,"15min":1.504},"min":{"1min":0.69799999999999995,"5min":0.69099999999999995,"15min":0.53000000000000003},"max":{"1min":6.7939999999999996,"5min":6.7939999999999996,"15min":6.7939999999999996},"last":0.72999999999999998},{"interface":"front","average":{"1min":1.845,"5min":2.0310000000000001,"15min":1.7649999999999999},"min":{"1min":0.91100000000000003,"5min":0.89600000000000002,"15min":0.79600000000000004},"max":{"1min":5.4710000000000001,"5min":7.718,"15min":13.505000000000001},"last":1.1719999999999999}]},{"osd":3,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":1.8200000000000001,"5min":1.9870000000000001,"15min":1.8220000000000001},"min":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.73199999999999998},"max":{"1min":4.6539999999999999,"5min":7.0979999999999999,"15min":12.358000000000001},"last":1.2889999999999999},{"interface":"front","average":{"1min":2.548,"5min":2.141,"15min":1.742},"min":{"1min":0.75600000000000001,"5min":0.69499999999999995,"15min":0.61199999999999999},"max":{"1min":10.074,"5min":10.074,"15min":10.074},"last":1.0660000000000001}]},{"osd":4,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":1.909,"5min":2.4119999999999999,"15min":2.2210000000000001},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.85799999999999998},"max":{"1min":3.145,"5min":8.4710000000000001,"15min":26.497},"last":1.27},{"interface":"front","average":{"1min":2.2709999999999999,"5min":2.4239999999999999,"15min":2.1659999999999999},"min":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":0.79000000000000004},"max":{"1min":5.923,"5min":10.172000000000001,"15min":10.478999999999999},"last":1.7190000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":2.5219999999999998,"5min":2.448,"15min":2.1349999999999998},"min":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.0760000000000001},"max":{"1min":11.5,"5min":11.5,"15min":13.752000000000001},"last":1.482},{"interface":"front","average":{"1min":3.5939999999999999,"5min":2.5470000000000002,"15min":2.2280000000000002},"min":{"1min":1.216,"5min":1.165,"15min":1.0580000000000001},"max":{"1min":30.359000000000002,"5min":30.359000000000002,"15min":30.359000000000002},"last":1.4370000000000001}]},{"osd":6,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":2.3849999999999998,"5min":2.3580000000000001,"15min":1.982},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.85899999999999999},"max":{"1min":6.9039999999999999,"5min":7.5549999999999997,"15min":7.5549999999999997},"last":1.2110000000000001},{"interface":"front","average":{"1min":2.238,"5min":2.444,"15min":2.274},"min":{"1min":1.1970000000000001,"5min":1.145,"15min":1.054},"max":{"1min":5.766,"5min":7.9749999999999996,"15min":13.630000000000001},"last":1.5660000000000001}]},{"osd":7,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":2.4420000000000002,"5min":2.5019999999999998,"15min":2.3570000000000002},"min":{"1min":1.3129999999999999,"5min":1.248,"15min":1.1839999999999999},"max":{"1min":5.3840000000000003,"5min":7.4779999999999998,"15min":11.385999999999999},"last":1.6339999999999999},{"interface":"front","average":{"1min":4.0830000000000002,"5min":2.8679999999999999,"15min":2.4220000000000002},"min":{"1min":1.1599999999999999,"5min":1.0509999999999999,"15min":0.94899999999999995},"max":{"1min":20.331,"5min":20.331,"15min":20.707000000000001},"last":1.653}]},{"osd":9,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":3.2530000000000001,"5min":2.774,"15min":2.3079999999999998},"min":{"1min":1.091,"5min":1.091,"15min":1.034},"max":{"1min":11.122,"5min":11.122,"15min":11.432},"last":1.3580000000000001},{"interface":"front","average":{"1min":2.6840000000000002,"5min":2.6120000000000001,"15min":2.3180000000000001},"min":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.1519999999999999},"max":{"1min":11.372999999999999,"5min":11.372999999999999,"15min":13.865},"last":1.3839999999999999}]},{"osd":11,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":2.4729999999999999,"5min":2.504,"15min":2.2879999999999998},"min":{"1min":1.286,"5min":1.2729999999999999,"15min":1.268},"max":{"1min":5.5069999999999997,"5min":7.5380000000000003,"15min":10.875},"last":1.5389999999999999},{"interface":"front","average":{"1min":3.3130000000000002,"5min":2.7909999999999999,"15min":2.3530000000000002},"min":{"1min":1.232,"5min":1.2170000000000001,"15min":1.101},"max":{"1min":11.676,"5min":11.676,"15min":11.676},"last":1.51}]}]},{"osd":9,"up_from":17,"seq":73014444345,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45668,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":45376,"kb_avail":94326172,"statfs":{"total":96636764160,"available":96590000128,"internally_reserved":0,"allocated":290816,"data_stored":135963,"data_compressed":2789,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":46465024},"hb_peers":[0,1,2,3,4,5,6,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:12:57 2020","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.095,"15min":1.123},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":3.3069999999999999,"5min":5.5289999999999999,"15min":8.7680000000000007},"last":1.093},{"interface":"front","average":{"1min":1.1619999999999999,"5min":1.1879999999999999,"15min":1.2789999999999999},"min":{"1min":0.72799999999999998,"5min":0.627,"15min":0.627},"max":{"1min":3.3730000000000002,"5min":5.4500000000000002,"15min":9.0199999999999996},"last":1.1299999999999999}]},{"osd":1,"last update":"Fri Nov 20 12:12:57 2020","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.9370000000000001,"15min":2.0790000000000002},"min":{"1min":0.627,"5min":0.627,"15min":0.59699999999999998},"max":{"1min":6.2560000000000002,"5min":66.763000000000005,"15min":126.151},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.601,"15min":1.625},"min":{"1min":0.753,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.0579999999999998,"5min":6.556,"15min":31.262},"last":1.595}]},{"osd":2,"last update":"Fri Nov 20 12:12:57 2020","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.339,"15min":1.379},"min":{"1min":0.75,"5min":0.67400000000000004,"15min":0.67100000000000004},"max":{"1min":2.6619999999999999,"5min":4.0179999999999998,"15min":8.9760000000000009},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.5720000000000001,"5min":1.4670000000000001,"15min":1.524},"min":{"1min":0.96399999999999997,"5min":0.748,"15min":0.69899999999999995},"max":{"1min":6.9359999999999999,"5min":6.9359999999999999,"15min":9.0449999999999999},"last":1.46}]},{"osd":3,"last update":"Fri Nov 20 12:12:57 2020","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.2310000000000001,"15min":1.3899999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.61599999999999999},"max":{"1min":2.262,"5min":6.3440000000000003,"15min":8.7949999999999999},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.476,"5min":1.643,"15min":1.7110000000000001},"min":{"1min":0.94599999999999995,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":2.7879999999999998,"5min":6.2050000000000001,"15min":9.2219999999999995},"last":1.6220000000000001}]},{"osd":4,"last update":"Fri Nov 20 12:12:57 2020","interfaces":[{"interface":"back","average":{"1min":1.7729999999999999,"5min":1.891,"15min":1.7569999999999999},"min":{"1min":1.1180000000000001,"5min":0.93200000000000005,"15min":0.61599999999999999},"max":{"1min":6.8019999999999996,"5min":6.8259999999999996,"15min":9.6609999999999996},"last":1.7410000000000001},{"interface":"front","average":{"1min":1.7450000000000001,"5min":1.665,"15min":1.7010000000000001},"min":{"1min":0.73099999999999998,"5min":0.65500000000000003,"15min":0.65200000000000002},"max":{"1min":4.2649999999999997,"5min":6.0810000000000004,"15min":9.2829999999999995},"last":1.446}]},{"osd":5,"last update":"Fri Nov 20 12:12:57 2020","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.554,"15min":1.6379999999999999},"min":{"1min":0.872,"5min":0.872,"15min":0.746},"max":{"1min":1.96,"5min":6.0170000000000003,"15min":9.1519999999999992},"last":1.655},{"interface":"front","average":{"1min":1.619,"5min":1.8220000000000001,"15min":1.804},"min":{"1min":1.097,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":2.903,"5min":6.3310000000000004,"15min":9.0980000000000008},"last":1.792}]},{"osd":6,"last update":"Fri Nov 20 12:12:57 2020","interfaces":[{"interface":"back","average":{"1min":1.835,"5min":1.978,"15min":2.0169999999999999},"min":{"1min":1.23,"5min":1.0109999999999999,"15min":0.84499999999999997},"max":{"1min":3.238,"5min":6.5890000000000004,"15min":9.8030000000000008},"last":1.921},{"interface":"front","average":{"1min":1.782,"5min":1.9470000000000001,"15min":1.95},"min":{"1min":1.2509999999999999,"5min":1.115,"15min":1.03},"max":{"1min":3.4889999999999999,"5min":7.2110000000000003,"15min":10.294},"last":1.893}]},{"osd":8,"last update":"Fri Nov 20 12:12:57 2020","interfaces":[{"interface":"back","average":{"1min":1.7090000000000001,"5min":1.901,"15min":1.9099999999999999},"min":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":0.96899999999999997},"max":{"1min":3.359,"5min":6.9560000000000004,"15min":10.076000000000001},"last":2.1539999999999999},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.72,"15min":1.861},"min":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"max":{"1min":2.0979999999999999,"5min":5.226,"15min":9.5210000000000008},"last":1.859}]},{"osd":10,"last update":"Fri Nov 20 12:12:57 2020","interfaces":[{"interface":"back","average":{"1min":2.161,"5min":2.226,"15min":2.0990000000000002},"min":{"1min":1.1830000000000001,"5min":1.139,"15min":1.1359999999999999},"max":{"1min":4.9880000000000004,"5min":7.0339999999999998,"15min":9.4830000000000005},"last":2.0510000000000002},{"interface":"front","average":{"1min":2.4590000000000001,"5min":2.242,"15min":2.0830000000000002},"min":{"1min":1.359,"5min":1.2010000000000001,"15min":1.093},"max":{"1min":9.3160000000000007,"5min":9.3160000000000007,"15min":10.202999999999999},"last":2.0209999999999999}]},{"osd":11,"last update":"Fri Nov 20 12:12:57 2020","interfaces":[{"interface":"back","average":{"1min":1.754,"5min":1.833,"15min":1.962},"min":{"1min":1.129,"5min":1.1100000000000001,"15min":1.1100000000000001},"max":{"1min":4.8920000000000003,"5min":5.4450000000000003,"15min":9.4060000000000006},"last":1.7749999999999999},{"interface":"front","average":{"1min":1.8919999999999999,"5min":2.052,"15min":2.0830000000000002},"min":{"1min":1.2809999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"max":{"1min":3.8809999999999998,"5min":8.5890000000000004,"15min":9.6059999999999999},"last":2.1840000000000002}]}]},{"osd":8,"up_from":17,"seq":73014444346,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313648,"kb_used_data":30056,"kb_used_omap":0,"kb_used_meta":283584,"kb_avail":94058192,"statfs":{"total":96636764160,"available":96315588608,"internally_reserved":0,"allocated":30777344,"data_stored":37884733,"data_compressed":3425241,"data_compressed_allocated":7270400,"data_compressed_original":14540800,"omap_allocated":0,"internal_metadata":290390016},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:13:37 2020","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.92600000000000005,"15min":0.94999999999999996},"min":{"1min":0.63,"5min":0.55800000000000005,"15min":0.54500000000000004},"max":{"1min":1.5669999999999999,"5min":2.6880000000000002,"15min":8.4719999999999995},"last":0.87},{"interface":"front","average":{"1min":1.345,"5min":1.226,"15min":1.0880000000000001},"min":{"1min":0.61399999999999999,"5min":0.57799999999999996,"15min":0.56999999999999995},"max":{"1min":4.915,"5min":6.3029999999999999,"15min":6.3029999999999999},"last":1.3129999999999999}]},{"osd":1,"last update":"Fri Nov 20 12:13:37 2020","interfaces":[{"interface":"back","average":{"1min":1.5900000000000001,"5min":1.4410000000000001,"15min":1.181},"min":{"1min":0.66500000000000004,"5min":0.58999999999999997,"15min":0.56000000000000005},"max":{"1min":6.2439999999999998,"5min":13.785,"15min":13.785},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.5,"5min":1.454,"15min":1.3640000000000001},"min":{"1min":0.72999999999999998,"5min":0.66300000000000003,"15min":0.59299999999999997},"max":{"1min":4.1609999999999996,"5min":14.462999999999999,"15min":14.462999999999999},"last":1.3540000000000001}]},{"osd":2,"last update":"Fri Nov 20 12:13:37 2020","interfaces":[{"interface":"back","average":{"1min":1.722,"5min":1.4490000000000001,"15min":1.226},"min":{"1min":0.76200000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":6.2220000000000004,"5min":6.444,"15min":6.444},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.454,"15min":1.288},"min":{"1min":0.65900000000000003,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":5.2430000000000003,"5min":5.5149999999999997,"15min":5.5149999999999997},"last":0.91500000000000004}]},{"osd":3,"last update":"Fri Nov 20 12:13:37 2020","interfaces":[{"interface":"back","average":{"1min":1.6060000000000001,"5min":1.5629999999999999,"15min":1.409},"min":{"1min":0.75700000000000001,"5min":0.70499999999999996,"15min":0.66700000000000004},"max":{"1min":6.117,"5min":6.117,"15min":6.117},"last":1.042},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.3979999999999999,"15min":1.496},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73299999999999998},"max":{"1min":2.7669999999999999,"5min":2.7669999999999999,"15min":29.010999999999999},"last":1.1739999999999999}]},{"osd":4,"last update":"Fri Nov 20 12:13:37 2020","interfaces":[{"interface":"back","average":{"1min":1.625,"5min":1.633,"15min":1.956},"min":{"1min":1.0169999999999999,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":3.085,"5min":5.4589999999999996,"15min":54.881},"last":1.5229999999999999},{"interface":"front","average":{"1min":1.962,"5min":1.8720000000000001,"15min":1.992},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":5.0449999999999999,"5min":6.5679999999999996,"15min":55.497},"last":1.4610000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:13:37 2020","interfaces":[{"interface":"back","average":{"1min":1.798,"5min":1.8979999999999999,"15min":1.952},"min":{"1min":0.96899999999999997,"5min":0.92500000000000004,"15min":0.86499999999999999},"max":{"1min":6.5910000000000002,"5min":6.9699999999999998,"15min":54.777000000000001},"last":1.496},{"interface":"front","average":{"1min":1.8160000000000001,"5min":1.8340000000000001,"15min":1.978},"min":{"1min":1.109,"5min":1.095,"15min":0.84899999999999998},"max":{"1min":3.1930000000000001,"5min":7.891,"15min":54.634999999999998},"last":1.6930000000000001}]},{"osd":7,"last update":"Fri Nov 20 12:13:37 2020","interfaces":[{"interface":"back","average":{"1min":2.407,"5min":2.1230000000000002,"15min":2.0649999999999999},"min":{"1min":0.997,"5min":0.997,"15min":0.997},"max":{"1min":5.6459999999999999,"5min":6.702,"15min":55.015999999999998},"last":1.5820000000000001},{"interface":"front","average":{"1min":2.2280000000000002,"5min":2.0289999999999999,"15min":2.04},"min":{"1min":1.143,"5min":1.042,"15min":1.042},"max":{"1min":6.4770000000000003,"5min":6.4770000000000003,"15min":54.698},"last":1.6519999999999999}]},{"osd":9,"last update":"Fri Nov 20 12:13:37 2020","interfaces":[{"interface":"back","average":{"1min":1.7430000000000001,"5min":1.7509999999999999,"15min":1.9550000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":3.0129999999999999,"5min":3.944,"15min":54.500999999999998},"last":1.944},{"interface":"front","average":{"1min":2.1379999999999999,"5min":1.962,"15min":2.004},"min":{"1min":1.123,"5min":1.089,"15min":1.048},"max":{"1min":5.274,"5min":6.8280000000000003,"15min":55.392000000000003},"last":1.8859999999999999}]},{"osd":10,"last update":"Fri Nov 20 12:13:37 2020","interfaces":[{"interface":"back","average":{"1min":2.2130000000000001,"5min":2.2370000000000001,"15min":2.1890000000000001},"min":{"1min":1.2090000000000001,"5min":1.1799999999999999,"15min":1.0580000000000001},"max":{"1min":6.3650000000000002,"5min":6.3700000000000001,"15min":54.901000000000003},"last":1.748},{"interface":"front","average":{"1min":1.8600000000000001,"5min":2.016,"15min":2.1320000000000001},"min":{"1min":1.262,"5min":1.2270000000000001,"15min":1.1559999999999999},"max":{"1min":3.2410000000000001,"5min":6.0659999999999998,"15min":54.753},"last":1.8360000000000001}]},{"osd":11,"last update":"Fri Nov 20 12:13:37 2020","interfaces":[{"interface":"back","average":{"1min":2.2639999999999998,"5min":2.109,"15min":2.069},"min":{"1min":1.2450000000000001,"5min":1.077,"15min":1.077},"max":{"1min":6.3470000000000004,"5min":6.9530000000000003,"15min":55.133000000000003},"last":1.7230000000000001},{"interface":"front","average":{"1min":2.2250000000000001,"5min":2.069,"15min":2.0680000000000001},"min":{"1min":1.286,"5min":1.111,"15min":1.095},"max":{"1min":6.7199999999999998,"5min":6.7199999999999998,"15min":54.609999999999999},"last":1.8620000000000001}]}]},{"osd":7,"up_from":17,"seq":73014444346,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":283572,"kb_used_data":28012,"kb_used_omap":0,"kb_used_meta":255552,"kb_avail":94088268,"statfs":{"total":96636764160,"available":96346386432,"internally_reserved":0,"allocated":28684288,"data_stored":37885274,"data_compressed":4461955,"data_compressed_allocated":9367552,"data_compressed_original":18735104,"omap_allocated":0,"internal_metadata":261685248},"hb_peers":[0,1,2,3,4,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:13:50 2020","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.3240000000000001,"15min":1.137},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.60599999999999998},"max":{"1min":4.0910000000000002,"5min":6.5129999999999999,"15min":6.5129999999999999},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.375,"5min":1.446,"15min":1.329},"min":{"1min":0.75900000000000001,"5min":0.71299999999999997,"15min":0.67100000000000004},"max":{"1min":2.8740000000000001,"5min":5.508,"15min":8.5229999999999997},"last":1.3400000000000001}]},{"osd":1,"last update":"Fri Nov 20 12:13:50 2020","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.5349999999999999,"15min":1.4359999999999999},"min":{"1min":0.69399999999999995,"5min":0.60199999999999998,"15min":0.57099999999999995},"max":{"1min":5.8120000000000003,"5min":7.7850000000000001,"15min":27.488},"last":0.89200000000000002},{"interface":"front","average":{"1min":3.1269999999999998,"5min":2.9449999999999998,"15min":2.1230000000000002},"min":{"1min":0.69899999999999995,"5min":0.61299999999999999,"15min":0.55200000000000005},"max":{"1min":34.600999999999999,"5min":71.591999999999999,"15min":71.591999999999999},"last":0.85599999999999998}]},{"osd":2,"last update":"Fri Nov 20 12:13:50 2020","interfaces":[{"interface":"back","average":{"1min":1.7150000000000001,"5min":1.823,"15min":1.5129999999999999},"min":{"1min":0.92700000000000005,"5min":0.81399999999999995,"15min":0.55800000000000005},"max":{"1min":4.1769999999999996,"5min":6.9569999999999999,"15min":6.9569999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.831,"5min":1.7470000000000001,"15min":1.5609999999999999},"min":{"1min":0.98599999999999999,"5min":0.86099999999999999,"15min":0.63100000000000001},"max":{"1min":5.2329999999999997,"5min":7.4569999999999999,"15min":12.949999999999999},"last":1.391}]},{"osd":3,"last update":"Fri Nov 20 12:13:50 2020","interfaces":[{"interface":"back","average":{"1min":1.8129999999999999,"5min":1.915,"15min":1.726},"min":{"1min":1.0209999999999999,"5min":0.81399999999999995,"15min":0.66200000000000003},"max":{"1min":3.8900000000000001,"5min":6.8529999999999998,"15min":8.6959999999999997},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.8089999999999999,"5min":2.1219999999999999,"15min":1.802},"min":{"1min":0.97199999999999998,"5min":0.91000000000000003,"15min":0.748},"max":{"1min":4.2380000000000004,"5min":6.8289999999999997,"15min":6.8479999999999999},"last":1.657}]},{"osd":4,"last update":"Fri Nov 20 12:13:50 2020","interfaces":[{"interface":"back","average":{"1min":1.9550000000000001,"5min":2.0569999999999999,"15min":1.8859999999999999},"min":{"1min":0.97899999999999998,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":5.3150000000000004,"5min":7.5350000000000001,"15min":26.966000000000001},"last":1.2030000000000001},{"interface":"front","average":{"1min":2.2879999999999998,"5min":2.319,"15min":2.1440000000000001},"min":{"1min":1.0840000000000001,"5min":0.876,"15min":0.78900000000000003},"max":{"1min":6.399,"5min":8.6560000000000006,"15min":26.786999999999999},"last":1.4419999999999999}]},{"osd":6,"last update":"Fri Nov 20 12:13:50 2020","interfaces":[{"interface":"back","average":{"1min":1.772,"5min":2.4039999999999999,"15min":2.0089999999999999},"min":{"1min":1.107,"5min":0.995,"15min":0.66000000000000003},"max":{"1min":4.2990000000000004,"5min":10.233000000000001,"15min":10.233000000000001},"last":1.262},{"interface":"front","average":{"1min":2.0800000000000001,"5min":2.133,"15min":1.8839999999999999},"min":{"1min":1.1399999999999999,"5min":0.81399999999999995,"15min":0.75800000000000001},"max":{"1min":5.4630000000000001,"5min":7.5990000000000002,"15min":11.321},"last":1.4910000000000001}]},{"osd":8,"last update":"Fri Nov 20 12:13:50 2020","interfaces":[{"interface":"back","average":{"1min":2.9630000000000001,"5min":2.403,"15min":2.0880000000000001},"min":{"1min":1.3260000000000001,"5min":0.999,"15min":0.92400000000000004},"max":{"1min":13.618,"5min":13.618,"15min":13.618},"last":1.5349999999999999},{"interface":"front","average":{"1min":2.4100000000000001,"5min":2.4649999999999999,"15min":2.0899999999999999},"min":{"1min":1.3029999999999999,"5min":1.1910000000000001,"15min":0.874},"max":{"1min":7.3170000000000002,"5min":7.3170000000000002,"15min":9.2720000000000002},"last":1.089}]},{"osd":9,"last update":"Fri Nov 20 12:13:50 2020","interfaces":[{"interface":"back","average":{"1min":2.0449999999999999,"5min":2.4889999999999999,"15min":2.1829999999999998},"min":{"1min":1.369,"5min":1.21,"15min":1.032},"max":{"1min":4.4779999999999998,"5min":7.3479999999999999,"15min":7.5979999999999999},"last":1.5620000000000001},{"interface":"front","average":{"1min":2.246,"5min":2.4319999999999999,"15min":2.0819999999999999},"min":{"1min":1.355,"5min":1.0660000000000001,"15min":0.97199999999999998},"max":{"1min":5.6920000000000002,"5min":7.6619999999999999,"15min":11.436999999999999},"last":1.577}]},{"osd":10,"last update":"Fri Nov 20 12:13:50 2020","interfaces":[{"interface":"back","average":{"1min":2.355,"5min":2.5,"15min":2.3109999999999999},"min":{"1min":1.2629999999999999,"5min":1.105,"15min":0.81999999999999995},"max":{"1min":4.6520000000000001,"5min":8.423,"15min":8.9809999999999999},"last":1.712},{"interface":"front","average":{"1min":2.181,"5min":2.681,"15min":2.3730000000000002},"min":{"1min":1.395,"5min":0.96799999999999997,"15min":0.96099999999999997},"max":{"1min":4.4189999999999996,"5min":7.4710000000000001,"15min":8.0190000000000001},"last":1.3720000000000001}]},{"osd":11,"last update":"Fri Nov 20 12:13:50 2020","interfaces":[{"interface":"back","average":{"1min":2.3780000000000001,"5min":2.4180000000000001,"15min":2.101},"min":{"1min":1.2909999999999999,"5min":1.133,"15min":0.88600000000000001},"max":{"1min":6.1900000000000004,"5min":7.7229999999999999,"15min":11.547000000000001},"last":1.681},{"interface":"front","average":{"1min":2.3799999999999999,"5min":2.4809999999999999,"15min":2.3109999999999999},"min":{"1min":1.3939999999999999,"5min":1.1759999999999999,"15min":0.98199999999999998},"max":{"1min":4.7590000000000003,"5min":10.367000000000001,"15min":14.678000000000001},"last":1.627}]}]},{"osd":6,"up_from":17,"seq":73014444346,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":453476,"kb_used_data":61468,"kb_used_omap":0,"kb_used_meta":392000,"kb_avail":93918364,"statfs":{"total":96636764160,"available":96172404736,"internally_reserved":0,"allocated":62943232,"data_stored":83481095,"data_compressed":9754370,"data_compressed_allocated":20705280,"data_compressed_original":41410560,"omap_allocated":0,"internal_metadata":401408000},"hb_peers":[0,1,2,3,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:13:36 2020","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.329,"15min":1.1739999999999999},"min":{"1min":0.67500000000000004,"5min":0.58699999999999997,"15min":0.54100000000000004},"max":{"1min":3.1739999999999999,"5min":11.004,"15min":11.004},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.97299999999999998,"15min":1.0209999999999999},"min":{"1min":0.67400000000000004,"5min":0.60499999999999998,"15min":0.56200000000000006},"max":{"1min":1.845,"5min":3.9860000000000002,"15min":8.5150000000000006},"last":0.86899999999999999}]},{"osd":1,"last update":"Fri Nov 20 12:13:36 2020","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.3160000000000001,"15min":1.381},"min":{"1min":0.77700000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.4100000000000001,"5min":4.5179999999999998,"15min":6.1369999999999996},"last":1.2849999999999999},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.4910000000000001,"15min":2.1899999999999999},"min":{"1min":0.68999999999999995,"5min":0.58099999999999996,"15min":0.56899999999999995},"max":{"1min":1.542,"5min":21.001000000000001,"15min":136.38},"last":0.90800000000000003}]},{"osd":2,"last update":"Fri Nov 20 12:13:36 2020","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.278,"15min":1.4139999999999999},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.58399999999999996},"max":{"1min":1.4810000000000001,"5min":6.9470000000000001,"15min":34.850999999999999},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.6850000000000001,"15min":1.5289999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.64600000000000002},"max":{"1min":2.8050000000000002,"5min":12.048999999999999,"15min":12.048999999999999},"last":1.24}]},{"osd":3,"last update":"Fri Nov 20 12:13:36 2020","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.4219999999999999,"15min":1.4450000000000001},"min":{"1min":0.88900000000000001,"5min":0.71499999999999997,"15min":0.68700000000000006},"max":{"1min":2.1749999999999998,"5min":4.6500000000000004,"15min":6.5990000000000002},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.3839999999999999,"15min":1.6319999999999999},"min":{"1min":0.86099999999999999,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.952,"5min":4.9889999999999999,"15min":54.747},"last":1.325}]},{"osd":5,"last update":"Fri Nov 20 12:13:36 2020","interfaces":[{"interface":"back","average":{"1min":1.6259999999999999,"5min":1.8819999999999999,"15min":1.766},"min":{"1min":0.97699999999999998,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":2.9369999999999998,"5min":12.162000000000001,"15min":21.766999999999999},"last":1.6739999999999999},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.635,"15min":1.6739999999999999},"min":{"1min":1.133,"5min":0.97499999999999998,"15min":0.84899999999999998},"max":{"1min":2.532,"5min":4.7880000000000003,"15min":22.012},"last":1.609}]},{"osd":7,"last update":"Fri Nov 20 12:13:36 2020","interfaces":[{"interface":"back","average":{"1min":1.895,"5min":1.7669999999999999,"15min":1.827},"min":{"1min":0.96099999999999997,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":6.4189999999999996,"5min":6.8789999999999996,"15min":34.982999999999997},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.881,"5min":2.1400000000000001,"15min":1.9550000000000001},"min":{"1min":1.1759999999999999,"5min":1.0049999999999999,"15min":0.874},"max":{"1min":4.3120000000000003,"5min":11.670999999999999,"15min":11.670999999999999},"last":1.524}]},{"osd":8,"last update":"Fri Nov 20 12:13:36 2020","interfaces":[{"interface":"back","average":{"1min":1.655,"5min":1.8160000000000001,"15min":1.7709999999999999},"min":{"1min":1.2070000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":2.6539999999999999,"5min":7.4560000000000004,"15min":7.4560000000000004},"last":1.885},{"interface":"front","average":{"1min":1.6020000000000001,"5min":1.829,"15min":1.984},"min":{"1min":1.2090000000000001,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":2.7730000000000001,"5min":6.4550000000000001,"15min":54.307000000000002},"last":1.5569999999999999}]},{"osd":9,"last update":"Fri Nov 20 12:13:36 2020","interfaces":[{"interface":"back","average":{"1min":1.79,"5min":2.0190000000000001,"15min":1.9450000000000001},"min":{"1min":1.073,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":3.5409999999999999,"5min":11.795999999999999,"15min":11.795999999999999},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.895,"5min":1.875,"15min":1.849},"min":{"1min":1.2769999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"max":{"1min":4.4740000000000002,"5min":7.3869999999999996,"15min":7.3869999999999996},"last":1.7529999999999999}]},{"osd":10,"last update":"Fri Nov 20 12:13:36 2020","interfaces":[{"interface":"back","average":{"1min":1.742,"5min":2.028,"15min":2.137},"min":{"1min":0.997,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":2.891,"5min":8.8759999999999994,"15min":54.162999999999997},"last":1.651},{"interface":"front","average":{"1min":2.1360000000000001,"5min":2.3690000000000002,"15min":2.1749999999999998},"min":{"1min":1.22,"5min":1.1819999999999999,"15min":1.0469999999999999},"max":{"1min":5.056,"5min":11.913,"15min":11.913},"last":1.8109999999999999}]},{"osd":11,"last update":"Fri Nov 20 12:13:36 2020","interfaces":[{"interface":"back","average":{"1min":1.964,"5min":1.9750000000000001,"15min":1.9510000000000001},"min":{"1min":1.347,"5min":1.1279999999999999,"15min":1.1279999999999999},"max":{"1min":4.5570000000000004,"5min":7.2610000000000001,"15min":7.2610000000000001},"last":1.962},{"interface":"front","average":{"1min":1.7430000000000001,"5min":1.9099999999999999,"15min":2.1190000000000002},"min":{"1min":1.325,"5min":1.077,"15min":1.077},"max":{"1min":3.0009999999999999,"5min":6.6970000000000001,"15min":54.432000000000002},"last":1.7390000000000001}]}]},{"osd":1,"up_from":17,"seq":73014444344,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":472096,"kb_used_data":48216,"kb_used_omap":0,"kb_used_meta":423872,"kb_avail":93899744,"statfs":{"total":96636764160,"available":96153337856,"internally_reserved":0,"allocated":49373184,"data_stored":66703879,"data_compressed":8227218,"data_compressed_allocated":17498112,"data_compressed_original":34996224,"omap_allocated":0,"internal_metadata":434044928},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.2070000000000001,"15min":1.123},"min":{"1min":0.71999999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":4.5490000000000004,"5min":6.0700000000000003,"15min":6.1559999999999997},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.49,"5min":1.5429999999999999,"15min":1.363},"min":{"1min":0.71999999999999997,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":6.5190000000000001,"5min":6.5190000000000001,"15min":9.3610000000000007},"last":1.395}]},{"osd":2,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.4810000000000001,"15min":1.3140000000000001},"min":{"1min":0.74399999999999999,"5min":0.59799999999999998,"15min":0.58699999999999997},"max":{"1min":4.0030000000000001,"5min":6.6760000000000002,"15min":6.6760000000000002},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.508,"15min":1.4450000000000001},"min":{"1min":0.84699999999999998,"5min":0.73899999999999999,"15min":0.54900000000000004},"max":{"1min":4.4180000000000001,"5min":6.3159999999999998,"15min":8.5210000000000008},"last":0.92100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":4,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":1.8400000000000001,"5min":1.99,"15min":1.764},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":8.1389999999999993,"5min":8.1389999999999993,"15min":9.5419999999999998},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.802,"5min":1.919,"15min":1.837},"min":{"1min":0.76800000000000002,"5min":0.67700000000000005,"15min":0.66700000000000004},"max":{"1min":4.2859999999999996,"5min":7.077,"15min":12.92},"last":1.3500000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":1.871,"5min":2.0129999999999999,"15min":1.819},"min":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.78400000000000003},"max":{"1min":6.7809999999999997,"5min":6.7809999999999997,"15min":9.7870000000000008},"last":1.042},{"interface":"front","average":{"1min":1.6319999999999999,"5min":1.766,"15min":1.6539999999999999},"min":{"1min":0.95499999999999996,"5min":0.82899999999999996,"15min":0.60299999999999998},"max":{"1min":4.4539999999999997,"5min":6.7939999999999996,"15min":7.4240000000000004},"last":1.0649999999999999}]},{"osd":6,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":1.72,"5min":1.8660000000000001,"15min":1.7430000000000001},"min":{"1min":0.98099999999999998,"5min":0.81399999999999995,"15min":0.68400000000000005},"max":{"1min":6.109,"5min":7.7210000000000001,"15min":7.7210000000000001},"last":1.244},{"interface":"front","average":{"1min":2.0249999999999999,"5min":2.173,"15min":2.032},"min":{"1min":1.1599999999999999,"5min":1.0740000000000001,"15min":0.97499999999999998},"max":{"1min":7.4320000000000004,"5min":7.4320000000000004,"15min":9.2859999999999996},"last":1.5609999999999999}]},{"osd":7,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":1.952,"5min":2.0609999999999999,"15min":1.946},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":6.6680000000000001,"5min":7.2539999999999996,"15min":8.8810000000000002},"last":1.212},{"interface":"front","average":{"1min":1.887,"5min":2.1219999999999999,"15min":2.044},"min":{"1min":1.1200000000000001,"5min":1.042,"15min":0.92300000000000004},"max":{"1min":6.359,"5min":7.0540000000000003,"15min":8.6080000000000005},"last":1.585}]},{"osd":8,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":2.1800000000000002,"5min":2.4860000000000002,"15min":2.2850000000000001},"min":{"1min":1.3220000000000001,"5min":1.2,"15min":1.1950000000000001},"max":{"1min":6.6589999999999998,"5min":14.266999999999999,"15min":14.266999999999999},"last":1.712},{"interface":"front","average":{"1min":2.1469999999999998,"5min":2.3199999999999998,"15min":2.1190000000000002},"min":{"1min":1.2110000000000001,"5min":0.98299999999999998,"15min":0.82599999999999996},"max":{"1min":6.79,"5min":14.351000000000001,"15min":14.351000000000001},"last":1.5249999999999999}]},{"osd":9,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":1.919,"5min":2.0979999999999999,"15min":2.0649999999999999},"min":{"1min":1.1599999999999999,"5min":1.079,"15min":1.079},"max":{"1min":6.2450000000000001,"5min":7.2149999999999999,"15min":11.465999999999999},"last":1.8819999999999999},{"interface":"front","average":{"1min":2.2490000000000001,"5min":2.4079999999999999,"15min":2.2999999999999998},"min":{"1min":1.393,"5min":1.2689999999999999,"15min":1.1970000000000001},"max":{"1min":6.9059999999999997,"5min":6.9059999999999997,"15min":12.558999999999999},"last":1.865}]},{"osd":10,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":2.2679999999999998,"5min":2.415,"15min":2.242},"min":{"1min":1.3069999999999999,"5min":1.1120000000000001,"15min":1.0069999999999999},"max":{"1min":6.4710000000000001,"5min":7.335,"15min":8.7420000000000009},"last":1.74},{"interface":"front","average":{"1min":2.5750000000000002,"5min":2.8820000000000001,"15min":2.673},"min":{"1min":1.3600000000000001,"5min":1.343,"15min":1.272},"max":{"1min":7.0229999999999997,"5min":7.298,"15min":12.689},"last":1.9650000000000001}]},{"osd":11,"last update":"Fri Nov 20 12:13:08 2020","interfaces":[{"interface":"back","average":{"1min":2.9239999999999999,"5min":2.6949999999999998,"15min":2.4830000000000001},"min":{"1min":1.4570000000000001,"5min":1.409,"15min":1.3540000000000001},"max":{"1min":7.141,"5min":7.141,"15min":12.827},"last":2.0529999999999999},{"interface":"front","average":{"1min":3.077,"5min":2.7610000000000001,"15min":2.5699999999999998},"min":{"1min":1.544,"5min":1.4710000000000001,"15min":1.389},"max":{"1min":7.25,"5min":7.25,"15min":12.941000000000001},"last":2.1299999999999999}]}]},{"osd":0,"up_from":17,"seq":73014444345,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":290796,"kb_used_data":19428,"kb_used_omap":0,"kb_used_meta":271360,"kb_avail":94081044,"statfs":{"total":96636764160,"available":96338989056,"internally_reserved":0,"allocated":19894272,"data_stored":25301787,"data_compressed":2644903,"data_compressed_allocated":5566464,"data_compressed_original":11132928,"omap_allocated":0,"internal_metadata":277872640},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 20 12:13:46 2020","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":1.0349999999999999,"15min":1.097},"min":{"1min":0.624,"5min":0.59499999999999997,"15min":0.56100000000000005},"max":{"1min":2.0659999999999998,"5min":8.7539999999999996,"15min":13.342000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.1339999999999999,"15min":1.1899999999999999},"min":{"1min":0.64300000000000002,"5min":0.61699999999999999,"15min":0.58999999999999997},"max":{"1min":2.2130000000000001,"5min":9.157,"15min":12.875},"last":0.99299999999999999}]},{"osd":2,"last update":"Fri Nov 20 12:13:46 2020","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.0620000000000001,"15min":1.1259999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.61199999999999999},"max":{"1min":2.121,"5min":4.4459999999999997,"15min":5.7370000000000001},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.179,"5min":1.2130000000000001,"15min":1.236},"min":{"1min":0.80100000000000005,"5min":0.69999999999999996,"15min":0.56799999999999995},"max":{"1min":1.599,"5min":2.2330000000000001,"15min":6.3029999999999999},"last":1.6379999999999999}]},{"osd":3,"last update":"Fri Nov 20 12:13:46 2020","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.327,"15min":1.3120000000000001},"min":{"1min":0.66500000000000004,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.359,"5min":4.7539999999999996,"15min":13.930999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.1679999999999999,"15min":1.244},"min":{"1min":0.64300000000000002,"5min":0.621,"15min":0.59299999999999997},"max":{"1min":2.5430000000000001,"5min":4.46,"15min":5.5339999999999998},"last":0.86399999999999999}]},{"osd":4,"last update":"Fri Nov 20 12:13:46 2020","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.488,"15min":1.496},"min":{"1min":0.78700000000000003,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.6600000000000001,"5min":5.7610000000000001,"15min":7.8120000000000003},"last":1.181},{"interface":"front","average":{"1min":1.242,"5min":1.452,"15min":1.4950000000000001},"min":{"1min":0.89100000000000001,"5min":0.83999999999999997,"15min":0.58299999999999996},"max":{"1min":1.7749999999999999,"5min":5.4000000000000004,"15min":7.9980000000000002},"last":1.1200000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:13:46 2020","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.5269999999999999,"15min":1.583},"min":{"1min":0.96999999999999997,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.78,"5min":6.5609999999999999,"15min":13.669},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.5289999999999999,"15min":1.5529999999999999},"min":{"1min":1.095,"5min":0.83199999999999996,"15min":0.81899999999999995},"max":{"1min":1.6719999999999999,"5min":5.2160000000000002,"15min":13.018000000000001},"last":1.2050000000000001}]},{"osd":6,"last update":"Fri Nov 20 12:13:46 2020","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.641,"15min":1.6879999999999999},"min":{"1min":1.0529999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":3.0840000000000001,"5min":6.6790000000000003,"15min":8.0410000000000004},"last":1.038},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.605,"15min":1.7030000000000001},"min":{"1min":1.1359999999999999,"5min":0.95399999999999996,"15min":0.73799999999999999},"max":{"1min":1.899,"5min":3.2709999999999999,"15min":6.6909999999999998},"last":1.3109999999999999}]},{"osd":7,"last update":"Fri Nov 20 12:13:46 2020","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.714,"15min":1.698},"min":{"1min":1.2310000000000001,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.9750000000000001,"5min":7.827,"15min":8.5820000000000007},"last":1.7589999999999999},{"interface":"front","average":{"1min":1.639,"5min":1.8129999999999999,"15min":1.8799999999999999},"min":{"1min":1.244,"5min":1.0600000000000001,"15min":1.0509999999999999},"max":{"1min":2.766,"5min":6.4400000000000004,"15min":9.5909999999999993},"last":1.4370000000000001}]},{"osd":8,"last update":"Fri Nov 20 12:13:46 2020","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.7669999999999999,"15min":1.7549999999999999},"min":{"1min":1.244,"5min":1.0549999999999999,"15min":1.0549999999999999},"max":{"1min":2.0600000000000001,"5min":5.2309999999999999,"15min":8.3469999999999995},"last":1.575},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.768,"15min":1.827},"min":{"1min":1.3029999999999999,"5min":1.157,"15min":1.0900000000000001},"max":{"1min":2.8740000000000001,"5min":6.556,"15min":8.4039999999999999},"last":1.363}]},{"osd":9,"last update":"Fri Nov 20 12:13:46 2020","interfaces":[{"interface":"back","average":{"1min":1.6439999999999999,"5min":1.768,"15min":1.833},"min":{"1min":1.2869999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"max":{"1min":2.1520000000000001,"5min":4.3129999999999997,"15min":8.4610000000000003},"last":1.819},{"interface":"front","average":{"1min":1.661,"5min":1.8919999999999999,"15min":1.907},"min":{"1min":1.4179999999999999,"5min":1.042,"15min":1.042},"max":{"1min":2.0489999999999999,"5min":5.6879999999999997,"15min":8.4649999999999999},"last":1.6639999999999999}]},{"osd":11,"last update":"Fri Nov 20 12:13:46 2020","interfaces":[{"interface":"back","average":{"1min":1.6639999999999999,"5min":1.7609999999999999,"15min":1.867},"min":{"1min":1.3620000000000001,"5min":1.177,"15min":1.1699999999999999},"max":{"1min":2.004,"5min":4.4740000000000002,"15min":8.3800000000000008},"last":1.734},{"interface":"front","average":{"1min":1.661,"5min":1.8859999999999999,"15min":1.921},"min":{"1min":1.4890000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"max":{"1min":2.1800000000000002,"5min":5.4909999999999997,"15min":8.7029999999999994},"last":1.4830000000000001}]}]},{"osd":2,"up_from":17,"seq":73014444345,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51748,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":51456,"kb_avail":94320092,"statfs":{"total":96636764160,"available":96583774208,"internally_reserved":0,"allocated":290816,"data_stored":135963,"data_compressed":2789,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":52690944},"hb_peers":[0,1,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":0.96199999999999997,"15min":0.97699999999999998},"min":{"1min":0.625,"5min":0.60599999999999998,"15min":0.56299999999999994},"max":{"1min":1.7749999999999999,"5min":3.5840000000000001,"15min":3.8690000000000002},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.1759999999999999,"15min":1.1899999999999999},"min":{"1min":0.68799999999999994,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":3.0179999999999998,"5min":6.4470000000000001,"15min":8.0739999999999998},"last":0.96099999999999997}]},{"osd":1,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.2729999999999999,"15min":1.294},"min":{"1min":0.64800000000000002,"5min":0.60199999999999998,"15min":0.55800000000000005},"max":{"1min":4.9740000000000002,"5min":4.9740000000000002,"15min":29.183},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.47,"15min":1.3919999999999999},"min":{"1min":0.72399999999999998,"5min":0.622,"15min":0.57699999999999996},"max":{"1min":5.484,"5min":7.7560000000000002,"15min":11.492000000000001},"last":1.3169999999999999}]},{"osd":3,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.99199999999999999,"15min":1.079},"min":{"1min":0.66200000000000003,"5min":0.59499999999999997,"15min":0.58099999999999996},"max":{"1min":1.798,"5min":4.0129999999999999,"15min":6.0220000000000002},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.2549999999999999,"15min":1.238},"min":{"1min":0.68799999999999994,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":4.3220000000000001,"5min":4.3220000000000001,"15min":9.3160000000000007},"last":0.99299999999999999}]},{"osd":4,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":1.9350000000000001,"5min":1.4850000000000001,"15min":1.4359999999999999},"min":{"1min":0.82899999999999996,"5min":0.75700000000000001,"15min":0.58299999999999996},"max":{"1min":6.5430000000000001,"5min":6.5430000000000001,"15min":7.0510000000000002},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.679,"5min":1.54,"15min":1.4359999999999999},"min":{"1min":0.90900000000000003,"5min":0.745,"15min":0.72499999999999998},"max":{"1min":6.5919999999999996,"5min":6.5919999999999996,"15min":6.5919999999999996},"last":1.4990000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.367,"15min":1.343},"min":{"1min":0.73999999999999999,"5min":0.69899999999999995,"15min":0.624},"max":{"1min":2.7509999999999999,"5min":6.5869999999999997,"15min":7.3659999999999997},"last":1.272},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.502,"15min":1.597},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.65600000000000003},"max":{"1min":5.0830000000000002,"5min":9.1240000000000006,"15min":35.177},"last":1.4379999999999999}]},{"osd":6,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":1.5600000000000001,"5min":1.512,"15min":1.4630000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":5.0949999999999998,"5min":5.0949999999999998,"15min":5.4880000000000004},"last":1.6439999999999999},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.5629999999999999,"15min":1.619},"min":{"1min":1.0289999999999999,"5min":0.995,"15min":0.83799999999999997},"max":{"1min":3.097,"5min":6.7149999999999999,"15min":8.202},"last":1.359}]},{"osd":7,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":1.804,"5min":1.8480000000000001,"15min":1.7430000000000001},"min":{"1min":0.98999999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":5.1859999999999999,"5min":9.3460000000000001,"15min":10.002000000000001},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.6910000000000001,"5min":1.6890000000000001,"15min":1.613},"min":{"1min":1.101,"5min":1.0660000000000001,"15min":0.85799999999999998},"max":{"1min":3.9089999999999998,"5min":4.7460000000000004,"15min":4.9340000000000002},"last":1.772}]},{"osd":8,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":1.7589999999999999,"15min":1.6739999999999999},"min":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":0.81399999999999995},"max":{"1min":3.3610000000000002,"5min":8.3019999999999996,"15min":8.3019999999999996},"last":1.478},{"interface":"front","average":{"1min":1.853,"5min":1.8140000000000001,"15min":1.728},"min":{"1min":1.0600000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":5.2910000000000004,"5min":9.2420000000000009,"15min":9.2420000000000009},"last":1.732}]},{"osd":9,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":1.6830000000000001,"15min":1.633},"min":{"1min":1.173,"5min":1.081,"15min":0.999},"max":{"1min":2.839,"5min":4.2000000000000002,"15min":6.3769999999999998},"last":1.851},{"interface":"front","average":{"1min":1.635,"5min":1.7549999999999999,"15min":1.7849999999999999},"min":{"1min":1.2210000000000001,"5min":1.109,"15min":1.069},"max":{"1min":3.1829999999999998,"5min":6.8319999999999999,"15min":9.0559999999999992},"last":1.5800000000000001}]},{"osd":10,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":1.8999999999999999,"5min":1.956,"15min":1.847},"min":{"1min":1.2350000000000001,"5min":1.224,"15min":1.1739999999999999},"max":{"1min":4.4219999999999997,"5min":5.3609999999999998,"15min":6.4409999999999998},"last":1.9239999999999999},{"interface":"front","average":{"1min":2.3740000000000001,"5min":2.2210000000000001,"15min":2.1880000000000002},"min":{"1min":1.282,"5min":1.282,"15min":1.169},"max":{"1min":6.4589999999999996,"5min":13.752000000000001,"15min":29.145},"last":1.6739999999999999}]}]},{"osd":3,"up_from":17,"seq":73014444346,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":662340,"kb_used_data":83004,"kb_used_omap":0,"kb_used_meta":579328,"kb_avail":93709500,"statfs":{"total":96636764160,"available":95958528000,"internally_reserved":0,"allocated":84996096,"data_stored":110400418,"data_compressed":12152602,"data_compressed_allocated":25579520,"data_compressed_original":51159040,"omap_allocated":0,"internal_metadata":593231872},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.452,"15min":1.1060000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.54700000000000004},"max":{"1min":5.6319999999999997,"5min":32.991,"15min":32.991},"last":1.5529999999999999},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.6799999999999999,"15min":1.3560000000000001},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.621},"max":{"1min":1.591,"5min":33.176000000000002,"15min":33.176000000000002},"last":1.617}]},{"osd":1,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":1.962,"15min":1.5189999999999999},"min":{"1min":0.629,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3939999999999999,"5min":35.597999999999999,"15min":35.597999999999999},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.623,"15min":1.2749999999999999},"min":{"1min":0.64600000000000002,"5min":0.61299999999999999,"15min":0.59299999999999997},"max":{"1min":1.8240000000000001,"5min":33.368000000000002,"15min":33.368000000000002},"last":1.363}]},{"osd":2,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.772,"15min":1.4139999999999999},"min":{"1min":0.77000000000000002,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.4970000000000001,"5min":33.314,"15min":33.314},"last":1.399},{"interface":"front","average":{"1min":1.194,"5min":1.6299999999999999,"15min":1.4399999999999999},"min":{"1min":0.751,"5min":0.60899999999999999,"15min":0.60199999999999998},"max":{"1min":1.647,"5min":33.457000000000001,"15min":33.457000000000001},"last":1.337}]},{"osd":4,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.8080000000000001,"15min":1.5169999999999999},"min":{"1min":0.79000000000000004,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":3.02,"5min":33.484999999999999,"15min":33.484999999999999},"last":1.05},{"interface":"front","average":{"1min":1.5700000000000001,"5min":2.0680000000000001,"15min":1.6419999999999999},"min":{"1min":1.0049999999999999,"5min":0.80000000000000004,"15min":0.72599999999999998},"max":{"1min":7.8289999999999997,"5min":33.442999999999998,"15min":33.442999999999998},"last":1.026}]},{"osd":5,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":2.008,"15min":1.659},"min":{"1min":0.879,"5min":0.879,"15min":0.79000000000000004},"max":{"1min":2.012,"5min":33.523000000000003,"15min":33.523000000000003},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.371,"5min":1.857,"15min":1.696},"min":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.90600000000000003},"max":{"1min":1.746,"5min":33.753,"15min":33.753},"last":1.758}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":7,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":2.0289999999999999,"5min":2.1970000000000001,"15min":1.9159999999999999},"min":{"1min":1.0700000000000001,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":9.0589999999999993,"5min":33.869,"15min":33.869},"last":1.47},{"interface":"front","average":{"1min":1.861,"5min":2.0990000000000002,"15min":1.704},"min":{"1min":0.93200000000000005,"5min":0.879,"15min":0.83999999999999997},"max":{"1min":9.1400000000000006,"5min":36.171999999999997,"15min":36.171999999999997},"last":1.496}]},{"osd":8,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":1.538,"5min":2.0569999999999999,"15min":1.901},"min":{"1min":1.1419999999999999,"5min":1.0269999999999999,"15min":0.89300000000000002},"max":{"1min":1.8759999999999999,"5min":33.996000000000002,"15min":33.996000000000002},"last":1.891},{"interface":"front","average":{"1min":1.357,"5min":1.8979999999999999,"15min":1.6220000000000001},"min":{"1min":1.0369999999999999,"5min":0.84899999999999998,"15min":0.82299999999999995},"max":{"1min":1.9259999999999999,"5min":36.100000000000001,"15min":36.100000000000001},"last":1.599}]},{"osd":9,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":2.1709999999999998,"15min":1.8280000000000001},"min":{"1min":1.1060000000000001,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":2.2349999999999999,"5min":33.655999999999999,"15min":33.655999999999999},"last":1.698},{"interface":"front","average":{"1min":1.617,"5min":2.1880000000000002,"15min":2.0529999999999999},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":2.0739999999999998,"5min":34.082999999999998,"15min":34.082999999999998},"last":1.986}]},{"osd":10,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":2.1389999999999998,"15min":1.883},"min":{"1min":1.177,"5min":0.94099999999999995,"15min":0.90000000000000002},"max":{"1min":3.8039999999999998,"5min":36.235999999999997,"15min":36.235999999999997},"last":1.677},{"interface":"front","average":{"1min":1.714,"5min":2.3780000000000001,"15min":2.04},"min":{"1min":1.3380000000000001,"5min":1.0780000000000001,"15min":1.071},"max":{"1min":3.762,"5min":33.789999999999999,"15min":33.789999999999999},"last":1.8280000000000001}]},{"osd":11,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":1.764,"5min":2.375,"15min":2.1339999999999999},"min":{"1min":1.3129999999999999,"5min":1.24,"15min":1.153},"max":{"1min":3.0619999999999998,"5min":35.018999999999998,"15min":35.018999999999998},"last":2.0670000000000002},{"interface":"front","average":{"1min":1.5920000000000001,"5min":2.1819999999999999,"15min":1.871},"min":{"1min":1.206,"5min":1.194,"15min":1.0029999999999999},"max":{"1min":3.0899999999999999,"5min":36.298000000000002,"15min":36.298000000000002},"last":1.7869999999999999}]}]},{"osd":4,"up_from":17,"seq":73014444346,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":345160,"kb_used_data":29568,"kb_used_omap":0,"kb_used_meta":315584,"kb_avail":94026680,"statfs":{"total":96636764160,"available":96283320320,"internally_reserved":0,"allocated":30277632,"data_stored":39096515,"data_compressed":4213942,"data_compressed_allocated":8978432,"data_compressed_original":17956864,"omap_allocated":0,"internal_metadata":323158016},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":1,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.6579999999999999,"15min":1.52},"min":{"1min":0.68200000000000005,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":3.5070000000000001,"5min":10.784000000000001,"15min":35.734999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.542,"5min":1.8819999999999999,"15min":2.0070000000000001},"min":{"1min":0.68799999999999994,"5min":0.629,"15min":0.52500000000000002},"max":{"1min":6.048,"5min":8.0079999999999991,"15min":104.79300000000001},"last":0.81999999999999995}]},{"osd":2,"last update":"Fri Nov 20 12:12:58 2020","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.6100000000000001,"15min":1.506},"min":{"1min":0.83499999999999996,"5min":0.749,"15min":0.65600000000000003},"max":{"1min":2.556,"5min":6.843,"15min":6.843},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.373,"5min":1.8460000000000001,"15min":1.603},"min":{"1min":0.67000000000000004,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.5470000000000002,"5min":7.3079999999999998,"15min":16.853999999999999},"last":1.077}]},{"osd":3,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.853,"15min":1.667},"min":{"1min":1.069,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":2.827,"5min":10.906000000000001,"15min":10.906000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.536,"5min":2.028,"15min":1.7450000000000001},"min":{"1min":0.748,"5min":0.748,"15min":0.63700000000000001},"max":{"1min":2.6579999999999999,"5min":6.9779999999999998,"15min":11.813000000000001},"last":1.238}]},{"osd":5,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":1.569,"5min":1.6339999999999999,"15min":1.385},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.59599999999999997},"max":{"1min":5.5700000000000003,"5min":6.1689999999999996,"15min":6.6600000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.704,"5min":2.0870000000000002,"15min":1.8919999999999999},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":2.7509999999999999,"5min":5.9820000000000002,"15min":9.2070000000000007},"last":1.462}]},{"osd":6,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":1.768,"5min":1.6890000000000001,"15min":1.595},"min":{"1min":0.71799999999999997,"5min":0.64500000000000002,"15min":0.60499999999999998},"max":{"1min":5.6970000000000001,"5min":5.7850000000000001,"15min":25.809000000000001},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.8169999999999999,"5min":2.27,"15min":2.0819999999999999},"min":{"1min":1.1719999999999999,"5min":1.101,"15min":0.998},"max":{"1min":3.077,"5min":10.268000000000001,"15min":12.85},"last":1.5980000000000001}]},{"osd":7,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":2.0760000000000001,"5min":2.464,"15min":2.109},"min":{"1min":1.0149999999999999,"5min":0.92500000000000004,"15min":0.82899999999999996},"max":{"1min":5.8140000000000001,"5min":8.9719999999999995,"15min":16.713999999999999},"last":1.3500000000000001},{"interface":"front","average":{"1min":2.1230000000000002,"5min":2.1389999999999998,"15min":1.774},"min":{"1min":1.03,"5min":0.876,"15min":0.71399999999999997},"max":{"1min":6.1589999999999998,"5min":11.853,"15min":11.853},"last":1.274}]},{"osd":8,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":2.0270000000000001,"5min":2.637,"15min":2.2450000000000001},"min":{"1min":1.3540000000000001,"5min":1.161,"15min":1.1439999999999999},"max":{"1min":3.0720000000000001,"5min":12.117000000000001,"15min":12.117000000000001},"last":1.6859999999999999},{"interface":"front","average":{"1min":2.1339999999999999,"5min":2.4399999999999999,"15min":2.1160000000000001},"min":{"1min":1.1619999999999999,"5min":1.127,"15min":1.099},"max":{"1min":6,"5min":9.0939999999999994,"15min":11.938000000000001},"last":1.5309999999999999}]},{"osd":9,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":2.1539999999999999,"5min":2.5779999999999998,"15min":2.214},"min":{"1min":1.284,"5min":1.1890000000000001,"15min":1.0629999999999999},"max":{"1min":6.109,"5min":9.202,"15min":12.176},"last":1.637},{"interface":"front","average":{"1min":2.1579999999999999,"5min":2.1469999999999998,"15min":1.887},"min":{"1min":1.147,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":6.085,"5min":6.085,"15min":7.8689999999999998},"last":1.5669999999999999}]},{"osd":10,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":2.7589999999999999,"5min":2.5310000000000001,"15min":2.105},"min":{"1min":1.304,"5min":1.109,"15min":0.99399999999999999},"max":{"1min":6.4850000000000003,"5min":6.4850000000000003,"15min":8.0099999999999998},"last":1.4099999999999999},{"interface":"front","average":{"1min":2.4510000000000001,"5min":2.6579999999999999,"15min":2.3490000000000002},"min":{"1min":1.246,"5min":1.2210000000000001,"15min":1.2050000000000001},"max":{"1min":5.4009999999999998,"5min":10.391,"15min":10.391},"last":1.758}]},{"osd":11,"last update":"Fri Nov 20 12:12:52 2020","interfaces":[{"interface":"back","average":{"1min":2.1829999999999998,"5min":2.6299999999999999,"15min":2.3220000000000001},"min":{"1min":1.4139999999999999,"5min":1.278,"15min":1.1399999999999999},"max":{"1min":3.4380000000000002,"5min":10.654,"15min":10.654},"last":1.831},{"interface":"front","average":{"1min":2.298,"5min":2.7639999999999998,"15min":2.3330000000000002},"min":{"1min":1.351,"5min":1.2190000000000001,"15min":1.1359999999999999},"max":{"1min":6.2229999999999999,"5min":11.749000000000001,"15min":12.053000000000001},"last":1.4419999999999999}]}]},{"osd":5,"up_from":17,"seq":73014444347,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310052,"kb_used_data":12764,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94061788,"statfs":{"total":96636764160,"available":96319270912,"internally_reserved":0,"allocated":13070336,"data_stored":16913339,"data_compressed":1933693,"data_compressed_allocated":4009984,"data_compressed_original":8019968,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:13:42 2020","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.91600000000000004,"15min":0.88700000000000001},"min":{"1min":0.57399999999999995,"5min":0.54100000000000004,"15min":0.53800000000000003},"max":{"1min":2.0880000000000001,"5min":4.5519999999999996,"15min":6.7670000000000003},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.95199999999999996,"15min":0.97499999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":3.0329999999999999,"5min":6.3840000000000003,"15min":6.3840000000000003},"last":0.77400000000000002}]},{"osd":1,"last update":"Fri Nov 20 12:13:42 2020","interfaces":[{"interface":"back","average":{"1min":1.502,"5min":1.29,"15min":1.2430000000000001},"min":{"1min":0.55500000000000005,"5min":0.54700000000000004,"15min":0.52900000000000003},"max":{"1min":4.8650000000000002,"5min":7.069,"15min":11.497},"last":1.075},{"interface":"front","average":{"1min":1.74,"5min":1.504,"15min":1.4239999999999999},"min":{"1min":0.97499999999999998,"5min":0.76900000000000002,"15min":0.52900000000000003},"max":{"1min":4.8929999999999998,"5min":5.1390000000000002,"15min":8.4290000000000003},"last":0.754}]},{"osd":3,"last update":"Fri Nov 20 12:13:42 2020","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.296,"15min":1.2669999999999999},"min":{"1min":0.65300000000000002,"5min":0.58099999999999996,"15min":0.56000000000000005},"max":{"1min":4.2460000000000004,"5min":6.1299999999999999,"15min":20.777000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.319,"5min":1.304,"15min":1.3540000000000001},"min":{"1min":0.75900000000000001,"5min":0.67800000000000005,"15min":0.58599999999999997},"max":{"1min":2.6110000000000002,"5min":5.7279999999999998,"15min":11.946},"last":1.044}]},{"osd":4,"last update":"Fri Nov 20 12:13:42 2020","interfaces":[{"interface":"back","average":{"1min":1.637,"5min":1.5589999999999999,"15min":1.375},"min":{"1min":0.85799999999999998,"5min":0.69899999999999995,"15min":0.56399999999999995},"max":{"1min":5.181,"5min":6.4909999999999997,"15min":11.629},"last":0.997},{"interface":"front","average":{"1min":1.736,"5min":1.736,"15min":1.577},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.56200000000000006},"max":{"1min":9.4730000000000008,"5min":9.4730000000000008,"15min":10.872999999999999},"last":0.79700000000000004}]},{"osd":6,"last update":"Fri Nov 20 12:13:42 2020","interfaces":[{"interface":"back","average":{"1min":1.7030000000000001,"5min":1.47,"15min":1.4339999999999999},"min":{"1min":0.92900000000000005,"5min":0.625,"15min":0.625},"max":{"1min":5.4489999999999998,"5min":5.4489999999999998,"15min":7.0060000000000002},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.6679999999999999,"5min":1.4970000000000001,"15min":1.6850000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71299999999999997},"max":{"1min":5.3259999999999996,"5min":6.2370000000000001,"15min":54.036000000000001},"last":1.3879999999999999}]},{"osd":7,"last update":"Fri Nov 20 12:13:42 2020","interfaces":[{"interface":"back","average":{"1min":1.5589999999999999,"5min":1.716,"15min":1.55},"min":{"1min":0.90600000000000003,"5min":0.83599999999999997,"15min":0.76100000000000001},"max":{"1min":3.3610000000000002,"5min":7.0910000000000002,"15min":7.0910000000000002},"last":1.135},{"interface":"front","average":{"1min":2.2240000000000002,"5min":1.8,"15min":1.7070000000000001},"min":{"1min":1.04,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":7.6799999999999997,"5min":7.6799999999999997,"15min":11.364000000000001},"last":1.234}]},{"osd":8,"last update":"Fri Nov 20 12:13:42 2020","interfaces":[{"interface":"back","average":{"1min":1.6879999999999999,"5min":1.597,"15min":1.5960000000000001},"min":{"1min":1.0740000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":3.2170000000000001,"5min":5.0129999999999999,"15min":7.1189999999999998},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.776,"5min":1.718,"15min":1.6499999999999999},"min":{"1min":1.0469999999999999,"5min":0.86299999999999999,"15min":0.78400000000000003},"max":{"1min":5.0810000000000004,"5min":7.3860000000000001,"15min":7.3860000000000001},"last":1.26}]},{"osd":9,"last update":"Fri Nov 20 12:13:42 2020","interfaces":[{"interface":"back","average":{"1min":1.631,"5min":1.6819999999999999,"15min":1.6839999999999999},"min":{"1min":0.95999999999999996,"5min":0.95799999999999996,"15min":0.84799999999999998},"max":{"1min":4.3559999999999999,"5min":4.3559999999999999,"15min":10.994},"last":1.319},{"interface":"front","average":{"1min":1.7250000000000001,"5min":1.7090000000000001,"15min":1.6890000000000001},"min":{"1min":1.3280000000000001,"5min":1.0649999999999999,"15min":1.0649999999999999},"max":{"1min":2.7349999999999999,"5min":5.1639999999999997,"15min":7.2320000000000002},"last":1.4359999999999999}]},{"osd":10,"last update":"Fri Nov 20 12:13:42 2020","interfaces":[{"interface":"back","average":{"1min":1.871,"5min":1.9770000000000001,"15min":1.9219999999999999},"min":{"1min":1.1659999999999999,"5min":1.0760000000000001,"15min":1.0389999999999999},"max":{"1min":4.593,"5min":11.638999999999999,"15min":11.638999999999999},"last":1.417},{"interface":"front","average":{"1min":2.3570000000000002,"5min":1.9119999999999999,"15min":1.8420000000000001},"min":{"1min":1.393,"5min":1.1020000000000001,"15min":1.0780000000000001},"max":{"1min":6.2409999999999997,"5min":6.2409999999999997,"15min":7.3410000000000002},"last":1.284}]},{"osd":11,"last update":"Fri Nov 20 12:13:42 2020","interfaces":[{"interface":"back","average":{"1min":1.8560000000000001,"5min":1.802,"15min":1.6870000000000001},"min":{"1min":1.177,"5min":1.0249999999999999,"15min":1.0009999999999999},"max":{"1min":4.9669999999999996,"5min":7.2539999999999996,"15min":7.2539999999999996},"last":1.528},{"interface":"front","average":{"1min":1.867,"5min":1.8520000000000001,"15min":1.841},"min":{"1min":1.3340000000000001,"5min":1.105,"15min":1.0840000000000001},"max":{"1min":4.476,"5min":4.6959999999999997,"15min":11.231999999999999},"last":1.506}]}]}]}} 2020-11-20T12:13:57.838 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2020-11-20T11:48:08.486179+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=48, tm_sec=8, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=13, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:13:57.838 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2020-11-20T11:48:08.486179+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=48, tm_sec=8, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=13, tm_sec=30, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:13:57.839 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2020-11-20T12:14:01.669 INFO:tasks.ceph.osd.0.smithi192.stderr:2020-11-20T12:14:01.665+0000 7f79b0d25700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 31315) UID: 0 2020-11-20T12:14:01.670 INFO:tasks.ceph.osd.3.smithi192.stderr:2020-11-20T12:14:01.665+0000 7fc0bf346700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 31315) UID: 0 2020-11-20T12:14:01.670 INFO:tasks.ceph.osd.6.smithi192.stderr:2020-11-20T12:14:01.665+0000 7fe02eff7700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 31315) UID: 0 2020-11-20T12:14:01.670 INFO:tasks.ceph.osd.9.smithi192.stderr:2020-11-20T12:14:01.665+0000 7f7cbf4a3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 31315) UID: 0 2020-11-20T12:14:17.841 INFO:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-20T12:14:17.981 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.978+0000 7f3ac0ef2700 1 Processor -- start 2020-11-20T12:14:17.982 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.978+0000 7f3ac0ef2700 1 -- start start 2020-11-20T12:14:17.983 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.979+0000 7f3ac0ef2700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3abc060370 0x7f3abc060750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.983 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.979+0000 7f3ac0ef2700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7f3abc066110 0x7f3abc150410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.983 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.979+0000 7f3ac0ef2700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3abc0665a0 con 0x7f3abc1554b0 2020-11-20T12:14:17.984 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.979+0000 7f3ac0ef2700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3abc0635d0 con 0x7f3abc066110 2020-11-20T12:14:17.984 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.979+0000 7f3ac0ef2700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3abc1520a0 con 0x7f3abc060370 2020-11-20T12:14:17.984 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.979+0000 7f3aba59c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3abc060370 0x7f3abc060750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.984 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.979+0000 7f3aba59c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3abc060370 0x7f3abc060750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50132/0 (socket says 172.21.15.192:50132) 2020-11-20T12:14:17.985 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.979+0000 7f3aba59c700 1 -- 172.21.15.192:0/2315443374 learned_addr learned my addr 172.21.15.192:0/2315443374 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:14:17.985 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.979+0000 7f3abad9d700 1 --2- 172.21.15.192:0/2315443374 >> v2:172.21.15.87:3300/0 conn(0x7f3abc066110 0x7f3abc150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.990 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.980+0000 7f3aba59c700 1 -- 172.21.15.192:0/2315443374 >> v2:172.21.15.87:3300/0 conn(0x7f3abc066110 msgr2=0x7f3abc150410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:17.990 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.980+0000 7f3aba59c700 1 --2- 172.21.15.192:0/2315443374 >> v2:172.21.15.87:3300/0 conn(0x7f3abc066110 0x7f3abc150410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.990 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.980+0000 7f3aba59c700 1 -- 172.21.15.192:0/2315443374 >> v1:172.21.15.87:6789/0 conn(0x7f3abc1554b0 legacy=0x7f3abc0bfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.991 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.980+0000 7f3aba59c700 1 -- 172.21.15.192:0/2315443374 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3abc065490 con 0x7f3abc060370 2020-11-20T12:14:17.991 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.980+0000 7f3aba59c700 1 --2- 172.21.15.192:0/2315443374 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3abc060370 0x7f3abc060750 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f3abc0c2150 tx=0x7f3aac006ef0).ready entity=mon.2 client_cookie=c2ef9b3075b005f7 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:17.991 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.980+0000 7f3ab9d9b700 1 -- 172.21.15.192:0/2315443374 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac00b8f0 con 0x7f3abc060370 2020-11-20T12:14:17.991 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.980+0000 7f3ab9d9b700 1 -- 172.21.15.192:0/2315443374 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aac000e90 con 0x7f3abc060370 2020-11-20T12:14:17.991 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.980+0000 7f3ab9d9b700 1 -- 172.21.15.192:0/2315443374 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac00bc60 con 0x7f3abc060370 2020-11-20T12:14:17.992 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.980+0000 7f3ac0ef2700 1 -- 172.21.15.192:0/2315443374 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3abc060370 msgr2=0x7f3abc060750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.992 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.980+0000 7f3ac0ef2700 1 --2- 172.21.15.192:0/2315443374 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3abc060370 0x7f3abc060750 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f3abc0c2150 tx=0x7f3aac006ef0).stop 2020-11-20T12:14:17.992 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.980+0000 7f3ac0ef2700 1 -- 172.21.15.192:0/2315443374 shutdown_connections 2020-11-20T12:14:17.992 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.980+0000 7f3ac0ef2700 1 --2- 172.21.15.192:0/2315443374 >> v2:172.21.15.87:3300/0 conn(0x7f3abc066110 0x7f3abc150410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.992 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.980+0000 7f3ac0ef2700 1 --2- 172.21.15.192:0/2315443374 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3abc060370 0x7f3abc060750 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.993 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.980+0000 7f3ac0ef2700 1 -- 172.21.15.192:0/2315443374 >> 172.21.15.192:0/2315443374 conn(0x7f3abc0c46a0 msgr2=0x7f3abc0c4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:17.993 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.980+0000 7f3ac0ef2700 1 -- 172.21.15.192:0/2315443374 shutdown_connections 2020-11-20T12:14:17.993 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.980+0000 7f3ac0ef2700 1 -- 172.21.15.192:0/2315443374 wait complete. 2020-11-20T12:14:17.993 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.982+0000 7f3ac0ef2700 1 Processor -- start 2020-11-20T12:14:17.994 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.982+0000 7f3ac0ef2700 1 -- start start 2020-11-20T12:14:17.994 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.982+0000 7f3ac0ef2700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3abc060370 0x7f3abc160690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.994 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.982+0000 7f3ac0ef2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3abc066110 0x7f3abc0c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.994 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.982+0000 7f3ac0ef2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3abc1554b0 0x7f3abc0bdd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.994 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.982+0000 7f3ac0ef2700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc160d50 con 0x7f3abc060370 2020-11-20T12:14:17.995 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.982+0000 7f3ac0ef2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc160ff0 con 0x7f3abc1554b0 2020-11-20T12:14:17.995 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.982+0000 7f3ac0ef2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc161290 con 0x7f3abc066110 2020-11-20T12:14:17.995 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.983+0000 7f3ab1d9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3abc066110 0x7f3abc0c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.995 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.983+0000 7f3ab1d9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3abc066110 0x7f3abc0c4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50140/0 (socket says 172.21.15.192:50140) 2020-11-20T12:14:17.995 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.983+0000 7f3ab1d9b700 1 -- 172.21.15.192:0/2795046590 learned_addr learned my addr 172.21.15.192:0/2795046590 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:14:17.996 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.983+0000 7f3abad9d700 1 --2- 172.21.15.192:0/2795046590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3abc1554b0 0x7f3abc0bdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.996 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.983+0000 7f3aba59c700 1 --2- 172.21.15.192:0/2795046590 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3abc060370 0x7f3abc160690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.996 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.983+0000 7f3ab1d9b700 1 -- 172.21.15.192:0/2795046590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3abc1554b0 msgr2=0x7f3abc0bdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.996 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.983+0000 7f3ab1d9b700 1 --2- 172.21.15.192:0/2795046590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3abc1554b0 0x7f3abc0bdd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.996 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.983+0000 7f3ab1d9b700 1 -- 172.21.15.192:0/2795046590 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3abc060370 msgr2=0x7f3abc160690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.997 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.983+0000 7f3ab1d9b700 1 --2- 172.21.15.192:0/2795046590 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3abc060370 0x7f3abc160690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.997 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.983+0000 7f3ab1d9b700 1 -- 172.21.15.192:0/2795046590 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3abc161530 con 0x7f3abc066110 2020-11-20T12:14:17.997 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.983+0000 7f3aba59c700 1 --2- 172.21.15.192:0/2795046590 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3abc060370 0x7f3abc160690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:17.997 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.983+0000 7f3ab1d9b700 1 --2- 172.21.15.192:0/2795046590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3abc066110 0x7f3abc0c4c40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f3aa400c710 tx=0x7f3aa4007c40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:17.997 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.983+0000 7f3ab2ffd700 1 -- 172.21.15.192:0/2795046590 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa400e4a0 con 0x7f3abc066110 2020-11-20T12:14:17.998 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.983+0000 7f3ab2ffd700 1 -- 172.21.15.192:0/2795046590 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa4001e90 con 0x7f3abc066110 2020-11-20T12:14:17.998 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.983+0000 7f3ac0ef2700 1 -- 172.21.15.192:0/2795046590 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3abc0bb7b0 con 0x7f3abc066110 2020-11-20T12:14:17.998 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.983+0000 7f3ab2ffd700 1 -- 172.21.15.192:0/2795046590 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa400e830 con 0x7f3abc066110 2020-11-20T12:14:17.998 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.983+0000 7f3ac0ef2700 1 -- 172.21.15.192:0/2795046590 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3abc156780 con 0x7f3abc066110 2020-11-20T12:14:17.999 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.984+0000 7f3ac0ef2700 1 -- 172.21.15.192:0/2795046590 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3abc0699a0 con 0x7f3abc066110 2020-11-20T12:14:17.999 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.985+0000 7f3ab2ffd700 1 -- 172.21.15.192:0/2795046590 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f3aa4010030 con 0x7f3abc066110 2020-11-20T12:14:17.999 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.985+0000 7f3ab2ffd700 1 --2- 172.21.15.192:0/2795046590 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3a98080670 0x7f3a98082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.999 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.985+0000 7f3ab2ffd700 1 -- 172.21.15.192:0/2795046590 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f3aa40a24e0 con 0x7f3abc066110 2020-11-20T12:14:18.000 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.989+0000 7f3aba59c700 1 --2- 172.21.15.192:0/2795046590 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3a98080670 0x7f3a98082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:18.000 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.989+0000 7f3ab2ffd700 1 -- 172.21.15.192:0/2795046590 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f3aa4076ef0 con 0x7f3abc066110 2020-11-20T12:14:18.000 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:17.989+0000 7f3aba59c700 1 --2- 172.21.15.192:0/2795046590 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3a98080670 0x7f3a98082b30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f3aac006f30 tx=0x7f3aac016000).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:18.139 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.136+0000 7f3ac0ef2700 1 -- 172.21.15.192:0/2795046590 --> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3abc0665a0 con 0x7f3a98080670 2020-11-20T12:14:18.144 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.141+0000 7f3ab2ffd700 1 -- 172.21.15.192:0/2795046590 <== mgr.4106 v2:172.21.15.192:6800/22925 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+149448 (secure 0 0 0) 0x7f3abc0665a0 con 0x7f3a98080670 2020-11-20T12:14:18.144 INFO:teuthology.orchestra.run.smithi192.stdout: 2020-11-20T12:14:18.148 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.143+0000 7f3ac0ef2700 1 -- 172.21.15.192:0/2795046590 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3a98080670 msgr2=0x7f3a98082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:18.148 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.143+0000 7f3ac0ef2700 1 --2- 172.21.15.192:0/2795046590 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3a98080670 0x7f3a98082b30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f3aac006f30 tx=0x7f3aac016000).stop 2020-11-20T12:14:18.148 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.143+0000 7f3ac0ef2700 1 -- 172.21.15.192:0/2795046590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3abc066110 msgr2=0x7f3abc0c4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:18.148 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.143+0000 7f3ac0ef2700 1 --2- 172.21.15.192:0/2795046590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3abc066110 0x7f3abc0c4c40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f3aa400c710 tx=0x7f3aa4007c40).stop 2020-11-20T12:14:18.148 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.143+0000 7f3ac0ef2700 1 -- 172.21.15.192:0/2795046590 shutdown_connections 2020-11-20T12:14:18.149 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.143+0000 7f3ac0ef2700 1 --2- 172.21.15.192:0/2795046590 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7f3a98080670 0x7f3a98082b30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.149 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.143+0000 7f3ac0ef2700 1 --2- 172.21.15.192:0/2795046590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3abc1554b0 0x7f3abc0bdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.149 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.143+0000 7f3ac0ef2700 1 --2- 172.21.15.192:0/2795046590 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7f3abc060370 0x7f3abc160690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.149 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.143+0000 7f3ac0ef2700 1 --2- 172.21.15.192:0/2795046590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3abc066110 0x7f3abc0c4c40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.149 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.143+0000 7f3ac0ef2700 1 -- 172.21.15.192:0/2795046590 >> 172.21.15.192:0/2795046590 conn(0x7f3abc0c46a0 msgr2=0x7f3abc151580 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:18.150 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.143+0000 7f3ac0ef2700 1 -- 172.21.15.192:0/2795046590 shutdown_connections 2020-11-20T12:14:18.150 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.143+0000 7f3ac0ef2700 1 -- 172.21.15.192:0/2795046590 wait complete. 2020-11-20T12:14:18.150 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2020-11-20T12:14:18.158 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":808,"stamp":"2020-11-20T12:14:16.620394+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":239746965,"num_objects":90,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":0,"num_read":13768,"num_read_kb":740881,"num_write":316686,"num_write_kb":5410704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":93265,"num_omap_keys":159,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160617,"ondisk_log_size":160617,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":3800896,"kb_used_data":362592,"kb_used_omap":0,"kb_used_meta":3438208,"kb_avail":1128661184,"statfs":{"total":1159641169920,"available":1155749052416,"internally_reserved":0,"allocated":371294208,"data_stored":481125486,"data_compressed":52868208,"data_compressed_allocated":111796224,"data_compressed_original":223592448,"omap_allocated":0,"internal_metadata":3520724992},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002051"},"pg_stats":[{"pgid":"4.2","version":"28'28165","reported_seq":"29426","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:37.108042+0000","last_change":"2020-11-20T12:13:37.108139+0000","last_active":"2020-11-20T12:13:37.108042+0000","last_peered":"2020-11-20T12:13:37.108042+0000","last_clean":"2020-11-20T12:13:37.108042+0000","last_became_active":"2020-11-20T11:48:09.603149+0000","last_became_peered":"2020-11-20T11:48:09.603149+0000","last_unstale":"2020-11-20T12:13:37.108042+0000","last_undegraded":"2020-11-20T12:13:37.108042+0000","last_fullsized":"2020-11-20T12:13:37.108042+0000","mapping_epoch":26,"log_start":"28'18154","ondisk_log_start":"28'18154","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'28165","last_scrub_stamp":"2020-11-20T12:13:37.108036+0000","last_deep_scrub":"28'28165","last_deep_scrub_stamp":"2020-11-20T12:13:37.108036+0000","last_clean_scrub_stamp":"2020-11-20T12:13:37.108036+0000","log_size":10011,"ondisk_log_size":10011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1247,"num_read_kb":71900,"num_write":20182,"num_write_kb":535970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4,7],"acting":[1,8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:33.600746+0000","last_change":"2020-11-20T12:13:33.600835+0000","last_active":"2020-11-20T12:13:33.600746+0000","last_peered":"2020-11-20T12:13:33.600746+0000","last_clean":"2020-11-20T12:13:33.600746+0000","last_became_active":"2020-11-20T11:48:03.440545+0000","last_became_peered":"2020-11-20T11:48:03.440545+0000","last_unstale":"2020-11-20T12:13:33.600746+0000","last_undegraded":"2020-11-20T12:13:33.600746+0000","last_fullsized":"2020-11-20T12:13:33.600746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:13:33.600741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:13:33.600741+0000","last_clean_scrub_stamp":"2020-11-20T12:13:33.600741+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10],"acting":[9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"28'26312","reported_seq":"26326","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:41.768991+0000","last_change":"2020-11-20T12:13:41.769056+0000","last_active":"2020-11-20T12:13:41.768991+0000","last_peered":"2020-11-20T12:13:41.768991+0000","last_clean":"2020-11-20T12:13:41.768991+0000","last_became_active":"2020-11-20T11:48:06.484261+0000","last_became_peered":"2020-11-20T11:48:06.484261+0000","last_unstale":"2020-11-20T12:13:41.768991+0000","last_undegraded":"2020-11-20T12:13:41.768991+0000","last_fullsized":"2020-11-20T12:13:41.768991+0000","mapping_epoch":23,"log_start":"28'16300","ondisk_log_start":"28'16300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'26312","last_scrub_stamp":"2020-11-20T12:13:41.768985+0000","last_deep_scrub":"28'26312","last_deep_scrub_stamp":"2020-11-20T12:13:41.768985+0000","last_clean_scrub_stamp":"2020-11-20T12:13:41.768985+0000","log_size":10012,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16777376,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":26397,"num_write_kb":171630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":21225,"num_omap_keys":35,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'27002","reported_seq":"28352","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:56.494872+0000","last_change":"2020-11-20T12:13:56.494971+0000","last_active":"2020-11-20T12:13:56.494872+0000","last_peered":"2020-11-20T12:13:56.494872+0000","last_clean":"2020-11-20T12:13:56.494872+0000","last_became_active":"2020-11-20T11:48:09.600693+0000","last_became_peered":"2020-11-20T11:48:09.600693+0000","last_unstale":"2020-11-20T12:13:56.494872+0000","last_undegraded":"2020-11-20T12:13:56.494872+0000","last_fullsized":"2020-11-20T12:13:56.494872+0000","mapping_epoch":26,"log_start":"28'16967","ondisk_log_start":"28'16967","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'27002","last_scrub_stamp":"2020-11-20T12:13:56.494866+0000","last_deep_scrub":"28'27002","last_deep_scrub_stamp":"2020-11-20T12:13:56.494866+0000","last_clean_scrub_stamp":"2020-11-20T12:13:56.494866+0000","log_size":10035,"ondisk_log_size":10035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1336,"num_read_kb":87000,"num_write":19165,"num_write_kb":539571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,8,10],"acting":[6,0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"17","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:40.647994+0000","last_change":"2020-11-20T12:13:40.648105+0000","last_active":"2020-11-20T12:13:40.647994+0000","last_peered":"2020-11-20T12:13:40.647994+0000","last_clean":"2020-11-20T12:13:40.647994+0000","last_became_active":"2020-11-20T11:48:03.364003+0000","last_became_peered":"2020-11-20T11:48:03.364003+0000","last_unstale":"2020-11-20T12:13:40.647994+0000","last_undegraded":"2020-11-20T12:13:40.647994+0000","last_fullsized":"2020-11-20T12:13:40.647994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:13:40.647988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:13:40.647988+0000","last_clean_scrub_stamp":"2020-11-20T12:13:40.647988+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"28'22134","reported_seq":"22148","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:39.721374+0000","last_change":"2020-11-20T12:13:39.721429+0000","last_active":"2020-11-20T12:13:39.721374+0000","last_peered":"2020-11-20T12:13:39.721374+0000","last_clean":"2020-11-20T12:13:39.721374+0000","last_became_active":"2020-11-20T11:48:06.628670+0000","last_became_peered":"2020-11-20T11:48:06.628670+0000","last_unstale":"2020-11-20T12:13:39.721374+0000","last_undegraded":"2020-11-20T12:13:39.721374+0000","last_fullsized":"2020-11-20T12:13:39.721374+0000","mapping_epoch":23,"log_start":"28'12100","ondisk_log_start":"28'12100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'22134","last_scrub_stamp":"2020-11-20T12:13:39.721369+0000","last_deep_scrub":"28'22134","last_deep_scrub_stamp":"2020-11-20T12:13:39.721369+0000","last_clean_scrub_stamp":"2020-11-20T12:13:39.721369+0000","log_size":10034,"ondisk_log_size":10034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":37748770,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":22175,"num_write_kb":164436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4978,"num_omap_keys":11,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.7","version":"28'26179","reported_seq":"27713","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:14:00.542574+0000","last_change":"2020-11-20T12:14:00.542676+0000","last_active":"2020-11-20T12:14:00.542574+0000","last_peered":"2020-11-20T12:14:00.542574+0000","last_clean":"2020-11-20T12:14:00.542574+0000","last_became_active":"2020-11-20T11:48:09.598147+0000","last_became_peered":"2020-11-20T11:48:09.598147+0000","last_unstale":"2020-11-20T12:14:00.542574+0000","last_undegraded":"2020-11-20T12:14:00.542574+0000","last_fullsized":"2020-11-20T12:14:00.542574+0000","mapping_epoch":26,"log_start":"28'16165","ondisk_log_start":"28'16165","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'26179","last_scrub_stamp":"2020-11-20T12:14:00.542568+0000","last_deep_scrub":"28'26179","last_deep_scrub_stamp":"2020-11-20T12:14:00.542568+0000","last_clean_scrub_stamp":"2020-11-20T12:14:00.542568+0000","log_size":10014,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1520,"num_read_kb":90522,"num_write":18274,"num_write_kb":563834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,5,0],"acting":[6,1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:38.302699+0000","last_change":"2020-11-20T12:13:38.302794+0000","last_active":"2020-11-20T12:13:38.302699+0000","last_peered":"2020-11-20T12:13:38.302699+0000","last_clean":"2020-11-20T12:13:38.302699+0000","last_became_active":"2020-11-20T11:48:03.436251+0000","last_became_peered":"2020-11-20T11:48:03.436251+0000","last_unstale":"2020-11-20T12:13:38.302699+0000","last_undegraded":"2020-11-20T12:13:38.302699+0000","last_fullsized":"2020-11-20T12:13:38.302699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:13:38.302691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:13:38.302691+0000","last_clean_scrub_stamp":"2020-11-20T12:13:38.302691+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"28'18843","reported_seq":"18858","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:36.149565+0000","last_change":"2020-11-20T12:13:36.149634+0000","last_active":"2020-11-20T12:13:36.149565+0000","last_peered":"2020-11-20T12:13:36.149565+0000","last_clean":"2020-11-20T12:13:36.149565+0000","last_became_active":"2020-11-20T11:48:06.645318+0000","last_became_peered":"2020-11-20T11:48:06.645318+0000","last_unstale":"2020-11-20T12:13:36.149565+0000","last_undegraded":"2020-11-20T12:13:36.149565+0000","last_fullsized":"2020-11-20T12:13:36.149565+0000","mapping_epoch":23,"log_start":"28'8800","ondisk_log_start":"28'8800","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'18843","last_scrub_stamp":"2020-11-20T12:13:36.149559+0000","last_deep_scrub":"28'18843","last_deep_scrub_stamp":"2020-11-20T12:13:36.149559+0000","last_clean_scrub_stamp":"2020-11-20T12:13:36.149559+0000","log_size":10043,"ondisk_log_size":10043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8388608,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":18953,"num_write_kb":142544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18841,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"28'26566","reported_seq":"27858","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:45.642391+0000","last_change":"2020-11-20T12:13:45.642488+0000","last_active":"2020-11-20T12:13:45.642391+0000","last_peered":"2020-11-20T12:13:45.642391+0000","last_clean":"2020-11-20T12:13:45.642391+0000","last_became_active":"2020-11-20T11:48:09.600181+0000","last_became_peered":"2020-11-20T11:48:09.600181+0000","last_unstale":"2020-11-20T12:13:45.642391+0000","last_undegraded":"2020-11-20T12:13:45.642391+0000","last_fullsized":"2020-11-20T12:13:45.642391+0000","mapping_epoch":26,"log_start":"28'16547","ondisk_log_start":"28'16547","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'26566","last_scrub_stamp":"2020-11-20T12:13:45.642385+0000","last_deep_scrub":"28'26566","last_deep_scrub_stamp":"2020-11-20T12:13:45.642385+0000","last_clean_scrub_stamp":"2020-11-20T12:13:45.642385+0000","log_size":10019,"ondisk_log_size":10019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1278,"num_read_kb":79856,"num_write":18659,"num_write_kb":485186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,4,11],"acting":[5,10,4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"17","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:37.496242+0000","last_change":"2020-11-20T12:13:37.496344+0000","last_active":"2020-11-20T12:13:37.496242+0000","last_peered":"2020-11-20T12:13:37.496242+0000","last_clean":"2020-11-20T12:13:37.496242+0000","last_became_active":"2020-11-20T11:48:03.361549+0000","last_became_peered":"2020-11-20T11:48:03.361549+0000","last_unstale":"2020-11-20T12:13:37.496242+0000","last_undegraded":"2020-11-20T12:13:37.496242+0000","last_fullsized":"2020-11-20T12:13:37.496242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:13:37.496233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:13:37.496233+0000","last_clean_scrub_stamp":"2020-11-20T12:13:37.496233+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"1.0","version":"28'6","reported_seq":"27","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:36.902400+0000","last_change":"2020-11-20T12:13:36.902489+0000","last_active":"2020-11-20T12:13:36.902400+0000","last_peered":"2020-11-20T12:13:36.902400+0000","last_clean":"2020-11-20T12:13:36.902400+0000","last_became_active":"2020-11-20T11:47:58.639096+0000","last_became_peered":"2020-11-20T11:47:58.639096+0000","last_unstale":"2020-11-20T12:13:36.902400+0000","last_undegraded":"2020-11-20T12:13:36.902400+0000","last_fullsized":"2020-11-20T12:13:36.902400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2020-11-20T12:13:36.902391+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2020-11-20T12:13:36.902391+0000","last_clean_scrub_stamp":"2020-11-20T12:13:36.902391+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12390,"num_omap_keys":3,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"28'23227","reported_seq":"23241","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:35.182155+0000","last_change":"2020-11-20T12:13:35.182216+0000","last_active":"2020-11-20T12:13:35.182155+0000","last_peered":"2020-11-20T12:13:35.182155+0000","last_clean":"2020-11-20T12:13:35.182155+0000","last_became_active":"2020-11-20T11:48:06.724982+0000","last_became_peered":"2020-11-20T11:48:06.724982+0000","last_unstale":"2020-11-20T12:13:35.182155+0000","last_undegraded":"2020-11-20T12:13:35.182155+0000","last_fullsized":"2020-11-20T12:13:35.182155+0000","mapping_epoch":23,"log_start":"28'13200","ondisk_log_start":"28'13200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'23227","last_scrub_stamp":"2020-11-20T12:13:35.182149+0000","last_deep_scrub":"28'23227","last_deep_scrub_stamp":"2020-11-20T12:13:35.182149+0000","last_clean_scrub_stamp":"2020-11-20T12:13:35.182149+0000","log_size":10027,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38960552,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":23265,"num_write_kb":170579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6598,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"28'26481","reported_seq":"28537","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:40.152558+0000","last_change":"2020-11-20T12:13:40.152642+0000","last_active":"2020-11-20T12:13:40.152558+0000","last_peered":"2020-11-20T12:13:40.152558+0000","last_clean":"2020-11-20T12:13:40.152558+0000","last_became_active":"2020-11-20T11:48:09.599710+0000","last_became_peered":"2020-11-20T11:48:09.599710+0000","last_unstale":"2020-11-20T12:13:40.152558+0000","last_undegraded":"2020-11-20T12:13:40.152558+0000","last_fullsized":"2020-11-20T12:13:40.152558+0000","mapping_epoch":26,"log_start":"28'16449","ondisk_log_start":"28'16449","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'26481","last_scrub_stamp":"2020-11-20T12:13:40.152552+0000","last_deep_scrub":"28'26481","last_deep_scrub_stamp":"2020-11-20T12:13:40.152552+0000","last_clean_scrub_stamp":"2020-11-20T12:13:40.152552+0000","log_size":10032,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2042,"num_read_kb":123354,"num_write":18484,"num_write_kb":487460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6,11],"acting":[10,9,6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:38.864190+0000","last_change":"2020-11-20T12:13:38.864279+0000","last_active":"2020-11-20T12:13:38.864190+0000","last_peered":"2020-11-20T12:13:38.864190+0000","last_clean":"2020-11-20T12:13:38.864190+0000","last_became_active":"2020-11-20T11:48:03.437759+0000","last_became_peered":"2020-11-20T11:48:03.437759+0000","last_unstale":"2020-11-20T12:13:38.864190+0000","last_undegraded":"2020-11-20T12:13:38.864190+0000","last_fullsized":"2020-11-20T12:13:38.864190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:13:38.864185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:13:38.864185+0000","last_clean_scrub_stamp":"2020-11-20T12:13:38.864185+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"28'15782","reported_seq":"16659","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:40.424256+0000","last_change":"2020-11-20T12:13:40.424318+0000","last_active":"2020-11-20T12:13:40.424256+0000","last_peered":"2020-11-20T12:13:40.424256+0000","last_clean":"2020-11-20T12:13:40.424256+0000","last_became_active":"2020-11-20T11:48:06.484857+0000","last_became_peered":"2020-11-20T11:48:06.484857+0000","last_unstale":"2020-11-20T12:13:40.424256+0000","last_undegraded":"2020-11-20T12:13:40.424256+0000","last_fullsized":"2020-11-20T12:13:40.424256+0000","mapping_epoch":23,"log_start":"28'5700","ondisk_log_start":"28'5700","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'15782","last_scrub_stamp":"2020-11-20T12:13:40.424250+0000","last_deep_scrub":"28'15782","last_deep_scrub_stamp":"2020-11-20T12:13:40.424250+0000","last_clean_scrub_stamp":"2020-11-20T12:13:40.424250+0000","log_size":10082,"ondisk_log_size":10082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":863,"num_read_kb":4704,"num_write":15805,"num_write_kb":119765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"28'26399","reported_seq":"28425","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:38.131850+0000","last_change":"2020-11-20T12:13:38.131929+0000","last_active":"2020-11-20T12:13:38.131850+0000","last_peered":"2020-11-20T12:13:38.131850+0000","last_clean":"2020-11-20T12:13:38.131850+0000","last_became_active":"2020-11-20T11:48:09.599735+0000","last_became_peered":"2020-11-20T11:48:09.599735+0000","last_unstale":"2020-11-20T12:13:38.131850+0000","last_undegraded":"2020-11-20T12:13:38.131850+0000","last_fullsized":"2020-11-20T12:13:38.131850+0000","mapping_epoch":26,"log_start":"28'16359","ondisk_log_start":"28'16359","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'26399","last_scrub_stamp":"2020-11-20T12:13:38.131845+0000","last_deep_scrub":"28'26399","last_deep_scrub_stamp":"2020-11-20T12:13:38.131845+0000","last_clean_scrub_stamp":"2020-11-20T12:13:38.131845+0000","log_size":10040,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2012,"num_read_kb":122872,"num_write":18367,"num_write_kb":513978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,11,6],"acting":[1,4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:41.086003+0000","last_change":"2020-11-20T12:13:41.086067+0000","last_active":"2020-11-20T12:13:41.086003+0000","last_peered":"2020-11-20T12:13:41.086003+0000","last_clean":"2020-11-20T12:13:41.086003+0000","last_became_active":"2020-11-20T11:48:03.435438+0000","last_became_peered":"2020-11-20T11:48:03.435438+0000","last_unstale":"2020-11-20T12:13:41.086003+0000","last_undegraded":"2020-11-20T12:13:41.086003+0000","last_fullsized":"2020-11-20T12:13:41.086003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:13:41.086000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:13:41.086000+0000","last_clean_scrub_stamp":"2020-11-20T12:13:41.086000+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"28'21928","reported_seq":"22481","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:47.537213+0000","last_change":"2020-11-20T12:13:47.537274+0000","last_active":"2020-11-20T12:13:47.537213+0000","last_peered":"2020-11-20T12:13:47.537213+0000","last_clean":"2020-11-20T12:13:47.537213+0000","last_became_active":"2020-11-20T11:48:06.484250+0000","last_became_peered":"2020-11-20T11:48:06.484250+0000","last_unstale":"2020-11-20T12:13:47.537213+0000","last_undegraded":"2020-11-20T12:13:47.537213+0000","last_fullsized":"2020-11-20T12:13:47.537213+0000","mapping_epoch":23,"log_start":"28'11900","ondisk_log_start":"28'11900","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'21928","last_scrub_stamp":"2020-11-20T12:13:47.537207+0000","last_deep_scrub":"28'21928","last_deep_scrub_stamp":"2020-11-20T12:13:47.537207+0000","last_clean_scrub_stamp":"2020-11-20T12:13:47.537207+0000","log_size":10028,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":58179308,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":539,"num_read_kb":3921,"num_write":21970,"num_write_kb":180364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14931,"num_omap_keys":25,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"28'27292","reported_seq":"28494","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:40.075596+0000","last_change":"2020-11-20T12:13:40.075696+0000","last_active":"2020-11-20T12:13:40.075596+0000","last_peered":"2020-11-20T12:13:40.075596+0000","last_clean":"2020-11-20T12:13:40.075596+0000","last_became_active":"2020-11-20T11:48:09.598112+0000","last_became_peered":"2020-11-20T11:48:09.598112+0000","last_unstale":"2020-11-20T12:13:40.075596+0000","last_undegraded":"2020-11-20T12:13:40.075596+0000","last_fullsized":"2020-11-20T12:13:40.075596+0000","mapping_epoch":26,"log_start":"28'17256","ondisk_log_start":"28'17256","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'27292","last_scrub_stamp":"2020-11-20T12:13:40.075589+0000","last_deep_scrub":"28'27292","last_deep_scrub_stamp":"2020-11-20T12:13:40.075589+0000","last_clean_scrub_stamp":"2020-11-20T12:13:40.075589+0000","log_size":10036,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1188,"num_read_kb":87936,"num_write":19495,"num_write_kb":508885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"28'14086","reported_seq":"14697","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:39.211058+0000","last_change":"2020-11-20T12:13:39.211115+0000","last_active":"2020-11-20T12:13:39.211058+0000","last_peered":"2020-11-20T12:13:39.211058+0000","last_clean":"2020-11-20T12:13:39.211058+0000","last_became_active":"2020-11-20T11:48:06.644950+0000","last_became_peered":"2020-11-20T11:48:06.644950+0000","last_unstale":"2020-11-20T12:13:39.211058+0000","last_undegraded":"2020-11-20T12:13:39.211058+0000","last_fullsized":"2020-11-20T12:13:39.211058+0000","mapping_epoch":23,"log_start":"28'4000","ondisk_log_start":"28'4000","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'14086","last_scrub_stamp":"2020-11-20T12:13:39.211053+0000","last_deep_scrub":"28'14086","last_deep_scrub_stamp":"2020-11-20T12:13:39.211053+0000","last_clean_scrub_stamp":"2020-11-20T12:13:39.211053+0000","log_size":10086,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":29360703,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":602,"num_read_kb":4468,"num_write":14198,"num_write_kb":107079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12119,"num_omap_keys":20,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:35.558932+0000","last_change":"2020-11-20T12:13:35.559016+0000","last_active":"2020-11-20T12:13:35.558932+0000","last_peered":"2020-11-20T12:13:35.558932+0000","last_clean":"2020-11-20T12:13:35.558932+0000","last_became_active":"2020-11-20T11:48:03.440579+0000","last_became_peered":"2020-11-20T11:48:03.440579+0000","last_unstale":"2020-11-20T12:13:35.558932+0000","last_undegraded":"2020-11-20T12:13:35.558932+0000","last_fullsized":"2020-11-20T12:13:35.558932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:13:35.558927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:13:35.558927+0000","last_clean_scrub_stamp":"2020-11-20T12:13:35.558927+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10],"acting":[9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1","version":"28'27318","reported_seq":"28460","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:45.058183+0000","last_change":"2020-11-20T12:13:45.058283+0000","last_active":"2020-11-20T12:13:45.058183+0000","last_peered":"2020-11-20T12:13:45.058183+0000","last_clean":"2020-11-20T12:13:45.058183+0000","last_became_active":"2020-11-20T11:48:09.624778+0000","last_became_peered":"2020-11-20T11:48:09.624778+0000","last_unstale":"2020-11-20T12:13:45.058183+0000","last_undegraded":"2020-11-20T12:13:45.058183+0000","last_fullsized":"2020-11-20T12:13:45.058183+0000","mapping_epoch":26,"log_start":"28'17276","ondisk_log_start":"28'17276","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'27318","last_scrub_stamp":"2020-11-20T12:13:45.058177+0000","last_deep_scrub":"28'27318","last_deep_scrub_stamp":"2020-11-20T12:13:45.058177+0000","last_clean_scrub_stamp":"2020-11-20T12:13:45.058177+0000","log_size":10042,"ondisk_log_size":10042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1128,"num_read_kb":64348,"num_write":19481,"num_write_kb":566162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,11,8],"acting":[4,2,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:41.874267+0000","last_change":"2020-11-20T12:13:41.874328+0000","last_active":"2020-11-20T12:13:41.874267+0000","last_peered":"2020-11-20T12:13:41.874267+0000","last_clean":"2020-11-20T12:13:41.874267+0000","last_became_active":"2020-11-20T11:48:03.359617+0000","last_became_peered":"2020-11-20T11:48:03.359617+0000","last_unstale":"2020-11-20T12:13:41.874267+0000","last_undegraded":"2020-11-20T12:13:41.874267+0000","last_fullsized":"2020-11-20T12:13:41.874267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:13:41.874261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:13:41.874261+0000","last_clean_scrub_stamp":"2020-11-20T12:13:41.874261+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.6","version":"28'21170","reported_seq":"21184","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:13:32.913169+0000","last_change":"2020-11-20T12:13:32.913169+0000","last_active":"2020-11-20T12:13:32.913169+0000","last_peered":"2020-11-20T12:13:32.913169+0000","last_clean":"2020-11-20T12:13:32.913169+0000","last_became_active":"2020-11-20T11:48:06.483910+0000","last_became_peered":"2020-11-20T11:48:06.483910+0000","last_unstale":"2020-11-20T12:13:32.913169+0000","last_undegraded":"2020-11-20T12:13:32.913169+0000","last_fullsized":"2020-11-20T12:13:32.913169+0000","mapping_epoch":23,"log_start":"28'11100","ondisk_log_start":"28'11100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'21169","last_scrub_stamp":"2020-11-20T12:13:32.913105+0000","last_deep_scrub":"28'21169","last_deep_scrub_stamp":"2020-11-20T12:13:32.913105+0000","last_clean_scrub_stamp":"2020-11-20T12:13:32.913105+0000","log_size":10070,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25165824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21813,"num_write_kb":153246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2183,"num_omap_keys":23,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11751,"num_read_kb":727788,"num_write":152107,"num_write_kb":4201046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80229,"ondisk_log_size":80229,"up":32,"acting":32,"num_store_stats":12},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":239746965,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":2017,"num_read_kb":13093,"num_write":164576,"num_write_kb":1209643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":80875,"num_omap_keys":156,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":367804416,"data_stored":479493930,"data_compressed":52834740,"data_compressed_allocated":111747072,"data_compressed_original":223494144,"omap_allocated":0,"internal_metadata":0},"log_size":80382,"ondisk_log_size":80382,"up":16,"acting":16,"num_store_stats":9},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12390,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":10}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444349,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":444432,"kb_used_data":49224,"kb_used_omap":0,"kb_used_meta":395200,"kb_avail":93927408,"statfs":{"total":96636764160,"available":96181665792,"internally_reserved":0,"allocated":50405376,"data_stored":63050557,"data_compressed":6045917,"data_compressed_allocated":12808192,"data_compressed_original":25616384,"omap_allocated":0,"internal_metadata":404684800},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:13:52 2020","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.1890000000000001,"15min":1.0069999999999999},"min":{"1min":0.60599999999999998,"5min":0.55600000000000005,"15min":0.53300000000000003},"max":{"1min":4.5209999999999999,"5min":12.345000000000001,"15min":12.345000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.179,"15min":1.0629999999999999},"min":{"1min":0.63600000000000001,"5min":0.57799999999999996,"15min":0.54800000000000004},"max":{"1min":2.3759999999999999,"5min":12.679,"15min":12.679},"last":0.86899999999999999}]},{"osd":1,"last update":"Fri Nov 20 12:13:52 2020","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.1759999999999999,"15min":1.212},"min":{"1min":0.58799999999999997,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.7570000000000001,"5min":12.709,"15min":12.709},"last":1.431},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.4810000000000001,"15min":3.0099999999999998},"min":{"1min":0.82099999999999995,"5min":0.61099999999999999,"15min":0.54400000000000004},"max":{"1min":4.6449999999999996,"5min":12.489000000000001,"15min":285.29500000000002},"last":1.399}]},{"osd":2,"last update":"Fri Nov 20 12:13:52 2020","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.4419999999999999,"15min":1.2509999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.56999999999999995},"max":{"1min":3.4169999999999998,"5min":12.311,"15min":12.311},"last":1.204},{"interface":"front","average":{"1min":1.335,"5min":1.4339999999999999,"15min":1.268},"min":{"1min":0.79300000000000004,"5min":0.624,"15min":0.61199999999999999},"max":{"1min":3.4119999999999999,"5min":12.285,"15min":12.285},"last":0.90700000000000003}]},{"osd":3,"last update":"Fri Nov 20 12:13:52 2020","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.5109999999999999,"15min":1.7529999999999999},"min":{"1min":0.86099999999999999,"5min":0.621,"15min":0.621},"max":{"1min":2.8700000000000001,"5min":12.523999999999999,"15min":90.236999999999995},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.552,"5min":1.694,"15min":1.8720000000000001},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.82499999999999996},"max":{"1min":5.0810000000000004,"5min":12.629,"15min":90.265000000000001},"last":1.238}]},{"osd":4,"last update":"Fri Nov 20 12:13:52 2020","interfaces":[{"interface":"back","average":{"1min":1.6739999999999999,"5min":1.8839999999999999,"15min":2.1389999999999998},"min":{"1min":0.97299999999999998,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":5.3360000000000003,"5min":12.944000000000001,"15min":120.355},"last":1.5409999999999999},{"interface":"front","average":{"1min":1.5069999999999999,"5min":1.8120000000000001,"15min":1.655},"min":{"1min":1.0509999999999999,"5min":0.94499999999999995,"15min":0.79500000000000004},"max":{"1min":3.0299999999999998,"5min":12.964,"15min":12.964},"last":1.3420000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:13:52 2020","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.7549999999999999,"15min":1.605},"min":{"1min":1.0149999999999999,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.9729999999999999,"5min":12.843999999999999,"15min":12.843999999999999},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.9450000000000001,"5min":2.0449999999999999,"15min":1.998},"min":{"1min":1.131,"5min":0.94299999999999995,"15min":0.874},"max":{"1min":5.4509999999999996,"5min":13.067,"15min":68.132000000000005},"last":1.681}]},{"osd":6,"last update":"Fri Nov 20 12:13:52 2020","interfaces":[{"interface":"back","average":{"1min":1.7889999999999999,"5min":1.79,"15min":1.8080000000000001},"min":{"1min":1.177,"5min":1.0649999999999999,"15min":1.0189999999999999},"max":{"1min":6.2549999999999999,"5min":12.826000000000001,"15min":12.826000000000001},"last":1.468},{"interface":"front","average":{"1min":1.6699999999999999,"5min":1.8400000000000001,"15min":1.736},"min":{"1min":1.1439999999999999,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":3.0760000000000001,"5min":12.98,"15min":12.98},"last":1.583}]},{"osd":7,"last update":"Fri Nov 20 12:13:52 2020","interfaces":[{"interface":"back","average":{"1min":1.7110000000000001,"5min":1.9990000000000001,"15min":1.869},"min":{"1min":1.256,"5min":1.1870000000000001,"15min":0.96699999999999997},"max":{"1min":3.1850000000000001,"5min":13.167999999999999,"15min":13.167999999999999},"last":1.6060000000000001},{"interface":"front","average":{"1min":1.786,"5min":2.0539999999999998,"15min":1.9630000000000001},"min":{"1min":1.212,"5min":1.0860000000000001,"15min":1.0860000000000001},"max":{"1min":3.2919999999999998,"5min":13.102,"15min":13.102},"last":1.7110000000000001}]},{"osd":8,"last update":"Fri Nov 20 12:13:52 2020","interfaces":[{"interface":"back","average":{"1min":1.913,"5min":1.9910000000000001,"15min":1.851},"min":{"1min":1.1970000000000001,"5min":1.141,"15min":1.016},"max":{"1min":5.585,"5min":13.148,"15min":13.148},"last":1.8109999999999999},{"interface":"front","average":{"1min":2.028,"5min":1.976,"15min":1.8500000000000001},"min":{"1min":1.327,"5min":1.1000000000000001,"15min":1.0680000000000001},"max":{"1min":7.6349999999999998,"5min":13.086,"15min":13.086},"last":1.7370000000000001}]},{"osd":10,"last update":"Fri Nov 20 12:13:52 2020","interfaces":[{"interface":"back","average":{"1min":1.9710000000000001,"5min":2.2389999999999999,"15min":2.0310000000000001},"min":{"1min":1.276,"5min":1.262,"15min":1.179},"max":{"1min":5.2169999999999996,"5min":13.220000000000001,"15min":13.220000000000001},"last":1.9390000000000001},{"interface":"front","average":{"1min":1.875,"5min":2.2589999999999999,"15min":2.1110000000000002},"min":{"1min":1.391,"5min":1.306,"15min":1.1379999999999999},"max":{"1min":3.3029999999999999,"5min":13.233000000000001,"15min":19.605},"last":1.8380000000000001}]}]},{"osd":10,"up_from":17,"seq":73014444350,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127908,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":127616,"kb_avail":94243932,"statfs":{"total":96636764160,"available":96505786368,"internally_reserved":0,"allocated":290816,"data_stored":135963,"data_compressed":2789,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":130678784},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.5569999999999999,"15min":1.333},"min":{"1min":0.68000000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.8799999999999999,"5min":7.4349999999999996,"15min":8.9849999999999994},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.5840000000000001,"5min":1.5449999999999999,"15min":1.276},"min":{"1min":0.70199999999999996,"5min":0.60999999999999999,"15min":0.60199999999999998},"max":{"1min":4.5270000000000001,"5min":6.7789999999999999,"15min":6.7789999999999999},"last":0.75700000000000001}]},{"osd":1,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":1.8169999999999999,"5min":2.0790000000000002,"15min":1.7849999999999999},"min":{"1min":0.69699999999999995,"5min":0.66300000000000003,"15min":0.59199999999999997},"max":{"1min":11.619999999999999,"5min":12.619999999999999,"15min":12.619999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":2.1520000000000001,"5min":2.0489999999999999,"15min":1.7729999999999999},"min":{"1min":0.76000000000000001,"5min":0.70899999999999996,"15min":0.58899999999999997},"max":{"1min":11.154,"5min":11.154,"15min":11.154},"last":0.88900000000000001}]},{"osd":2,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":2.0640000000000001,"5min":1.851,"15min":1.504},"min":{"1min":0.69799999999999995,"5min":0.69099999999999995,"15min":0.53000000000000003},"max":{"1min":6.7939999999999996,"5min":6.7939999999999996,"15min":6.7939999999999996},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.845,"5min":2.0310000000000001,"15min":1.7649999999999999},"min":{"1min":0.91100000000000003,"5min":0.89600000000000002,"15min":0.79600000000000004},"max":{"1min":5.4710000000000001,"5min":7.718,"15min":13.505000000000001},"last":1.113}]},{"osd":3,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":1.8200000000000001,"5min":1.9870000000000001,"15min":1.8220000000000001},"min":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.73199999999999998},"max":{"1min":4.6539999999999999,"5min":7.0979999999999999,"15min":12.358000000000001},"last":1.1359999999999999},{"interface":"front","average":{"1min":2.548,"5min":2.141,"15min":1.742},"min":{"1min":0.75600000000000001,"5min":0.69499999999999995,"15min":0.61199999999999999},"max":{"1min":10.074,"5min":10.074,"15min":10.074},"last":1.004}]},{"osd":4,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":1.909,"5min":2.4119999999999999,"15min":2.2210000000000001},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.85799999999999998},"max":{"1min":3.145,"5min":8.4710000000000001,"15min":26.497},"last":1.2450000000000001},{"interface":"front","average":{"1min":2.2709999999999999,"5min":2.4239999999999999,"15min":2.1659999999999999},"min":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":0.79000000000000004},"max":{"1min":5.923,"5min":10.172000000000001,"15min":10.478999999999999},"last":1.278}]},{"osd":5,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":2.5219999999999998,"5min":2.448,"15min":2.1349999999999998},"min":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.0760000000000001},"max":{"1min":11.5,"5min":11.5,"15min":13.752000000000001},"last":1.359},{"interface":"front","average":{"1min":3.5939999999999999,"5min":2.5470000000000002,"15min":2.2280000000000002},"min":{"1min":1.216,"5min":1.165,"15min":1.0580000000000001},"max":{"1min":30.359000000000002,"5min":30.359000000000002,"15min":30.359000000000002},"last":1.4019999999999999}]},{"osd":6,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":2.3849999999999998,"5min":2.3580000000000001,"15min":1.982},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.85899999999999999},"max":{"1min":6.9039999999999999,"5min":7.5549999999999997,"15min":7.5549999999999997},"last":1.1679999999999999},{"interface":"front","average":{"1min":2.238,"5min":2.444,"15min":2.274},"min":{"1min":1.1970000000000001,"5min":1.145,"15min":1.054},"max":{"1min":5.766,"5min":7.9749999999999996,"15min":13.630000000000001},"last":1.4810000000000001}]},{"osd":7,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":2.4420000000000002,"5min":2.5019999999999998,"15min":2.3570000000000002},"min":{"1min":1.3129999999999999,"5min":1.248,"15min":1.1839999999999999},"max":{"1min":5.3840000000000003,"5min":7.4779999999999998,"15min":11.385999999999999},"last":1.5209999999999999},{"interface":"front","average":{"1min":4.0830000000000002,"5min":2.8679999999999999,"15min":2.4220000000000002},"min":{"1min":1.1599999999999999,"5min":1.0509999999999999,"15min":0.94899999999999995},"max":{"1min":20.331,"5min":20.331,"15min":20.707000000000001},"last":1.264}]},{"osd":9,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":3.2530000000000001,"5min":2.774,"15min":2.3079999999999998},"min":{"1min":1.091,"5min":1.091,"15min":1.034},"max":{"1min":11.122,"5min":11.122,"15min":11.432},"last":1.425},{"interface":"front","average":{"1min":2.6840000000000002,"5min":2.6120000000000001,"15min":2.3180000000000001},"min":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.1519999999999999},"max":{"1min":11.372999999999999,"5min":11.372999999999999,"15min":13.865},"last":1.5980000000000001}]},{"osd":11,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":2.4729999999999999,"5min":2.504,"15min":2.2879999999999998},"min":{"1min":1.286,"5min":1.2729999999999999,"15min":1.268},"max":{"1min":5.5069999999999997,"5min":7.5380000000000003,"15min":10.875},"last":1.6339999999999999},{"interface":"front","average":{"1min":3.3130000000000002,"5min":2.7909999999999999,"15min":2.3530000000000002},"min":{"1min":1.232,"5min":1.2170000000000001,"15min":1.101},"max":{"1min":11.676,"5min":11.676,"15min":11.676},"last":1.333}]}]},{"osd":9,"up_from":17,"seq":73014444349,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45668,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":45376,"kb_avail":94326172,"statfs":{"total":96636764160,"available":96590000128,"internally_reserved":0,"allocated":290816,"data_stored":135963,"data_compressed":2789,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":46465024},"hb_peers":[0,1,2,3,4,5,6,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:13:59 2020","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":1.028,"15min":1.0940000000000001},"min":{"1min":0.62,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.22,"5min":5.5289999999999999,"15min":6.8630000000000004},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.159,"15min":1.252},"min":{"1min":0.64400000000000002,"5min":0.627,"15min":0.627},"max":{"1min":1.718,"5min":5.4500000000000002,"15min":8.2669999999999995},"last":1.1559999999999999}]},{"osd":1,"last update":"Fri Nov 20 12:13:59 2020","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.9510000000000001,"15min":2.089},"min":{"1min":0.69199999999999995,"5min":0.627,"15min":0.59699999999999998},"max":{"1min":7.3109999999999999,"5min":66.763000000000005,"15min":126.151},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.135,"5min":1.411,"15min":1.5840000000000001},"min":{"1min":0.73699999999999999,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.595,"5min":6.556,"15min":31.262},"last":0.73499999999999999}]},{"osd":2,"last update":"Fri Nov 20 12:13:59 2020","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":1.2390000000000001,"15min":1.349},"min":{"1min":0.67500000000000004,"5min":0.67400000000000004,"15min":0.67100000000000004},"max":{"1min":1.2949999999999999,"5min":3.3279999999999998,"15min":7.4290000000000003},"last":1.097},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.4179999999999999,"15min":1.4970000000000001},"min":{"1min":0.93700000000000006,"5min":0.748,"15min":0.69899999999999995},"max":{"1min":1.4790000000000001,"5min":6.9359999999999999,"15min":6.9359999999999999},"last":1.2689999999999999}]},{"osd":3,"last update":"Fri Nov 20 12:13:59 2020","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.175,"15min":1.3680000000000001},"min":{"1min":0.69799999999999995,"5min":0.65700000000000003,"15min":0.61599999999999999},"max":{"1min":1.4610000000000001,"5min":6.3440000000000003,"15min":6.968},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.345,"5min":1.54,"15min":1.6870000000000001},"min":{"1min":0.98999999999999999,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":2.109,"5min":6.2050000000000001,"15min":7.5259999999999998},"last":1.244}]},{"osd":4,"last update":"Fri Nov 20 12:13:59 2020","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.7210000000000001,"15min":1.7310000000000001},"min":{"1min":0.96199999999999997,"5min":0.93200000000000005,"15min":0.61599999999999999},"max":{"1min":1.7410000000000001,"5min":6.8259999999999996,"15min":6.8259999999999996},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.526,"15min":1.665},"min":{"1min":0.996,"5min":0.65500000000000003,"15min":0.65200000000000002},"max":{"1min":1.446,"5min":5.4130000000000003,"15min":8.4169999999999998},"last":1.0169999999999999}]},{"osd":5,"last update":"Fri Nov 20 12:13:59 2020","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.5369999999999999,"15min":1.6160000000000001},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.746},"max":{"1min":2.246,"5min":6.0170000000000003,"15min":8.5440000000000005},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.369,"5min":1.7270000000000001,"15min":1.7769999999999999},"min":{"1min":0.96099999999999997,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.792,"5min":6.3310000000000004,"15min":7.6790000000000003},"last":1.351}]},{"osd":6,"last update":"Fri Nov 20 12:13:59 2020","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.855,"15min":1.988},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.84499999999999997},"max":{"1min":1.921,"5min":6.5890000000000004,"15min":9.8030000000000008},"last":1.6000000000000001},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.8640000000000001,"15min":1.921},"min":{"1min":1.145,"5min":1.141,"15min":1.03},"max":{"1min":1.9850000000000001,"5min":7.2110000000000003,"15min":9.8409999999999993},"last":1.3959999999999999}]},{"osd":8,"last update":"Fri Nov 20 12:13:59 2020","interfaces":[{"interface":"back","average":{"1min":1.806,"5min":1.873,"15min":1.8939999999999999},"min":{"1min":1.278,"5min":1.1719999999999999,"15min":0.96899999999999997},"max":{"1min":4.1900000000000004,"5min":6.9560000000000004,"15min":6.992},"last":1.526},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.667,"15min":1.833},"min":{"1min":1.0980000000000001,"5min":1.0109999999999999,"15min":1.0109999999999999},"max":{"1min":2.3780000000000001,"5min":5.226,"15min":8.6769999999999996},"last":1.569}]},{"osd":10,"last update":"Fri Nov 20 12:13:59 2020","interfaces":[{"interface":"back","average":{"1min":1.9419999999999999,"5min":2.1320000000000001,"15min":2.0750000000000002},"min":{"1min":1.286,"5min":1.139,"15min":1.1359999999999999},"max":{"1min":5.665,"5min":7.0339999999999998,"15min":8.2989999999999995},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.8440000000000001,"5min":2.2000000000000002,"15min":2.0590000000000002},"min":{"1min":1.3959999999999999,"5min":1.3009999999999999,"15min":1.093},"max":{"1min":3.4420000000000002,"5min":9.3160000000000007,"15min":9.3160000000000007},"last":1.645}]},{"osd":11,"last update":"Fri Nov 20 12:13:59 2020","interfaces":[{"interface":"back","average":{"1min":1.702,"5min":1.796,"15min":1.948},"min":{"1min":1.177,"5min":1.1100000000000001,"15min":1.1100000000000001},"max":{"1min":3.4750000000000001,"5min":5.4450000000000003,"15min":8.7720000000000002},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.722,"5min":1.954,"15min":2.0609999999999999},"min":{"1min":1.319,"5min":1.1579999999999999,"15min":1.1579999999999999},"max":{"1min":2.3839999999999999,"5min":8.5890000000000004,"15min":8.5890000000000004},"last":1.498}]}]},{"osd":8,"up_from":17,"seq":73014444350,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313648,"kb_used_data":30056,"kb_used_omap":0,"kb_used_meta":283584,"kb_avail":94058192,"statfs":{"total":96636764160,"available":96315588608,"internally_reserved":0,"allocated":30777344,"data_stored":37884733,"data_compressed":3425241,"data_compressed_allocated":7270400,"data_compressed_original":14540800,"omap_allocated":0,"internal_metadata":290390016},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:13:37 2020","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.92600000000000005,"15min":0.94999999999999996},"min":{"1min":0.63,"5min":0.55800000000000005,"15min":0.54500000000000004},"max":{"1min":1.5669999999999999,"5min":2.6880000000000002,"15min":8.4719999999999995},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.345,"5min":1.226,"15min":1.0880000000000001},"min":{"1min":0.61399999999999999,"5min":0.57799999999999996,"15min":0.56999999999999995},"max":{"1min":4.915,"5min":6.3029999999999999,"15min":6.3029999999999999},"last":1.1060000000000001}]},{"osd":1,"last update":"Fri Nov 20 12:13:37 2020","interfaces":[{"interface":"back","average":{"1min":1.5900000000000001,"5min":1.4410000000000001,"15min":1.181},"min":{"1min":0.66500000000000004,"5min":0.58999999999999997,"15min":0.56000000000000005},"max":{"1min":6.2439999999999998,"5min":13.785,"15min":13.785},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.5,"5min":1.454,"15min":1.3640000000000001},"min":{"1min":0.72999999999999998,"5min":0.66300000000000003,"15min":0.59299999999999997},"max":{"1min":4.1609999999999996,"5min":14.462999999999999,"15min":14.462999999999999},"last":1.073}]},{"osd":2,"last update":"Fri Nov 20 12:13:37 2020","interfaces":[{"interface":"back","average":{"1min":1.722,"5min":1.4490000000000001,"15min":1.226},"min":{"1min":0.76200000000000001,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":6.2220000000000004,"5min":6.444,"15min":6.444},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.454,"15min":1.288},"min":{"1min":0.65900000000000003,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":5.2430000000000003,"5min":5.5149999999999997,"15min":5.5149999999999997},"last":0.84799999999999998}]},{"osd":3,"last update":"Fri Nov 20 12:13:37 2020","interfaces":[{"interface":"back","average":{"1min":1.6060000000000001,"5min":1.5629999999999999,"15min":1.409},"min":{"1min":0.75700000000000001,"5min":0.70499999999999996,"15min":0.66700000000000004},"max":{"1min":6.117,"5min":6.117,"15min":6.117},"last":1.139},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.3979999999999999,"15min":1.496},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73299999999999998},"max":{"1min":2.7669999999999999,"5min":2.7669999999999999,"15min":29.010999999999999},"last":1.24}]},{"osd":4,"last update":"Fri Nov 20 12:13:37 2020","interfaces":[{"interface":"back","average":{"1min":1.625,"5min":1.633,"15min":1.956},"min":{"1min":1.0169999999999999,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":3.085,"5min":5.4589999999999996,"15min":54.881},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.962,"5min":1.8720000000000001,"15min":1.992},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":5.0449999999999999,"5min":6.5679999999999996,"15min":55.497},"last":1.3049999999999999}]},{"osd":5,"last update":"Fri Nov 20 12:13:37 2020","interfaces":[{"interface":"back","average":{"1min":1.798,"5min":1.8979999999999999,"15min":1.952},"min":{"1min":0.96899999999999997,"5min":0.92500000000000004,"15min":0.86499999999999999},"max":{"1min":6.5910000000000002,"5min":6.9699999999999998,"15min":54.777000000000001},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.8160000000000001,"5min":1.8340000000000001,"15min":1.978},"min":{"1min":1.109,"5min":1.095,"15min":0.84899999999999998},"max":{"1min":3.1930000000000001,"5min":7.891,"15min":54.634999999999998},"last":1.4750000000000001}]},{"osd":7,"last update":"Fri Nov 20 12:13:37 2020","interfaces":[{"interface":"back","average":{"1min":2.407,"5min":2.1230000000000002,"15min":2.0649999999999999},"min":{"1min":0.997,"5min":0.997,"15min":0.997},"max":{"1min":5.6459999999999999,"5min":6.702,"15min":55.015999999999998},"last":1.4410000000000001},{"interface":"front","average":{"1min":2.2280000000000002,"5min":2.0289999999999999,"15min":2.04},"min":{"1min":1.143,"5min":1.042,"15min":1.042},"max":{"1min":6.4770000000000003,"5min":6.4770000000000003,"15min":54.698},"last":1.4179999999999999}]},{"osd":9,"last update":"Fri Nov 20 12:13:37 2020","interfaces":[{"interface":"back","average":{"1min":1.7430000000000001,"5min":1.7509999999999999,"15min":1.9550000000000001},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":3.0129999999999999,"5min":3.944,"15min":54.500999999999998},"last":1.6679999999999999},{"interface":"front","average":{"1min":2.1379999999999999,"5min":1.962,"15min":2.004},"min":{"1min":1.123,"5min":1.089,"15min":1.048},"max":{"1min":5.274,"5min":6.8280000000000003,"15min":55.392000000000003},"last":1.554}]},{"osd":10,"last update":"Fri Nov 20 12:13:37 2020","interfaces":[{"interface":"back","average":{"1min":2.2130000000000001,"5min":2.2370000000000001,"15min":2.1890000000000001},"min":{"1min":1.2090000000000001,"5min":1.1799999999999999,"15min":1.0580000000000001},"max":{"1min":6.3650000000000002,"5min":6.3700000000000001,"15min":54.901000000000003},"last":1.506},{"interface":"front","average":{"1min":1.8600000000000001,"5min":2.016,"15min":2.1320000000000001},"min":{"1min":1.262,"5min":1.2270000000000001,"15min":1.1559999999999999},"max":{"1min":3.2410000000000001,"5min":6.0659999999999998,"15min":54.753},"last":1.5780000000000001}]},{"osd":11,"last update":"Fri Nov 20 12:13:37 2020","interfaces":[{"interface":"back","average":{"1min":2.2639999999999998,"5min":2.109,"15min":2.069},"min":{"1min":1.2450000000000001,"5min":1.077,"15min":1.077},"max":{"1min":6.3470000000000004,"5min":6.9530000000000003,"15min":55.133000000000003},"last":1.6359999999999999},{"interface":"front","average":{"1min":2.2250000000000001,"5min":2.069,"15min":2.0680000000000001},"min":{"1min":1.286,"5min":1.111,"15min":1.095},"max":{"1min":6.7199999999999998,"5min":6.7199999999999998,"15min":54.609999999999999},"last":1.6060000000000001}]}]},{"osd":7,"up_from":17,"seq":73014444350,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":283572,"kb_used_data":28012,"kb_used_omap":0,"kb_used_meta":255552,"kb_avail":94088268,"statfs":{"total":96636764160,"available":96346386432,"internally_reserved":0,"allocated":28684288,"data_stored":37885274,"data_compressed":4461955,"data_compressed_allocated":9367552,"data_compressed_original":18735104,"omap_allocated":0,"internal_metadata":261685248},"hb_peers":[0,1,2,3,4,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:13:50 2020","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.3240000000000001,"15min":1.137},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.60599999999999998},"max":{"1min":4.0910000000000002,"5min":6.5129999999999999,"15min":6.5129999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":1.375,"5min":1.446,"15min":1.329},"min":{"1min":0.75900000000000001,"5min":0.71299999999999997,"15min":0.67100000000000004},"max":{"1min":2.8740000000000001,"5min":5.508,"15min":8.5229999999999997},"last":0.93700000000000006}]},{"osd":1,"last update":"Fri Nov 20 12:13:50 2020","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.5349999999999999,"15min":1.4359999999999999},"min":{"1min":0.69399999999999995,"5min":0.60199999999999998,"15min":0.57099999999999995},"max":{"1min":5.8120000000000003,"5min":7.7850000000000001,"15min":27.488},"last":0.748},{"interface":"front","average":{"1min":3.1269999999999998,"5min":2.9449999999999998,"15min":2.1230000000000002},"min":{"1min":0.69899999999999995,"5min":0.61299999999999999,"15min":0.55200000000000005},"max":{"1min":34.600999999999999,"5min":71.591999999999999,"15min":71.591999999999999},"last":0.79500000000000004}]},{"osd":2,"last update":"Fri Nov 20 12:13:50 2020","interfaces":[{"interface":"back","average":{"1min":1.7150000000000001,"5min":1.823,"15min":1.5129999999999999},"min":{"1min":0.92700000000000005,"5min":0.81399999999999995,"15min":0.55800000000000005},"max":{"1min":4.1769999999999996,"5min":6.9569999999999999,"15min":6.9569999999999999},"last":1.03},{"interface":"front","average":{"1min":1.831,"5min":1.7470000000000001,"15min":1.5609999999999999},"min":{"1min":0.98599999999999999,"5min":0.86099999999999999,"15min":0.63100000000000001},"max":{"1min":5.2329999999999997,"5min":7.4569999999999999,"15min":12.949999999999999},"last":1.0680000000000001}]},{"osd":3,"last update":"Fri Nov 20 12:13:50 2020","interfaces":[{"interface":"back","average":{"1min":1.8129999999999999,"5min":1.915,"15min":1.726},"min":{"1min":1.0209999999999999,"5min":0.81399999999999995,"15min":0.66200000000000003},"max":{"1min":3.8900000000000001,"5min":6.8529999999999998,"15min":8.6959999999999997},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.8089999999999999,"5min":2.1219999999999999,"15min":1.802},"min":{"1min":0.97199999999999998,"5min":0.91000000000000003,"15min":0.748},"max":{"1min":4.2380000000000004,"5min":6.8289999999999997,"15min":6.8479999999999999},"last":1.1419999999999999}]},{"osd":4,"last update":"Fri Nov 20 12:13:50 2020","interfaces":[{"interface":"back","average":{"1min":1.9550000000000001,"5min":2.0569999999999999,"15min":1.8859999999999999},"min":{"1min":0.97899999999999998,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":5.3150000000000004,"5min":7.5350000000000001,"15min":26.966000000000001},"last":1.1899999999999999},{"interface":"front","average":{"1min":2.2879999999999998,"5min":2.319,"15min":2.1440000000000001},"min":{"1min":1.0840000000000001,"5min":0.876,"15min":0.78900000000000003},"max":{"1min":6.399,"5min":8.6560000000000006,"15min":26.786999999999999},"last":1.3420000000000001}]},{"osd":6,"last update":"Fri Nov 20 12:13:50 2020","interfaces":[{"interface":"back","average":{"1min":1.772,"5min":2.4039999999999999,"15min":2.0089999999999999},"min":{"1min":1.107,"5min":0.995,"15min":0.66000000000000003},"max":{"1min":4.2990000000000004,"5min":10.233000000000001,"15min":10.233000000000001},"last":1.276},{"interface":"front","average":{"1min":2.0800000000000001,"5min":2.133,"15min":1.8839999999999999},"min":{"1min":1.1399999999999999,"5min":0.81399999999999995,"15min":0.75800000000000001},"max":{"1min":5.4630000000000001,"5min":7.5990000000000002,"15min":11.321},"last":1.3160000000000001}]},{"osd":8,"last update":"Fri Nov 20 12:13:50 2020","interfaces":[{"interface":"back","average":{"1min":2.9630000000000001,"5min":2.403,"15min":2.0880000000000001},"min":{"1min":1.3260000000000001,"5min":0.999,"15min":0.92400000000000004},"max":{"1min":13.618,"5min":13.618,"15min":13.618},"last":1.7450000000000001},{"interface":"front","average":{"1min":2.4100000000000001,"5min":2.4649999999999999,"15min":2.0899999999999999},"min":{"1min":1.3029999999999999,"5min":1.1910000000000001,"15min":0.874},"max":{"1min":7.3170000000000002,"5min":7.3170000000000002,"15min":9.2720000000000002},"last":1.5660000000000001}]},{"osd":9,"last update":"Fri Nov 20 12:13:50 2020","interfaces":[{"interface":"back","average":{"1min":2.0449999999999999,"5min":2.4889999999999999,"15min":2.1829999999999998},"min":{"1min":1.369,"5min":1.21,"15min":1.032},"max":{"1min":4.4779999999999998,"5min":7.3479999999999999,"15min":7.5979999999999999},"last":1.4359999999999999},{"interface":"front","average":{"1min":2.246,"5min":2.4319999999999999,"15min":2.0819999999999999},"min":{"1min":1.355,"5min":1.0660000000000001,"15min":0.97199999999999998},"max":{"1min":5.6920000000000002,"5min":7.6619999999999999,"15min":11.436999999999999},"last":1.4530000000000001}]},{"osd":10,"last update":"Fri Nov 20 12:13:50 2020","interfaces":[{"interface":"back","average":{"1min":2.355,"5min":2.5,"15min":2.3109999999999999},"min":{"1min":1.2629999999999999,"5min":1.105,"15min":0.81999999999999995},"max":{"1min":4.6520000000000001,"5min":8.423,"15min":8.9809999999999999},"last":1.474},{"interface":"front","average":{"1min":2.181,"5min":2.681,"15min":2.3730000000000002},"min":{"1min":1.395,"5min":0.96799999999999997,"15min":0.96099999999999997},"max":{"1min":4.4189999999999996,"5min":7.4710000000000001,"15min":8.0190000000000001},"last":1.3660000000000001}]},{"osd":11,"last update":"Fri Nov 20 12:13:50 2020","interfaces":[{"interface":"back","average":{"1min":2.3780000000000001,"5min":2.4180000000000001,"15min":2.101},"min":{"1min":1.2909999999999999,"5min":1.133,"15min":0.88600000000000001},"max":{"1min":6.1900000000000004,"5min":7.7229999999999999,"15min":11.547000000000001},"last":1.5549999999999999},{"interface":"front","average":{"1min":2.3799999999999999,"5min":2.4809999999999999,"15min":2.3109999999999999},"min":{"1min":1.3939999999999999,"5min":1.1759999999999999,"15min":0.98199999999999998},"max":{"1min":4.7590000000000003,"5min":10.367000000000001,"15min":14.678000000000001},"last":1.6279999999999999}]}]},{"osd":6,"up_from":17,"seq":73014444350,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":453476,"kb_used_data":61468,"kb_used_omap":0,"kb_used_meta":392000,"kb_avail":93918364,"statfs":{"total":96636764160,"available":96172404736,"internally_reserved":0,"allocated":62943232,"data_stored":83481095,"data_compressed":9754370,"data_compressed_allocated":20705280,"data_compressed_original":41410560,"omap_allocated":0,"internal_metadata":401408000},"hb_peers":[0,1,2,3,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:13:36 2020","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.329,"15min":1.1739999999999999},"min":{"1min":0.67500000000000004,"5min":0.58699999999999997,"15min":0.54100000000000004},"max":{"1min":3.1739999999999999,"5min":11.004,"15min":11.004},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.97299999999999998,"15min":1.0209999999999999},"min":{"1min":0.67400000000000004,"5min":0.60499999999999998,"15min":0.56200000000000006},"max":{"1min":1.845,"5min":3.9860000000000002,"15min":8.5150000000000006},"last":1.2330000000000001}]},{"osd":1,"last update":"Fri Nov 20 12:13:36 2020","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.3160000000000001,"15min":1.381},"min":{"1min":0.77700000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.4100000000000001,"5min":4.5179999999999998,"15min":6.1369999999999996},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.4910000000000001,"15min":2.1899999999999999},"min":{"1min":0.68999999999999995,"5min":0.58099999999999996,"15min":0.56899999999999995},"max":{"1min":1.542,"5min":21.001000000000001,"15min":136.38},"last":0.753}]},{"osd":2,"last update":"Fri Nov 20 12:13:36 2020","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.278,"15min":1.4139999999999999},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.58399999999999996},"max":{"1min":1.4810000000000001,"5min":6.9470000000000001,"15min":34.850999999999999},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.6850000000000001,"15min":1.5289999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.64600000000000002},"max":{"1min":2.8050000000000002,"5min":12.048999999999999,"15min":12.048999999999999},"last":1.1220000000000001}]},{"osd":3,"last update":"Fri Nov 20 12:13:36 2020","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.4219999999999999,"15min":1.4450000000000001},"min":{"1min":0.88900000000000001,"5min":0.71499999999999997,"15min":0.68700000000000006},"max":{"1min":2.1749999999999998,"5min":4.6500000000000004,"15min":6.5990000000000002},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.3839999999999999,"15min":1.6319999999999999},"min":{"1min":0.86099999999999999,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.952,"5min":4.9889999999999999,"15min":54.747},"last":1.143}]},{"osd":5,"last update":"Fri Nov 20 12:13:36 2020","interfaces":[{"interface":"back","average":{"1min":1.6259999999999999,"5min":1.8819999999999999,"15min":1.766},"min":{"1min":0.97699999999999998,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":2.9369999999999998,"5min":12.162000000000001,"15min":21.766999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.5089999999999999,"5min":1.635,"15min":1.6739999999999999},"min":{"1min":1.133,"5min":0.97499999999999998,"15min":0.84899999999999998},"max":{"1min":2.532,"5min":4.7880000000000003,"15min":22.012},"last":1.3660000000000001}]},{"osd":7,"last update":"Fri Nov 20 12:13:36 2020","interfaces":[{"interface":"back","average":{"1min":1.895,"5min":1.7669999999999999,"15min":1.827},"min":{"1min":0.96099999999999997,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":6.4189999999999996,"5min":6.8789999999999996,"15min":34.982999999999997},"last":1.026},{"interface":"front","average":{"1min":1.881,"5min":2.1400000000000001,"15min":1.9550000000000001},"min":{"1min":1.1759999999999999,"5min":1.0049999999999999,"15min":0.874},"max":{"1min":4.3120000000000003,"5min":11.670999999999999,"15min":11.670999999999999},"last":1.395}]},{"osd":8,"last update":"Fri Nov 20 12:13:36 2020","interfaces":[{"interface":"back","average":{"1min":1.655,"5min":1.8160000000000001,"15min":1.7709999999999999},"min":{"1min":1.2070000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":2.6539999999999999,"5min":7.4560000000000004,"15min":7.4560000000000004},"last":1.659},{"interface":"front","average":{"1min":1.6020000000000001,"5min":1.829,"15min":1.984},"min":{"1min":1.2090000000000001,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":2.7730000000000001,"5min":6.4550000000000001,"15min":54.307000000000002},"last":1.4299999999999999}]},{"osd":9,"last update":"Fri Nov 20 12:13:36 2020","interfaces":[{"interface":"back","average":{"1min":1.79,"5min":2.0190000000000001,"15min":1.9450000000000001},"min":{"1min":1.073,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":3.5409999999999999,"5min":11.795999999999999,"15min":11.795999999999999},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.895,"5min":1.875,"15min":1.849},"min":{"1min":1.2769999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"max":{"1min":4.4740000000000002,"5min":7.3869999999999996,"15min":7.3869999999999996},"last":1.4990000000000001}]},{"osd":10,"last update":"Fri Nov 20 12:13:36 2020","interfaces":[{"interface":"back","average":{"1min":1.742,"5min":2.028,"15min":2.137},"min":{"1min":0.997,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":2.891,"5min":8.8759999999999994,"15min":54.162999999999997},"last":1.675},{"interface":"front","average":{"1min":2.1360000000000001,"5min":2.3690000000000002,"15min":2.1749999999999998},"min":{"1min":1.22,"5min":1.1819999999999999,"15min":1.0469999999999999},"max":{"1min":5.056,"5min":11.913,"15min":11.913},"last":1.5329999999999999}]},{"osd":11,"last update":"Fri Nov 20 12:13:36 2020","interfaces":[{"interface":"back","average":{"1min":1.964,"5min":1.9750000000000001,"15min":1.9510000000000001},"min":{"1min":1.347,"5min":1.1279999999999999,"15min":1.1279999999999999},"max":{"1min":4.5570000000000004,"5min":7.2610000000000001,"15min":7.2610000000000001},"last":1.595},{"interface":"front","average":{"1min":1.7430000000000001,"5min":1.9099999999999999,"15min":2.1190000000000002},"min":{"1min":1.325,"5min":1.077,"15min":1.077},"max":{"1min":3.0009999999999999,"5min":6.6970000000000001,"15min":54.432000000000002},"last":1.552}]}]},{"osd":1,"up_from":17,"seq":73014444348,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":472096,"kb_used_data":48216,"kb_used_omap":0,"kb_used_meta":423872,"kb_avail":93899744,"statfs":{"total":96636764160,"available":96153337856,"internally_reserved":0,"allocated":49373184,"data_stored":66703879,"data_compressed":8227218,"data_compressed_allocated":17498112,"data_compressed_original":34996224,"omap_allocated":0,"internal_metadata":434044928},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.2070000000000001,"15min":1.123},"min":{"1min":0.71999999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":4.5490000000000004,"5min":6.0700000000000003,"15min":6.1559999999999997},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.49,"5min":1.5429999999999999,"15min":1.363},"min":{"1min":0.71999999999999997,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":6.5190000000000001,"5min":6.5190000000000001,"15min":9.3610000000000007},"last":0.97299999999999998}]},{"osd":2,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.4810000000000001,"15min":1.3140000000000001},"min":{"1min":0.74399999999999999,"5min":0.59799999999999998,"15min":0.58699999999999997},"max":{"1min":4.0030000000000001,"5min":6.6760000000000002,"15min":6.6760000000000002},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.508,"15min":1.4450000000000001},"min":{"1min":0.84699999999999998,"5min":0.73899999999999999,"15min":0.54900000000000004},"max":{"1min":4.4180000000000001,"5min":6.3159999999999998,"15min":8.5210000000000008},"last":1.069}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":4,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":1.8400000000000001,"5min":1.99,"15min":1.764},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":8.1389999999999993,"5min":8.1389999999999993,"15min":9.5419999999999998},"last":0.74199999999999999},{"interface":"front","average":{"1min":1.802,"5min":1.919,"15min":1.837},"min":{"1min":0.76800000000000002,"5min":0.67700000000000005,"15min":0.66700000000000004},"max":{"1min":4.2859999999999996,"5min":7.077,"15min":12.92},"last":0.89200000000000002}]},{"osd":5,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":1.871,"5min":2.0129999999999999,"15min":1.819},"min":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.78400000000000003},"max":{"1min":6.7809999999999997,"5min":6.7809999999999997,"15min":9.7870000000000008},"last":1.052},{"interface":"front","average":{"1min":1.6319999999999999,"5min":1.766,"15min":1.6539999999999999},"min":{"1min":0.95499999999999996,"5min":0.82899999999999996,"15min":0.60299999999999998},"max":{"1min":4.4539999999999997,"5min":6.7939999999999996,"15min":7.4240000000000004},"last":1.03}]},{"osd":6,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":1.72,"5min":1.8660000000000001,"15min":1.7430000000000001},"min":{"1min":0.98099999999999998,"5min":0.81399999999999995,"15min":0.68400000000000005},"max":{"1min":6.109,"5min":7.7210000000000001,"15min":7.7210000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":2.0249999999999999,"5min":2.173,"15min":2.032},"min":{"1min":1.1599999999999999,"5min":1.0740000000000001,"15min":0.97499999999999998},"max":{"1min":7.4320000000000004,"5min":7.4320000000000004,"15min":9.2859999999999996},"last":1.125}]},{"osd":7,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":1.952,"5min":2.0609999999999999,"15min":1.946},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":6.6680000000000001,"5min":7.2539999999999996,"15min":8.8810000000000002},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.887,"5min":2.1219999999999999,"15min":2.044},"min":{"1min":1.1200000000000001,"5min":1.042,"15min":0.92300000000000004},"max":{"1min":6.359,"5min":7.0540000000000003,"15min":8.6080000000000005},"last":1.3049999999999999}]},{"osd":8,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":2.1800000000000002,"5min":2.4860000000000002,"15min":2.2850000000000001},"min":{"1min":1.3220000000000001,"5min":1.2,"15min":1.1950000000000001},"max":{"1min":6.6589999999999998,"5min":14.266999999999999,"15min":14.266999999999999},"last":1.262},{"interface":"front","average":{"1min":2.1469999999999998,"5min":2.3199999999999998,"15min":2.1190000000000002},"min":{"1min":1.2110000000000001,"5min":0.98299999999999998,"15min":0.82599999999999996},"max":{"1min":6.79,"5min":14.351000000000001,"15min":14.351000000000001},"last":1.2729999999999999}]},{"osd":9,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":1.919,"5min":2.0979999999999999,"15min":2.0649999999999999},"min":{"1min":1.1599999999999999,"5min":1.079,"15min":1.079},"max":{"1min":6.2450000000000001,"5min":7.2149999999999999,"15min":11.465999999999999},"last":1.5069999999999999},{"interface":"front","average":{"1min":2.2490000000000001,"5min":2.4079999999999999,"15min":2.2999999999999998},"min":{"1min":1.393,"5min":1.2689999999999999,"15min":1.1970000000000001},"max":{"1min":6.9059999999999997,"5min":6.9059999999999997,"15min":12.558999999999999},"last":1.198}]},{"osd":10,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":2.2679999999999998,"5min":2.415,"15min":2.242},"min":{"1min":1.3069999999999999,"5min":1.1120000000000001,"15min":1.0069999999999999},"max":{"1min":6.4710000000000001,"5min":7.335,"15min":8.7420000000000009},"last":1.4379999999999999},{"interface":"front","average":{"1min":2.5750000000000002,"5min":2.8820000000000001,"15min":2.673},"min":{"1min":1.3600000000000001,"5min":1.343,"15min":1.272},"max":{"1min":7.0229999999999997,"5min":7.298,"15min":12.689},"last":1.327}]},{"osd":11,"last update":"Fri Nov 20 12:14:09 2020","interfaces":[{"interface":"back","average":{"1min":2.0859999999999999,"5min":2.577,"15min":2.4990000000000001},"min":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3540000000000001},"max":{"1min":6.3769999999999998,"5min":7.141,"15min":12.827},"last":1.3899999999999999},{"interface":"front","average":{"1min":2.1779999999999999,"5min":2.649,"15min":2.5859999999999999},"min":{"1min":1.462,"5min":1.462,"15min":1.389},"max":{"1min":6.4939999999999998,"5min":7.25,"15min":12.941000000000001},"last":1.462}]}]},{"osd":0,"up_from":17,"seq":73014444349,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":290796,"kb_used_data":19428,"kb_used_omap":0,"kb_used_meta":271360,"kb_avail":94081044,"statfs":{"total":96636764160,"available":96338989056,"internally_reserved":0,"allocated":19894272,"data_stored":25301787,"data_compressed":2644903,"data_compressed_allocated":5566464,"data_compressed_original":11132928,"omap_allocated":0,"internal_metadata":277872640},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 20 12:13:46 2020","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":1.0349999999999999,"15min":1.097},"min":{"1min":0.624,"5min":0.59499999999999997,"15min":0.56100000000000005},"max":{"1min":2.0659999999999998,"5min":8.7539999999999996,"15min":13.342000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.1339999999999999,"15min":1.1899999999999999},"min":{"1min":0.64300000000000002,"5min":0.61699999999999999,"15min":0.58999999999999997},"max":{"1min":2.2130000000000001,"5min":9.157,"15min":12.875},"last":0.85299999999999998}]},{"osd":2,"last update":"Fri Nov 20 12:13:46 2020","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.0620000000000001,"15min":1.1259999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.61199999999999999},"max":{"1min":2.121,"5min":4.4459999999999997,"15min":5.7370000000000001},"last":1.206},{"interface":"front","average":{"1min":1.179,"5min":1.2130000000000001,"15min":1.236},"min":{"1min":0.80100000000000005,"5min":0.69999999999999996,"15min":0.56799999999999995},"max":{"1min":1.599,"5min":2.2330000000000001,"15min":6.3029999999999999},"last":1.2549999999999999}]},{"osd":3,"last update":"Fri Nov 20 12:13:46 2020","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.327,"15min":1.3120000000000001},"min":{"1min":0.66500000000000004,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.359,"5min":4.7539999999999996,"15min":13.930999999999999},"last":1.169},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.1679999999999999,"15min":1.244},"min":{"1min":0.64300000000000002,"5min":0.621,"15min":0.59299999999999997},"max":{"1min":2.5430000000000001,"5min":4.46,"15min":5.5339999999999998},"last":0.83499999999999996}]},{"osd":4,"last update":"Fri Nov 20 12:13:46 2020","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.488,"15min":1.496},"min":{"1min":0.78700000000000003,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.6600000000000001,"5min":5.7610000000000001,"15min":7.8120000000000003},"last":1.081},{"interface":"front","average":{"1min":1.242,"5min":1.452,"15min":1.4950000000000001},"min":{"1min":0.89100000000000001,"5min":0.83999999999999997,"15min":0.58299999999999996},"max":{"1min":1.7749999999999999,"5min":5.4000000000000004,"15min":7.9980000000000002},"last":1.1279999999999999}]},{"osd":5,"last update":"Fri Nov 20 12:13:46 2020","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.5269999999999999,"15min":1.583},"min":{"1min":0.96999999999999997,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.78,"5min":6.5609999999999999,"15min":13.669},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.5289999999999999,"15min":1.5529999999999999},"min":{"1min":1.095,"5min":0.83199999999999996,"15min":0.81899999999999995},"max":{"1min":1.6719999999999999,"5min":5.2160000000000002,"15min":13.018000000000001},"last":1.296}]},{"osd":6,"last update":"Fri Nov 20 12:13:46 2020","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.641,"15min":1.6879999999999999},"min":{"1min":1.0529999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":3.0840000000000001,"5min":6.6790000000000003,"15min":8.0410000000000004},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.605,"15min":1.7030000000000001},"min":{"1min":1.1359999999999999,"5min":0.95399999999999996,"15min":0.73799999999999999},"max":{"1min":1.899,"5min":3.2709999999999999,"15min":6.6909999999999998},"last":1.3979999999999999}]},{"osd":7,"last update":"Fri Nov 20 12:13:46 2020","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.714,"15min":1.698},"min":{"1min":1.2310000000000001,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.9750000000000001,"5min":7.827,"15min":8.5820000000000007},"last":1.411},{"interface":"front","average":{"1min":1.639,"5min":1.8129999999999999,"15min":1.8799999999999999},"min":{"1min":1.244,"5min":1.0600000000000001,"15min":1.0509999999999999},"max":{"1min":2.766,"5min":6.4400000000000004,"15min":9.5909999999999993},"last":1.373}]},{"osd":8,"last update":"Fri Nov 20 12:13:46 2020","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.7669999999999999,"15min":1.7549999999999999},"min":{"1min":1.244,"5min":1.0549999999999999,"15min":1.0549999999999999},"max":{"1min":2.0600000000000001,"5min":5.2309999999999999,"15min":8.3469999999999995},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.768,"15min":1.827},"min":{"1min":1.3029999999999999,"5min":1.157,"15min":1.0900000000000001},"max":{"1min":2.8740000000000001,"5min":6.556,"15min":8.4039999999999999},"last":1.607}]},{"osd":9,"last update":"Fri Nov 20 12:13:46 2020","interfaces":[{"interface":"back","average":{"1min":1.6439999999999999,"5min":1.768,"15min":1.833},"min":{"1min":1.2869999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"max":{"1min":2.1520000000000001,"5min":4.3129999999999997,"15min":8.4610000000000003},"last":1.5629999999999999},{"interface":"front","average":{"1min":1.661,"5min":1.8919999999999999,"15min":1.907},"min":{"1min":1.4179999999999999,"5min":1.042,"15min":1.042},"max":{"1min":2.0489999999999999,"5min":5.6879999999999997,"15min":8.4649999999999999},"last":1.6679999999999999}]},{"osd":11,"last update":"Fri Nov 20 12:13:46 2020","interfaces":[{"interface":"back","average":{"1min":1.6639999999999999,"5min":1.7609999999999999,"15min":1.867},"min":{"1min":1.3620000000000001,"5min":1.177,"15min":1.1699999999999999},"max":{"1min":2.004,"5min":4.4740000000000002,"15min":8.3800000000000008},"last":1.629},{"interface":"front","average":{"1min":1.661,"5min":1.8859999999999999,"15min":1.921},"min":{"1min":1.4890000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"max":{"1min":2.1800000000000002,"5min":5.4909999999999997,"15min":8.7029999999999994},"last":1.8009999999999999}]}]},{"osd":2,"up_from":17,"seq":73014444349,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51748,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":51456,"kb_avail":94320092,"statfs":{"total":96636764160,"available":96583774208,"internally_reserved":0,"allocated":290816,"data_stored":135963,"data_compressed":2789,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":52690944},"hb_peers":[0,1,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":0.96199999999999997,"15min":0.97699999999999998},"min":{"1min":0.625,"5min":0.60599999999999998,"15min":0.56299999999999994},"max":{"1min":1.7749999999999999,"5min":3.5840000000000001,"15min":3.8690000000000002},"last":0.67000000000000004},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.1759999999999999,"15min":1.1899999999999999},"min":{"1min":0.68799999999999994,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":3.0179999999999998,"5min":6.4470000000000001,"15min":8.0739999999999998},"last":1.0620000000000001}]},{"osd":1,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.2729999999999999,"15min":1.294},"min":{"1min":0.64800000000000002,"5min":0.60199999999999998,"15min":0.55800000000000005},"max":{"1min":4.9740000000000002,"5min":4.9740000000000002,"15min":29.183},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.47,"15min":1.3919999999999999},"min":{"1min":0.72399999999999998,"5min":0.622,"15min":0.57699999999999996},"max":{"1min":5.484,"5min":7.7560000000000002,"15min":11.492000000000001},"last":1.0109999999999999}]},{"osd":3,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.99199999999999999,"15min":1.079},"min":{"1min":0.66200000000000003,"5min":0.59499999999999997,"15min":0.58099999999999996},"max":{"1min":1.798,"5min":4.0129999999999999,"15min":6.0220000000000002},"last":0.69899999999999995},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.2549999999999999,"15min":1.238},"min":{"1min":0.68799999999999994,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":4.3220000000000001,"5min":4.3220000000000001,"15min":9.3160000000000007},"last":0.72599999999999998}]},{"osd":4,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":1.9350000000000001,"5min":1.4850000000000001,"15min":1.4359999999999999},"min":{"1min":0.82899999999999996,"5min":0.75700000000000001,"15min":0.58299999999999996},"max":{"1min":6.5430000000000001,"5min":6.5430000000000001,"15min":7.0510000000000002},"last":1.236},{"interface":"front","average":{"1min":1.679,"5min":1.54,"15min":1.4359999999999999},"min":{"1min":0.90900000000000003,"5min":0.745,"15min":0.72499999999999998},"max":{"1min":6.5919999999999996,"5min":6.5919999999999996,"15min":6.5919999999999996},"last":1.202}]},{"osd":5,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.367,"15min":1.343},"min":{"1min":0.73999999999999999,"5min":0.69899999999999995,"15min":0.624},"max":{"1min":2.7509999999999999,"5min":6.5869999999999997,"15min":7.3659999999999997},"last":1.276},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.502,"15min":1.597},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.65600000000000003},"max":{"1min":5.0830000000000002,"5min":9.1240000000000006,"15min":35.177},"last":1.1140000000000001}]},{"osd":6,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":1.5600000000000001,"5min":1.512,"15min":1.4630000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":5.0949999999999998,"5min":5.0949999999999998,"15min":5.4880000000000004},"last":1.369},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.5629999999999999,"15min":1.619},"min":{"1min":1.0289999999999999,"5min":0.995,"15min":0.83799999999999997},"max":{"1min":3.097,"5min":6.7149999999999999,"15min":8.202},"last":1.1850000000000001}]},{"osd":7,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":1.804,"5min":1.8480000000000001,"15min":1.7430000000000001},"min":{"1min":0.98999999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":5.1859999999999999,"5min":9.3460000000000001,"15min":10.002000000000001},"last":1.343},{"interface":"front","average":{"1min":1.6910000000000001,"5min":1.6890000000000001,"15min":1.613},"min":{"1min":1.101,"5min":1.0660000000000001,"15min":0.85799999999999998},"max":{"1min":3.9089999999999998,"5min":4.7460000000000004,"15min":4.9340000000000002},"last":1.637}]},{"osd":8,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":1.7589999999999999,"15min":1.6739999999999999},"min":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":0.81399999999999995},"max":{"1min":3.3610000000000002,"5min":8.3019999999999996,"15min":8.3019999999999996},"last":1.399},{"interface":"front","average":{"1min":1.853,"5min":1.8140000000000001,"15min":1.728},"min":{"1min":1.0600000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":5.2910000000000004,"5min":9.2420000000000009,"15min":9.2420000000000009},"last":1.4379999999999999}]},{"osd":9,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":1.6830000000000001,"15min":1.633},"min":{"1min":1.173,"5min":1.081,"15min":0.999},"max":{"1min":2.839,"5min":4.2000000000000002,"15min":6.3769999999999998},"last":1.5149999999999999},{"interface":"front","average":{"1min":1.635,"5min":1.7549999999999999,"15min":1.7849999999999999},"min":{"1min":1.2210000000000001,"5min":1.109,"15min":1.069},"max":{"1min":3.1829999999999998,"5min":6.8319999999999999,"15min":9.0559999999999992},"last":1.4830000000000001}]},{"osd":10,"last update":"Fri Nov 20 12:13:49 2020","interfaces":[{"interface":"back","average":{"1min":1.8999999999999999,"5min":1.956,"15min":1.847},"min":{"1min":1.2350000000000001,"5min":1.224,"15min":1.1739999999999999},"max":{"1min":4.4219999999999997,"5min":5.3609999999999998,"15min":6.4409999999999998},"last":1.774},{"interface":"front","average":{"1min":2.3740000000000001,"5min":2.2210000000000001,"15min":2.1880000000000002},"min":{"1min":1.282,"5min":1.282,"15min":1.169},"max":{"1min":6.4589999999999996,"5min":13.752000000000001,"15min":29.145},"last":1.5609999999999999}]}]},{"osd":3,"up_from":17,"seq":73014444350,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":662340,"kb_used_data":83004,"kb_used_omap":0,"kb_used_meta":579328,"kb_avail":93709500,"statfs":{"total":96636764160,"available":95958528000,"internally_reserved":0,"allocated":84996096,"data_stored":110400418,"data_compressed":12152602,"data_compressed_allocated":25579520,"data_compressed_original":51159040,"omap_allocated":0,"internal_metadata":593231872},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:13:55 2020","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":1.4339999999999999,"15min":1.109},"min":{"1min":0.59099999999999997,"5min":0.57599999999999996,"15min":0.54700000000000004},"max":{"1min":1.5529999999999999,"5min":32.991,"15min":32.991},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.552,"15min":1.357},"min":{"1min":0.66300000000000003,"5min":0.64000000000000001,"15min":0.621},"max":{"1min":1.617,"5min":33.176000000000002,"15min":33.176000000000002},"last":1.0760000000000001}]},{"osd":1,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":1.962,"15min":1.5189999999999999},"min":{"1min":0.629,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.3939999999999999,"5min":35.597999999999999,"15min":35.597999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.623,"15min":1.2749999999999999},"min":{"1min":0.64600000000000002,"5min":0.61299999999999999,"15min":0.59299999999999997},"max":{"1min":1.8240000000000001,"5min":33.368000000000002,"15min":33.368000000000002},"last":1.0009999999999999}]},{"osd":2,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.772,"15min":1.4139999999999999},"min":{"1min":0.77000000000000002,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.4970000000000001,"5min":33.314,"15min":33.314},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.194,"5min":1.6299999999999999,"15min":1.4399999999999999},"min":{"1min":0.751,"5min":0.60899999999999999,"15min":0.60199999999999998},"max":{"1min":1.647,"5min":33.457000000000001,"15min":33.457000000000001},"last":0.95499999999999996}]},{"osd":4,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.8080000000000001,"15min":1.5169999999999999},"min":{"1min":0.79000000000000004,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":3.02,"5min":33.484999999999999,"15min":33.484999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.5700000000000001,"5min":2.0680000000000001,"15min":1.6419999999999999},"min":{"1min":1.0049999999999999,"5min":0.80000000000000004,"15min":0.72599999999999998},"max":{"1min":7.8289999999999997,"5min":33.442999999999998,"15min":33.442999999999998},"last":0.76200000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":2.008,"15min":1.659},"min":{"1min":0.879,"5min":0.879,"15min":0.79000000000000004},"max":{"1min":2.012,"5min":33.523000000000003,"15min":33.523000000000003},"last":1.238},{"interface":"front","average":{"1min":1.371,"5min":1.857,"15min":1.696},"min":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.90600000000000003},"max":{"1min":1.746,"5min":33.753,"15min":33.753},"last":1.4670000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":7,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":2.0289999999999999,"5min":2.1970000000000001,"15min":1.9159999999999999},"min":{"1min":1.0700000000000001,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":9.0589999999999993,"5min":33.869,"15min":33.869},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.861,"5min":2.0990000000000002,"15min":1.704},"min":{"1min":0.93200000000000005,"5min":0.879,"15min":0.83999999999999997},"max":{"1min":9.1400000000000006,"5min":36.171999999999997,"15min":36.171999999999997},"last":1.1299999999999999}]},{"osd":8,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":1.538,"5min":2.0569999999999999,"15min":1.901},"min":{"1min":1.1419999999999999,"5min":1.0269999999999999,"15min":0.89300000000000002},"max":{"1min":1.8759999999999999,"5min":33.996000000000002,"15min":33.996000000000002},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.357,"5min":1.8979999999999999,"15min":1.6220000000000001},"min":{"1min":1.0369999999999999,"5min":0.84899999999999998,"15min":0.82299999999999995},"max":{"1min":1.9259999999999999,"5min":36.100000000000001,"15min":36.100000000000001},"last":1.2609999999999999}]},{"osd":9,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":2.1709999999999998,"15min":1.8280000000000001},"min":{"1min":1.1060000000000001,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":2.2349999999999999,"5min":33.655999999999999,"15min":33.655999999999999},"last":1.367},{"interface":"front","average":{"1min":1.617,"5min":2.1880000000000002,"15min":2.0529999999999999},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":2.0739999999999998,"5min":34.082999999999998,"15min":34.082999999999998},"last":1.552}]},{"osd":10,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":2.1389999999999998,"15min":1.883},"min":{"1min":1.177,"5min":0.94099999999999995,"15min":0.90000000000000002},"max":{"1min":3.8039999999999998,"5min":36.235999999999997,"15min":36.235999999999997},"last":1.391},{"interface":"front","average":{"1min":1.714,"5min":2.3780000000000001,"15min":2.04},"min":{"1min":1.3380000000000001,"5min":1.0780000000000001,"15min":1.071},"max":{"1min":3.762,"5min":33.789999999999999,"15min":33.789999999999999},"last":1.4970000000000001}]},{"osd":11,"last update":"Fri Nov 20 12:13:48 2020","interfaces":[{"interface":"back","average":{"1min":1.764,"5min":2.375,"15min":2.1339999999999999},"min":{"1min":1.3129999999999999,"5min":1.24,"15min":1.153},"max":{"1min":3.0619999999999998,"5min":35.018999999999998,"15min":35.018999999999998},"last":1.6259999999999999},{"interface":"front","average":{"1min":1.5920000000000001,"5min":2.1819999999999999,"15min":1.871},"min":{"1min":1.206,"5min":1.194,"15min":1.0029999999999999},"max":{"1min":3.0899999999999999,"5min":36.298000000000002,"15min":36.298000000000002},"last":1.5189999999999999}]}]},{"osd":4,"up_from":17,"seq":73014444350,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":345160,"kb_used_data":29568,"kb_used_omap":0,"kb_used_meta":315584,"kb_avail":94026680,"statfs":{"total":96636764160,"available":96283320320,"internally_reserved":0,"allocated":30277632,"data_stored":39096515,"data_compressed":4213942,"data_compressed_allocated":8978432,"data_compressed_original":17956864,"omap_allocated":0,"internal_metadata":323158016},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":1,"last update":"Fri Nov 20 12:13:55 2020","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.573,"15min":1.554},"min":{"1min":0.61699999999999999,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":7.1050000000000004,"5min":10.784000000000001,"15min":35.734999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":1.954,"5min":1.869,"15min":2.077},"min":{"1min":0.64500000000000002,"5min":0.629,"15min":0.52500000000000002},"max":{"1min":9.9789999999999992,"5min":9.9789999999999992,"15min":104.79300000000001},"last":0.75600000000000001}]},{"osd":2,"last update":"Fri Nov 20 12:13:59 2020","interfaces":[{"interface":"back","average":{"1min":1.5980000000000001,"5min":1.6359999999999999,"15min":1.534},"min":{"1min":0.93500000000000005,"5min":0.749,"15min":0.65600000000000003},"max":{"1min":6.4240000000000004,"5min":6.843,"15min":6.843},"last":1.2},{"interface":"front","average":{"1min":1.651,"5min":1.7729999999999999,"15min":1.6319999999999999},"min":{"1min":0.94199999999999995,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":5.9139999999999997,"5min":7.3079999999999998,"15min":16.853999999999999},"last":1.2949999999999999}]},{"osd":3,"last update":"Fri Nov 20 12:13:55 2020","interfaces":[{"interface":"back","average":{"1min":1.76,"5min":1.8100000000000001,"15min":1.7050000000000001},"min":{"1min":1.022,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":6.6299999999999999,"5min":10.906000000000001,"15min":10.906000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.48,"5min":1.8979999999999999,"15min":1.7689999999999999},"min":{"1min":0.99199999999999999,"5min":0.748,"15min":0.63700000000000001},"max":{"1min":3.7250000000000001,"5min":6.9779999999999998,"15min":11.813000000000001},"last":1.028}]},{"osd":5,"last update":"Fri Nov 20 12:13:55 2020","interfaces":[{"interface":"back","average":{"1min":1.601,"5min":1.681,"15min":1.429},"min":{"1min":0.67600000000000005,"5min":0.64500000000000002,"15min":0.59599999999999997},"max":{"1min":5.7999999999999998,"5min":6.1689999999999996,"15min":6.6600000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.9350000000000001,"5min":1.9990000000000001,"15min":1.927},"min":{"1min":1.014,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":6.7649999999999997,"5min":6.7649999999999997,"15min":9.2070000000000007},"last":1.3180000000000001}]},{"osd":6,"last update":"Fri Nov 20 12:13:55 2020","interfaces":[{"interface":"back","average":{"1min":1.5960000000000001,"5min":1.7849999999999999,"15min":1.6299999999999999},"min":{"1min":0.76000000000000001,"5min":0.71799999999999997,"15min":0.60499999999999998},"max":{"1min":5.5579999999999998,"5min":5.7850000000000001,"15min":25.809000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":2.044,"5min":2.2309999999999999,"15min":2.1230000000000002},"min":{"1min":1.1619999999999999,"5min":1.101,"15min":1.0329999999999999},"max":{"1min":7.4470000000000001,"5min":10.268000000000001,"15min":12.85},"last":1.075}]},{"osd":7,"last update":"Fri Nov 20 12:13:55 2020","interfaces":[{"interface":"back","average":{"1min":2.2229999999999999,"5min":2.4199999999999999,"15min":2.1629999999999998},"min":{"1min":0.95999999999999996,"5min":0.92500000000000004,"15min":0.82899999999999996},"max":{"1min":10.552,"5min":10.552,"15min":16.713999999999999},"last":1.173},{"interface":"front","average":{"1min":1.913,"5min":2.177,"15min":1.8200000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.71399999999999997},"max":{"1min":6.0519999999999996,"5min":11.853,"15min":11.853},"last":1.123}]},{"osd":8,"last update":"Fri Nov 20 12:13:55 2020","interfaces":[{"interface":"back","average":{"1min":2.1299999999999999,"5min":2.536,"15min":2.278},"min":{"1min":1.204,"5min":1.161,"15min":1.161},"max":{"1min":6.9969999999999999,"5min":12.117000000000001,"15min":12.117000000000001},"last":1.484},{"interface":"front","average":{"1min":1.9870000000000001,"5min":2.3290000000000002,"15min":2.149},"min":{"1min":1.2649999999999999,"5min":1.127,"15min":1.099},"max":{"1min":6.024,"5min":9.0939999999999994,"15min":11.938000000000001},"last":1.4350000000000001}]},{"osd":9,"last update":"Fri Nov 20 12:13:55 2020","interfaces":[{"interface":"back","average":{"1min":2.0379999999999998,"5min":2.4649999999999999,"15min":2.2450000000000001},"min":{"1min":1.272,"5min":1.1890000000000001,"15min":1.1890000000000001},"max":{"1min":6.7270000000000003,"5min":9.202,"15min":12.176},"last":1.5640000000000001},{"interface":"front","average":{"1min":2.0030000000000001,"5min":2.206,"15min":1.9279999999999999},"min":{"1min":1.127,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":6.157,"5min":6.157,"15min":7.8689999999999998},"last":1.2370000000000001}]},{"osd":10,"last update":"Fri Nov 20 12:13:55 2020","interfaces":[{"interface":"back","average":{"1min":2.113,"5min":2.5569999999999999,"15min":2.1469999999999998},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":6.0709999999999997,"5min":6.4850000000000003,"15min":8.0099999999999998},"last":1.349},{"interface":"front","average":{"1min":2.254,"5min":2.5640000000000001,"15min":2.3879999999999999},"min":{"1min":1.288,"5min":1.2210000000000001,"15min":1.2050000000000001},"max":{"1min":6.8810000000000002,"5min":10.391,"15min":10.391},"last":1.419}]},{"osd":11,"last update":"Fri Nov 20 12:13:55 2020","interfaces":[{"interface":"back","average":{"1min":2.2949999999999999,"5min":2.5249999999999999,"15min":2.359},"min":{"1min":1.3500000000000001,"5min":1.278,"15min":1.1399999999999999},"max":{"1min":7.2089999999999996,"5min":10.654,"15min":10.654},"last":1.5489999999999999},{"interface":"front","average":{"1min":2.1389999999999998,"5min":2.6459999999999999,"15min":2.363},"min":{"1min":1.411,"5min":1.2190000000000001,"15min":1.2190000000000001},"max":{"1min":6.2359999999999998,"5min":11.749000000000001,"15min":12.053000000000001},"last":1.6859999999999999}]}]},{"osd":5,"up_from":17,"seq":73014444351,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310052,"kb_used_data":12764,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94061788,"statfs":{"total":96636764160,"available":96319270912,"internally_reserved":0,"allocated":13070336,"data_stored":16913339,"data_compressed":1933693,"data_compressed_allocated":4009984,"data_compressed_original":8019968,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:13:42 2020","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.91600000000000004,"15min":0.88700000000000001},"min":{"1min":0.57399999999999995,"5min":0.54100000000000004,"15min":0.53800000000000003},"max":{"1min":2.0880000000000001,"5min":4.5519999999999996,"15min":6.7670000000000003},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.95199999999999996,"15min":0.97499999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":3.0329999999999999,"5min":6.3840000000000003,"15min":6.3840000000000003},"last":0.84199999999999997}]},{"osd":1,"last update":"Fri Nov 20 12:13:42 2020","interfaces":[{"interface":"back","average":{"1min":1.502,"5min":1.29,"15min":1.2430000000000001},"min":{"1min":0.55500000000000005,"5min":0.54700000000000004,"15min":0.52900000000000003},"max":{"1min":4.8650000000000002,"5min":7.069,"15min":11.497},"last":1.4750000000000001},{"interface":"front","average":{"1min":1.74,"5min":1.504,"15min":1.4239999999999999},"min":{"1min":0.97499999999999998,"5min":0.76900000000000002,"15min":0.52900000000000003},"max":{"1min":4.8929999999999998,"5min":5.1390000000000002,"15min":8.4290000000000003},"last":1.55}]},{"osd":3,"last update":"Fri Nov 20 12:13:42 2020","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.296,"15min":1.2669999999999999},"min":{"1min":0.65300000000000002,"5min":0.58099999999999996,"15min":0.56000000000000005},"max":{"1min":4.2460000000000004,"5min":6.1299999999999999,"15min":20.777000000000001},"last":0.874},{"interface":"front","average":{"1min":1.319,"5min":1.304,"15min":1.3540000000000001},"min":{"1min":0.75900000000000001,"5min":0.67800000000000005,"15min":0.58599999999999997},"max":{"1min":2.6110000000000002,"5min":5.7279999999999998,"15min":11.946},"last":1.0980000000000001}]},{"osd":4,"last update":"Fri Nov 20 12:13:42 2020","interfaces":[{"interface":"back","average":{"1min":1.637,"5min":1.5589999999999999,"15min":1.375},"min":{"1min":0.85799999999999998,"5min":0.69899999999999995,"15min":0.56399999999999995},"max":{"1min":5.181,"5min":6.4909999999999997,"15min":11.629},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.736,"5min":1.736,"15min":1.577},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.56200000000000006},"max":{"1min":9.4730000000000008,"5min":9.4730000000000008,"15min":10.872999999999999},"last":1.131}]},{"osd":6,"last update":"Fri Nov 20 12:13:42 2020","interfaces":[{"interface":"back","average":{"1min":1.7030000000000001,"5min":1.47,"15min":1.4339999999999999},"min":{"1min":0.92900000000000005,"5min":0.625,"15min":0.625},"max":{"1min":5.4489999999999998,"5min":5.4489999999999998,"15min":7.0060000000000002},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.6679999999999999,"5min":1.4970000000000001,"15min":1.6850000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71299999999999997},"max":{"1min":5.3259999999999996,"5min":6.2370000000000001,"15min":54.036000000000001},"last":1.0529999999999999}]},{"osd":7,"last update":"Fri Nov 20 12:13:42 2020","interfaces":[{"interface":"back","average":{"1min":1.5589999999999999,"5min":1.716,"15min":1.55},"min":{"1min":0.90600000000000003,"5min":0.83599999999999997,"15min":0.76100000000000001},"max":{"1min":3.3610000000000002,"5min":7.0910000000000002,"15min":7.0910000000000002},"last":1.3480000000000001},{"interface":"front","average":{"1min":2.2240000000000002,"5min":1.8,"15min":1.7070000000000001},"min":{"1min":1.04,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":7.6799999999999997,"5min":7.6799999999999997,"15min":11.364000000000001},"last":1.2929999999999999}]},{"osd":8,"last update":"Fri Nov 20 12:13:42 2020","interfaces":[{"interface":"back","average":{"1min":1.6879999999999999,"5min":1.597,"15min":1.5960000000000001},"min":{"1min":1.0740000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":3.2170000000000001,"5min":5.0129999999999999,"15min":7.1189999999999998},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.776,"5min":1.718,"15min":1.6499999999999999},"min":{"1min":1.0469999999999999,"5min":0.86299999999999999,"15min":0.78400000000000003},"max":{"1min":5.0810000000000004,"5min":7.3860000000000001,"15min":7.3860000000000001},"last":1.496}]},{"osd":9,"last update":"Fri Nov 20 12:13:42 2020","interfaces":[{"interface":"back","average":{"1min":1.631,"5min":1.6819999999999999,"15min":1.6839999999999999},"min":{"1min":0.95999999999999996,"5min":0.95799999999999996,"15min":0.84799999999999998},"max":{"1min":4.3559999999999999,"5min":4.3559999999999999,"15min":10.994},"last":1.385},{"interface":"front","average":{"1min":1.7250000000000001,"5min":1.7090000000000001,"15min":1.6890000000000001},"min":{"1min":1.3280000000000001,"5min":1.0649999999999999,"15min":1.0649999999999999},"max":{"1min":2.7349999999999999,"5min":5.1639999999999997,"15min":7.2320000000000002},"last":1.6910000000000001}]},{"osd":10,"last update":"Fri Nov 20 12:13:42 2020","interfaces":[{"interface":"back","average":{"1min":1.871,"5min":1.9770000000000001,"15min":1.9219999999999999},"min":{"1min":1.1659999999999999,"5min":1.0760000000000001,"15min":1.0389999999999999},"max":{"1min":4.593,"5min":11.638999999999999,"15min":11.638999999999999},"last":1.5880000000000001},{"interface":"front","average":{"1min":2.3570000000000002,"5min":1.9119999999999999,"15min":1.8420000000000001},"min":{"1min":1.393,"5min":1.1020000000000001,"15min":1.0780000000000001},"max":{"1min":6.2409999999999997,"5min":6.2409999999999997,"15min":7.3410000000000002},"last":1.768}]},{"osd":11,"last update":"Fri Nov 20 12:13:42 2020","interfaces":[{"interface":"back","average":{"1min":1.8560000000000001,"5min":1.802,"15min":1.6870000000000001},"min":{"1min":1.177,"5min":1.0249999999999999,"15min":1.0009999999999999},"max":{"1min":4.9669999999999996,"5min":7.2539999999999996,"15min":7.2539999999999996},"last":1.643},{"interface":"front","average":{"1min":1.867,"5min":1.8520000000000001,"15min":1.841},"min":{"1min":1.3340000000000001,"5min":1.105,"15min":1.0840000000000001},"max":{"1min":4.476,"5min":4.6959999999999997,"15min":11.231999999999999},"last":1.667}]}]}]}} 2020-11-20T12:14:18.165 INFO:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2020-11-20T12:14:18.279 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.275+0000 7fe029940700 1 Processor -- start 2020-11-20T12:14:18.279 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.275+0000 7fe029940700 1 -- start start 2020-11-20T12:14:18.281 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.276+0000 7fe029940700 1 --2- >> v2:172.21.15.87:3300/0 conn(0x7fe0240bbae0 0x7fe02414db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:18.282 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.276+0000 7fe029940700 1 -- --> v1:172.21.15.87:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0240641f0 con 0x7fe0240bb630 2020-11-20T12:14:18.282 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.276+0000 7fe029940700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe024064490 con 0x7fe02414a840 2020-11-20T12:14:18.282 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.276+0000 7fe029940700 1 -- --> v2:172.21.15.87:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe024064730 con 0x7fe0240bbae0 2020-11-20T12:14:18.282 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.277+0000 7fe022ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe02414a840 0x7fe0240601b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.192:33870/0 (socket says 172.21.15.192:33870) 2020-11-20T12:14:18.282 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.277+0000 7fe022ffd700 1 -- 172.21.15.192:0/3527528073 learned_addr learned my addr 172.21.15.192:0/3527528073 (peer_addr_for_me v1:172.21.15.192:0/0) 2020-11-20T12:14:18.283 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.277+0000 7fe0237fe700 1 --2- 172.21.15.192:0/3527528073 >> v2:172.21.15.87:3300/0 conn(0x7fe0240bbae0 0x7fe02414db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:18.283 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.277+0000 7fe021ffb700 1 -- 172.21.15.192:0/3527528073 <== mon.1 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 22997190 0 0) 0x7fe024064490 con 0x7fe02414a840 2020-11-20T12:14:18.283 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.277+0000 7fe021ffb700 1 -- 172.21.15.192:0/3527528073 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe010003280 con 0x7fe02414a840 2020-11-20T12:14:18.283 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.277+0000 7fe0237fe700 1 -- 172.21.15.192:0/3527528073 >> v1:172.21.15.146:6789/0 conn(0x7fe02414a840 legacy=0x7fe0240601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:18.283 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.277+0000 7fe0237fe700 1 -- 172.21.15.192:0/3527528073 >> v1:172.21.15.87:6789/0 conn(0x7fe0240bb630 legacy=0x7fe02414d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:18.284 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.277+0000 7fe021ffb700 1 -- 172.21.15.192:0/3527528073 <== mon.0 v1:172.21.15.87:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3474424248 0 0) 0x7fe0240641f0 con 0x7fe0240bb630 2020-11-20T12:14:18.284 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.277+0000 7fe0237fe700 1 -- 172.21.15.192:0/3527528073 --> v2:172.21.15.87:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0240649d0 con 0x7fe0240bbae0 2020-11-20T12:14:18.284 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.277+0000 7fe0237fe700 1 --2- 172.21.15.192:0/3527528073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0240bbae0 0x7fe02414db50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fe01c009ce0 tx=0x7fe01c009220).ready entity=mon.0 client_cookie=87025e8e3d145513 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:18.284 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.277+0000 7fe021ffb700 1 -- 172.21.15.192:0/3527528073 <== mon.0 v2:172.21.15.87:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01c00bad0 con 0x7fe0240bbae0 2020-11-20T12:14:18.284 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.277+0000 7fe021ffb700 1 -- 172.21.15.192:0/3527528073 <== mon.0 v2:172.21.15.87:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe01c00bc30 con 0x7fe0240bbae0 2020-11-20T12:14:18.285 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.277+0000 7fe021ffb700 1 -- 172.21.15.192:0/3527528073 <== mon.0 v2:172.21.15.87:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01c011400 con 0x7fe0240bbae0 2020-11-20T12:14:18.285 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.278+0000 7fe029940700 1 -- 172.21.15.192:0/3527528073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0240bbae0 msgr2=0x7fe02414db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:18.285 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.278+0000 7fe029940700 1 --2- 172.21.15.192:0/3527528073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0240bbae0 0x7fe02414db50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fe01c009ce0 tx=0x7fe01c009220).stop 2020-11-20T12:14:18.285 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.278+0000 7fe029940700 1 -- 172.21.15.192:0/3527528073 shutdown_connections 2020-11-20T12:14:18.285 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.278+0000 7fe029940700 1 --2- 172.21.15.192:0/3527528073 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe0240bbae0 0x7fe02414db50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.286 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.278+0000 7fe029940700 1 -- 172.21.15.192:0/3527528073 >> 172.21.15.192:0/3527528073 conn(0x7fe024062100 msgr2=0x7fe0240c3590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:18.286 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.278+0000 7fe029940700 1 -- 172.21.15.192:0/3527528073 shutdown_connections 2020-11-20T12:14:18.286 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.278+0000 7fe029940700 1 -- 172.21.15.192:0/3527528073 wait complete. 2020-11-20T12:14:18.289 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.279+0000 7fe029940700 1 Processor -- start 2020-11-20T12:14:18.290 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.279+0000 7fe029940700 1 -- start start 2020-11-20T12:14:18.290 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.280+0000 7fe029940700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0240bb630 0x7fe0241511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:18.290 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.280+0000 7fe029940700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0240bbae0 0x7fe024146a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:18.290 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.280+0000 7fe029940700 1 --2- >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe02414a840 0x7fe024146f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:18.290 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.280+0000 7fe029940700 1 -- --> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0240af410 con 0x7fe02414a840 2020-11-20T12:14:18.291 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.280+0000 7fe029940700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0240af600 con 0x7fe0240bbae0 2020-11-20T12:14:18.291 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.280+0000 7fe029940700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0240af8a0 con 0x7fe0240bb630 2020-11-20T12:14:18.291 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.280+0000 7fe022ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0240bb630 0x7fe0241511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:18.291 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.280+0000 7fe022ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0240bb630 0x7fe0241511a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50152/0 (socket says 172.21.15.192:50152) 2020-11-20T12:14:18.291 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.280+0000 7fe022ffd700 1 -- 172.21.15.192:0/1278045842 learned_addr learned my addr 172.21.15.192:0/1278045842 (peer_addr_for_me v2:172.21.15.192:0/0) 2020-11-20T12:14:18.292 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.280+0000 7fe0227fc700 1 --2- 172.21.15.192:0/1278045842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0240bbae0 0x7fe024146a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:18.292 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.280+0000 7fe0237fe700 1 --2- 172.21.15.192:0/1278045842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe02414a840 0x7fe024146f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:18.292 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.280+0000 7fe022ffd700 1 -- 172.21.15.192:0/1278045842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0240bbae0 msgr2=0x7fe024146a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:18.292 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.280+0000 7fe022ffd700 1 --2- 172.21.15.192:0/1278045842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0240bbae0 0x7fe024146a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.292 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.280+0000 7fe022ffd700 1 -- 172.21.15.192:0/1278045842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe02414a840 msgr2=0x7fe024146f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:18.293 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.280+0000 7fe022ffd700 1 --2- 172.21.15.192:0/1278045842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe02414a840 0x7fe024146f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.293 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.280+0000 7fe022ffd700 1 -- 172.21.15.192:0/1278045842 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0240afb40 con 0x7fe0240bb630 2020-11-20T12:14:18.293 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.280+0000 7fe022ffd700 1 --2- 172.21.15.192:0/1278045842 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0240bb630 0x7fe0241511a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fe01800c710 tx=0x7fe018007b10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:18.293 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.281+0000 7fe00affd700 1 -- 172.21.15.192:0/1278045842 <== mon.2 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0180072e0 con 0x7fe0240bb630 2020-11-20T12:14:18.294 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.281+0000 7fe029940700 1 -- 172.21.15.192:0/1278045842 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0240ac9f0 con 0x7fe0240bb630 2020-11-20T12:14:18.294 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.281+0000 7fe00affd700 1 -- 172.21.15.192:0/1278045842 <== mon.2 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe018007440 con 0x7fe0240bb630 2020-11-20T12:14:18.294 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.281+0000 7fe00affd700 1 -- 172.21.15.192:0/1278045842 <== mon.2 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe018005840 con 0x7fe0240bb630 2020-11-20T12:14:18.294 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.281+0000 7fe029940700 1 -- 172.21.15.192:0/1278045842 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0240ac4d0 con 0x7fe0240bb630 2020-11-20T12:14:18.294 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.282+0000 7fe029940700 1 -- 172.21.15.192:0/1278045842 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0240699a0 con 0x7fe0240bb630 2020-11-20T12:14:18.294 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.282+0000 7fe00affd700 1 -- 172.21.15.192:0/1278045842 <== mon.2 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fe018010070 con 0x7fe0240bb630 2020-11-20T12:14:18.295 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.283+0000 7fe00affd700 1 --2- 172.21.15.192:0/1278045842 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fe0000806a0 0x7fe000082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:18.295 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.283+0000 7fe00affd700 1 -- 172.21.15.192:0/1278045842 <== mon.2 v2:172.21.15.192:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fe0180a2680 con 0x7fe0240bb630 2020-11-20T12:14:18.295 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.283+0000 7fe0227fc700 1 --2- 172.21.15.192:0/1278045842 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fe0000806a0 0x7fe000082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:18.295 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.283+0000 7fe0227fc700 1 --2- 172.21.15.192:0/1278045842 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fe0000806a0 0x7fe000082b60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fe0240bac20 tx=0x7fe014007a40).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:18.296 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.289+0000 7fe00affd700 1 -- 172.21.15.192:0/1278045842 <== mon.2 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fe018077090 con 0x7fe0240bb630 2020-11-20T12:14:18.433 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.430+0000 7fe029940700 1 -- 172.21.15.192:0/1278045842 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"} v 0) v1 -- 0x7fe02405ca80 con 0x7fe0240bb630 2020-11-20T12:14:18.441 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.438+0000 7fe00affd700 1 -- 172.21.15.192:0/1278045842 <== mon.2 v2:172.21.15.192:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe018007c70 con 0x7fe0240bb630 2020-11-20T12:14:18.441 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.438+0000 7fe00affd700 1 -- 172.21.15.192:0/1278045842 <== mon.2 v2:172.21.15.192:3300/0 8 ==== mon_command_ack([{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}]=0 v2) v1 ==== 123+0+0 (secure 0 0 0) 0x7fe01807a6b0 con 0x7fe0240bb630 2020-11-20T12:14:18.444 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.440+0000 7fe029940700 1 -- 172.21.15.192:0/1278045842 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fe0000806a0 msgr2=0x7fe000082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:18.444 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.440+0000 7fe029940700 1 --2- 172.21.15.192:0/1278045842 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fe0000806a0 0x7fe000082b60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fe0240bac20 tx=0x7fe014007a40).stop 2020-11-20T12:14:18.444 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.440+0000 7fe029940700 1 -- 172.21.15.192:0/1278045842 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0240bb630 msgr2=0x7fe0241511a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:18.445 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.440+0000 7fe029940700 1 --2- 172.21.15.192:0/1278045842 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0240bb630 0x7fe0241511a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fe01800c710 tx=0x7fe018007b10).stop 2020-11-20T12:14:18.445 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.440+0000 7fe029940700 1 -- 172.21.15.192:0/1278045842 shutdown_connections 2020-11-20T12:14:18.445 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.440+0000 7fe029940700 1 --2- 172.21.15.192:0/1278045842 >> [v2:172.21.15.192:6800/22925,v1:172.21.15.192:6801/22925] conn(0x7fe0000806a0 0x7fe000082b60 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.445 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.440+0000 7fe029940700 1 --2- 172.21.15.192:0/1278045842 >> [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] conn(0x7fe02414a840 0x7fe024146f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.445 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.440+0000 7fe029940700 1 --2- 172.21.15.192:0/1278045842 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0240bb630 0x7fe0241511a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.446 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.440+0000 7fe029940700 1 --2- 172.21.15.192:0/1278045842 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0240bbae0 0x7fe024146a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.446 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.441+0000 7fe029940700 1 -- 172.21.15.192:0/1278045842 >> 172.21.15.192:0/1278045842 conn(0x7fe024062100 msgr2=0x7fe0240601b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:18.446 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.441+0000 7fe029940700 1 -- 172.21.15.192:0/1278045842 shutdown_connections 2020-11-20T12:14:18.446 INFO:teuthology.orchestra.run.smithi192.stderr:2020-11-20T12:14:18.441+0000 7fe029940700 1 -- 172.21.15.192:0/1278045842 wait complete. 2020-11-20T12:14:18.455 INFO:teuthology.misc:Shutting down mds daemons... 2020-11-20T12:14:18.456 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-11-20T12:14:18.456 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:14:18.464 INFO:tasks.ceph.mds.a:Stopped 2020-11-20T12:14:18.464 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-11-20T12:14:18.465 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:14:20.642 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2020-11-20T12:14:24.567 INFO:tasks.ceph.mds.b:Stopped 2020-11-20T12:14:24.568 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2020-11-20T12:14:24.568 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:14:24.661 INFO:tasks.ceph.mds.c:Stopped 2020-11-20T12:14:24.662 INFO:teuthology.misc:Shutting down osd daemons... 2020-11-20T12:14:24.663 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2020-11-20T12:14:24.663 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:14:24.727 INFO:tasks.ceph.osd.0:Stopped 2020-11-20T12:14:24.728 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2020-11-20T12:14:24.728 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:14:24.784 INFO:tasks.ceph.osd.3:Stopped 2020-11-20T12:14:24.785 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2020-11-20T12:14:24.785 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:14:24.855 INFO:tasks.ceph.osd.6:Stopped 2020-11-20T12:14:24.856 DEBUG:tasks.ceph.osd.9:waiting for process to exit 2020-11-20T12:14:24.856 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:14:24.898 INFO:tasks.ceph.osd.9:Stopped 2020-11-20T12:14:24.898 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2020-11-20T12:14:24.899 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:14:24.975 INFO:tasks.ceph.osd.1:Stopped 2020-11-20T12:14:24.975 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2020-11-20T12:14:24.976 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:14:25.049 INFO:tasks.ceph.osd.4:Stopped 2020-11-20T12:14:25.050 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2020-11-20T12:14:25.050 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:14:25.112 INFO:tasks.ceph.osd.7:Stopped 2020-11-20T12:14:25.113 DEBUG:tasks.ceph.osd.10:waiting for process to exit 2020-11-20T12:14:25.113 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:14:25.190 INFO:tasks.ceph.osd.10:Stopped 2020-11-20T12:14:25.190 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2020-11-20T12:14:25.191 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:14:25.246 INFO:tasks.ceph.osd.2:Stopped 2020-11-20T12:14:25.247 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2020-11-20T12:14:25.247 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:14:25.344 INFO:tasks.ceph.osd.5:Stopped 2020-11-20T12:14:25.346 DEBUG:tasks.ceph.osd.8:waiting for process to exit 2020-11-20T12:14:25.346 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:14:25.433 INFO:tasks.ceph.osd.8:Stopped 2020-11-20T12:14:25.434 DEBUG:tasks.ceph.osd.11:waiting for process to exit 2020-11-20T12:14:25.434 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:14:25.518 INFO:tasks.ceph.osd.11:Stopped 2020-11-20T12:14:25.518 INFO:teuthology.misc:Shutting down mgr daemons... 2020-11-20T12:14:25.518 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2020-11-20T12:14:25.519 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:14:25.542 INFO:tasks.ceph.mgr.x:Stopped 2020-11-20T12:14:25.543 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2020-11-20T12:14:25.543 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:14:25.567 INFO:tasks.ceph.mgr.y:Stopped 2020-11-20T12:14:25.568 DEBUG:tasks.ceph.mgr.z:waiting for process to exit 2020-11-20T12:14:25.568 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:14:25.591 INFO:tasks.ceph.mgr.z:Stopped 2020-11-20T12:14:25.592 INFO:teuthology.misc:Shutting down mon daemons... 2020-11-20T12:14:25.592 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2020-11-20T12:14:25.593 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:14:25.609 INFO:tasks.ceph.mon.a:Stopped 2020-11-20T12:14:25.609 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2020-11-20T12:14:25.610 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:14:25.631 INFO:tasks.ceph.mon.b:Stopped 2020-11-20T12:14:25.632 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2020-11-20T12:14:25.632 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:14:25.659 INFO:tasks.ceph.mon.c:Stopped 2020-11-20T12:14:25.659 INFO:tasks.ceph:Checking cluster log for badness... 2020-11-20T12:14:25.660 INFO:teuthology.orchestra.run.smithi192:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2020-11-20T12:14:25.661 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2020-11-20T12:14:25.661 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2020-11-20T12:14:25.763 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi192.front.sepia.ceph.com 2020-11-20T12:14:25.764 INFO:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2020-11-20T12:14:27.015 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi192.front.sepia.ceph.com 2020-11-20T12:14:27.016 INFO:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2020-11-20T12:14:27.180 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi192.front.sepia.ceph.com 2020-11-20T12:14:27.181 INFO:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2020-11-20T12:14:27.275 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-9 on ubuntu@smithi192.front.sepia.ceph.com 2020-11-20T12:14:27.275 INFO:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-9 2020-11-20T12:14:27.425 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi146.front.sepia.ceph.com 2020-11-20T12:14:27.426 INFO:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2020-11-20T12:14:28.740 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi146.front.sepia.ceph.com 2020-11-20T12:14:28.741 INFO:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2020-11-20T12:14:28.941 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi146.front.sepia.ceph.com 2020-11-20T12:14:28.942 INFO:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2020-11-20T12:14:29.095 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-10 on ubuntu@smithi146.front.sepia.ceph.com 2020-11-20T12:14:29.095 INFO:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-10 2020-11-20T12:14:29.275 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi087.front.sepia.ceph.com 2020-11-20T12:14:29.276 INFO:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2020-11-20T12:14:29.835 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi087.front.sepia.ceph.com 2020-11-20T12:14:29.835 INFO:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2020-11-20T12:14:29.958 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-8 on ubuntu@smithi087.front.sepia.ceph.com 2020-11-20T12:14:29.959 INFO:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-8 2020-11-20T12:14:30.056 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-11 on ubuntu@smithi087.front.sepia.ceph.com 2020-11-20T12:14:30.057 INFO:teuthology.orchestra.run.smithi087:> sync && sudo umount -f /var/lib/ceph/osd/ceph-11 2020-11-20T12:14:30.156 INFO:tasks.ceph:Archiving mon data... 2020-11-20T12:14:30.158 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640275/data/mon.a.tgz 2020-11-20T12:14:30.159 INFO:teuthology.orchestra.run.smithi192:> mktemp 2020-11-20T12:14:30.174 INFO:teuthology.orchestra.run.smithi192.stdout:/tmp/tmp.HDupcKhS3A 2020-11-20T12:14:30.175 INFO:teuthology.orchestra.run.smithi192:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.HDupcKhS3A 2020-11-20T12:14:30.447 INFO:teuthology.orchestra.run.smithi192:> sudo chmod 0666 /tmp/tmp.HDupcKhS3A 2020-11-20T12:14:30.663 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2020-11-20T12:14:30.687 DEBUG:teuthology.orchestra.remote:smithi192:/tmp/tmp.HDupcKhS3A is 539KB 2020-11-20T12:14:30.812 INFO:teuthology.orchestra.run.smithi192:> rm -fr /tmp/tmp.HDupcKhS3A 2020-11-20T12:14:30.839 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640275/data/mon.b.tgz 2020-11-20T12:14:30.840 INFO:teuthology.orchestra.run.smithi146:> mktemp 2020-11-20T12:14:30.868 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.K9foNgyYq1 2020-11-20T12:14:30.868 INFO:teuthology.orchestra.run.smithi146:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.K9foNgyYq1 2020-11-20T12:14:31.237 INFO:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.K9foNgyYq1 2020-11-20T12:14:31.465 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.K9foNgyYq1 is 539KB 2020-11-20T12:14:31.534 INFO:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.K9foNgyYq1 2020-11-20T12:14:31.551 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640275/data/mon.c.tgz 2020-11-20T12:14:31.552 INFO:teuthology.orchestra.run.smithi087:> mktemp 2020-11-20T12:14:31.587 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.brnAhvRL9Q 2020-11-20T12:14:31.588 INFO:teuthology.orchestra.run.smithi087:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.brnAhvRL9Q 2020-11-20T12:14:31.863 INFO:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.brnAhvRL9Q 2020-11-20T12:14:31.999 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.brnAhvRL9Q is 528KB 2020-11-20T12:14:32.045 INFO:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.brnAhvRL9Q 2020-11-20T12:14:32.060 INFO:tasks.ceph:Cleaning ceph cluster... 2020-11-20T12:14:32.060 INFO:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2020-11-20T12:14:32.107 INFO:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2020-11-20T12:14:32.111 INFO:teuthology.orchestra.run.smithi192:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2020-11-20T12:14:32.248 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2020-11-20T12:14:32.248 INFO:teuthology.orchestra.run.smithi192:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2020-11-20T12:14:32.253 INFO:teuthology.orchestra.run.smithi146:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2020-11-20T12:14:32.257 INFO:teuthology.orchestra.run.smithi087:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2020-11-20T12:14:32.276 INFO:teuthology.orchestra.run.smithi192.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2020-11-20T12:14:32.281 INFO:teuthology.orchestra.run.smithi146.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2020-11-20T12:14:32.284 INFO:teuthology.orchestra.run.smithi087.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2020-11-20T12:14:32.309 INFO:tasks.ceph:Archiving crash dumps... 2020-11-20T12:14:32.319 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640275/remote/smithi192/crash 2020-11-20T12:14:32.324 INFO:teuthology.orchestra.run.smithi192:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2020-11-20T12:14:32.375 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640275/remote/smithi146/crash 2020-11-20T12:14:32.378 INFO:teuthology.orchestra.run.smithi146:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2020-11-20T12:14:32.406 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640275/remote/smithi087/crash 2020-11-20T12:14:32.408 INFO:teuthology.orchestra.run.smithi087:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2020-11-20T12:14:32.433 INFO:tasks.ceph:Shutting down logrotate 2020-11-20T12:15:35.530 INFO:teuthology.orchestra.run.smithi146.stderr:ceph-osd: no process found